Skip to content
Local AI Wizard
Your machine
Theme

Granite Embedding Small English R2

IBM · ibm-granite/granite-embedding-small-english-r2

Weights license: Apache 2.0 · code and components may use other terms

MTEB (Multilingual, v2)No sourced MTEB resultNo sourced MTEB result
Memory needed~3 GB8-bit planning estimate · not measured
Parameters48 MSee technical details for the basis
Dimensions · context3848,192 tokens

Quality

Not in the MTEB ranking

The MTEB results dataset covers 25 of 131 tasks of MTEB (Multilingual, v2); a mean over a partial task set is not comparable, so none is computed.

Sourced benchmarks
MTEB (eng, v2)mean(task) · 384d61.07independent run
2026-10-25

Reported by the publisher

The card has 1 evaluation table, but none of their columns has been matched to this checkpoint yet (read 2026-10-25); no value is copied from another column. This stays an open gap. tables on the card, column not matched yet · read 2026-10-25

Quality × memory

No comparable quality × memory pair

Embedding memory estimates cluster at a few GB, so a quality × memory chart would not separate these models; MTEB is ranked above instead.

Runs on

Fast memory holds it 119

The planning estimate fits the memory the model can use quickly: graphics card VRAM, or unified memory within the macOS GPU share.

Show all 119

Hardware profiles grouped by the embedding planning estimate (8-bit weights, 20% allowance, 2 GB reserve). Not a measured fit.

Consider it for

Consider Granite Embedding Small English R2 for retrieval and semantic search: it turns text into 384-dimension vectors.

Check first

The publisher states no memory figure; the hardware list uses a ~3 GB planning estimate, a ceiling and not a measurement. PT-BR is not confirmed by a source.

Measured speed

No published measurement for this checkpoint

Throughput (texts per second) is shown only when a source publishes it with hardware, build and setup. It is never estimated.

How to run

The planning estimate uses 8-bit weights, 20% working allowance and a 2 GB reserve; it is a ceiling, not a measurement.

Runs in
Sentence Transformerssource
Languages · PT-BR
EnglishPT-BR unconfirmed

Documented ways to run it

Copied as printed in the linked source (read 2026-10-18); not run by this site.

Setup stated first by the source · Sentence Transformers
pip install sentence_transformers
Sentence Transformers · model card · Usage
from sentence_transformers import SentenceTransformer, util

model_path = "ibm-granite/granite-embedding-small-english-r2"
# Load the Sentence Transformer model
model = SentenceTransformer(model_path)

input_queries = [
    ' Who made the song My achy breaky heart? ',
    'summit define'
    ]

input_passages = [
    "Achy Breaky Heart is a country song written by Don Von Tress. Originally titled Don't Tell My Heart and performed by The Marcy Brothers in 1991. ",
    "Definition of summit for English Language Learners. : 1 the highest point of a mountain : the top of a mountain. : 2 the highest level. : 3 a meeting or series of meetings between the leaders of two or more governments."
    ]

# encode queries and passages. The model produces unnormalized vectors. If your task requires normalized embeddings pass normalize_embeddings=True to encode as below.
query_embeddings = model.encode(input_queries)
passage_embeddings = model.encode(input_passages)

# calculate cosine similarity
print(util.cos_sim(query_embeddings, passage_embeddings))
Setup stated first by the source · Transformers
pip install transformers torch
Transformers · model card · Usage
import torch
from transformers import AutoModel, AutoTokenizer

model_path = "ibm-granite/granite-embedding-small-english-r2"

# Load the model and tokenizer
model = AutoModel.from_pretrained(model_path)
tokenizer = AutoTokenizer.from_pretrained(model_path)
model.eval()

input_queries = [
    ' Who made the song My achy breaky heart? ',
    'summit define'
    ]

# tokenize inputs
tokenized_queries = tokenizer(input_queries, padding=True, truncation=True, return_tensors='pt')

# encode queries
with torch.no_grad():
    # Queries
    model_output = model(**tokenized_queries)
    # Perform pooling. granite-embedding-278m-multilingual uses CLS Pooling
    query_embeddings = model_output[0][:, 0]

# normalize the embeddings
query_embeddings = torch.nn.functional.normalize(query_embeddings, dim=1)

Choose my computer

Technical details

What the source and the catalog store for this checkpoint. Missing fields are left out, never zero.

Task
embeddings for search (feature extraction)
Library in source
Sentence Transformers
Weight license
Apache 2.0
Commercial use
Allowed Apache License 2.0 text (SPDX) · read 2026-10-18license text
Parameter basis
Hub safetensors total (47,662,464 parameters, read 2026-10-09 from the Hub API).
Announced
2025-08-15

Sources

Identity and published specifications come from the checkpoint page. Benchmark scores belong to the named release and do not measure speed on your computer.

Curated facts checked: 2026-10-09. Each value cites its source (the publisher's card or the MTEB results dataset); estimates are labelled as estimates, and a value no source states stays empty. A repository commit is not a model release date.