Multilingual E5 Base
intfloat · intfloat/multilingual-e5-base
Weights license: MIT · code and components may use other terms
Quality
MTEB (Multilingual, v2)
Mean(task) · 0–100 · higher is better · this model outlined
- Color = publisher
Source: MTEB results dataset (independent runs, CC0) · publisher-reported where the model card is the only source · other benchmarks and versions are not mixed in
| MTEB (Multilingual, v2) | mean(task) · 768d | 57.03 | independent run |
|---|---|---|---|
| MTEB (eng, v2) | mean(task) · 768d | 61.00 | independent run |
Reported by the publisher
- MTEB AmazonCounterfactualClassification (en) (en; test; accuracy)
- 78.970Classification
- MTEB AmazonCounterfactualClassification (de) (de; test; accuracy)
- 71.724Classification
- MTEB AmazonCounterfactualClassification (en-ext) (en-ext; test; accuracy)
- 79.655Classification
- MTEB AmazonCounterfactualClassification (ja) (ja; test; accuracy)
- 73.330Classification
- MTEB AmazonPolarityClassification (test; accuracy)
- 90.638Classification
- MTEB AmazonReviewsClassification (en) (en; test; accuracy)
- 44.546Classification
- MTEB AmazonReviewsClassification (de) (de; test; accuracy)
- 41.828Classification
- MTEB AmazonReviewsClassification (es) (es; test; accuracy)
- 40.534Classification
Every reported result
- MTEB AmazonReviewsClassification (fr) (fr; test; accuracy)
- 39.684Classification
- MTEB AmazonReviewsClassification (ja) (ja; test; accuracy)
- 37.436Classification
- MTEB AmazonReviewsClassification (zh) (zh; test; accuracy)
- 37.226Classification
- MTEB ArguAna (test; ndcg_at_10)
- 44.230Retrieval
- MTEB ArxivClusteringP2P (test; v_measure)
- 40.278Clustering
- MTEB ArxivClusteringS2S (test; v_measure)
- 35.420Clustering
- MTEB AskUbuntuDupQuestions (test; map)
- 58.228Reranking
- MTEB BIOSSES (test; cos_sim_spearman)
- 85.059STS
- MTEB BUCC (de-en) (de-en; test; f1)
- 99.127BitextMining
- MTEB BUCC (fr-en) (fr-en; test; f1)
- 97.593BitextMining
- MTEB BUCC (ru-en) (ru-en; test; f1)
- 97.199BitextMining
- MTEB BUCC (zh-en) (zh-en; test; f1)
- 98.297BitextMining
- MTEB Banking77Classification (test; accuracy)
- 82.740Classification
- MTEB BiorxivClusteringP2P (test; v_measure)
- 35.038Clustering
- MTEB BiorxivClusteringS2S (test; v_measure)
- 29.460Clustering
- MTEB CQADupstackAndroidRetrieval (test; ndcg_at_10)
- 47.825Retrieval
- MTEB CQADupstackEnglishRetrieval (test; ndcg_at_10)
- 44.059Retrieval
- MTEB CQADupstackGamingRetrieval (test; ndcg_at_10)
- 59.198Retrieval
- MTEB CQADupstackGisRetrieval (test; ndcg_at_10)
- 34.929Retrieval
- MTEB CQADupstackMathematicaRetrieval (test; ndcg_at_10)
- 27.029Retrieval
- MTEB CQADupstackPhysicsRetrieval (test; ndcg_at_10)
- 41.577Retrieval
- MTEB CQADupstackProgrammersRetrieval (test; ndcg_at_10)
- 40.697Retrieval
- MTEB CQADupstackRetrieval (test; ndcg_at_10)
- 38.521Retrieval
- MTEB CQADupstackStatsRetrieval (test; ndcg_at_10)
- 32.587Retrieval
- MTEB CQADupstackTexRetrieval (test; ndcg_at_10)
- 27.306Retrieval
- MTEB CQADupstackUnixRetrieval (test; ndcg_at_10)
- 36.729Retrieval
- MTEB CQADupstackWebmastersRetrieval (test; ndcg_at_10)
- 39.208Retrieval
- MTEB CQADupstackWordpressRetrieval (test; ndcg_at_10)
- 31.113Retrieval
- MTEB ClimateFEVER (test; ndcg_at_10)
- 23.856Retrieval
- MTEB DBPedia (test; ndcg_at_10)
- 40.356Retrieval
- MTEB EmotionClassification (test; accuracy)
- 45.18Classification
- MTEB FEVER (test; ndcg_at_10)
- 79.443Retrieval
- MTEB FiQA2018 (test; ndcg_at_10)
- 38.169Retrieval
- MTEB HotpotQA (test; ndcg_at_10)
- 68.557Retrieval
- MTEB ImdbClassification (test; accuracy)
- 85.460Classification
- MTEB MSMARCO (dev; ndcg_at_10)
- 42.274Retrieval
- MTEB MTOPDomainClassification (en) (en; test; accuracy)
- 93.133Classification
- MTEB MTOPDomainClassification (de) (de; test; accuracy)
- 89.625Classification
- MTEB MTOPDomainClassification (es) (es; test; accuracy)
- 90.590Classification
- MTEB MTOPDomainClassification (fr) (fr; test; accuracy)
- 86.210Classification
- MTEB MTOPDomainClassification (hi) (hi; test; accuracy)
- 87.318Classification
- MTEB MTOPDomainClassification (th) (th; test; accuracy)
- 86.242Classification
- MTEB MTOPIntentClassification (en) (en; test; accuracy)
- 75.271Classification
- MTEB MTOPIntentClassification (de) (de; test; accuracy)
- 71.234Classification
- MTEB MTOPIntentClassification (es) (es; test; accuracy)
- 71.274Classification
- MTEB MTOPIntentClassification (fr) (fr; test; accuracy)
- 67.682Classification
- MTEB MTOPIntentClassification (hi) (hi; test; accuracy)
- 69.236Classification
- MTEB MTOPIntentClassification (th) (th; test; accuracy)
- 71.714Classification
- MTEB MassiveIntentClassification (af) (af; test; accuracy)
- 59.976Classification
- MTEB MassiveIntentClassification (am) (am; test; accuracy)
- 53.655Classification
- MTEB MassiveIntentClassification (ar) (ar; test; accuracy)
- 57.458Classification
- MTEB MassiveIntentClassification (az) (az; test; accuracy)
- 62.592Classification
- MTEB MassiveIntentClassification (bn) (bn; test; accuracy)
- 61.126Classification
- MTEB MassiveIntentClassification (cy) (cy; test; accuracy)
- 50.057Classification
- MTEB MassiveIntentClassification (da) (da; test; accuracy)
- 66.644Classification
- MTEB MassiveIntentClassification (de) (de; test; accuracy)
- 66.089Classification
- MTEB MassiveIntentClassification (el) (el; test; accuracy)
- 64.681Classification
- MTEB MassiveIntentClassification (en) (en; test; accuracy)
- 72.112Classification
- MTEB MassiveIntentClassification (es) (es; test; accuracy)
- 68.403Classification
- MTEB MassiveIntentClassification (fa) (fa; test; accuracy)
- 67.246Classification
- MTEB MassiveIntentClassification (fi) (fi; test; accuracy)
- 65.783Classification
- MTEB MassiveIntentClassification (fr) (fr; test; accuracy)
- 67.946Classification
- MTEB MassiveIntentClassification (he) (he; test; accuracy)
- 62.051Classification
- MTEB MassiveIntentClassification (hi) (hi; test; accuracy)
- 64.953Classification
- MTEB MassiveIntentClassification (hu) (hu; test; accuracy)
- 64.973Classification
- MTEB MassiveIntentClassification (hy) (hy; test; accuracy)
- 60.081Classification
- MTEB MassiveIntentClassification (id) (id; test; accuracy)
- 66.638Classification
- MTEB MassiveIntentClassification (is) (is; test; accuracy)
- 56.385Classification
- MTEB MassiveIntentClassification (it) (it; test; accuracy)
- 68.931Classification
- MTEB MassiveIntentClassification (ja) (ja; test; accuracy)
- 68.944Classification
- MTEB MassiveIntentClassification (jv) (jv; test; accuracy)
- 54.260Classification
- MTEB MassiveIntentClassification (ka) (ka; test; accuracy)
- 48.988Classification
- MTEB MassiveIntentClassification (km) (km; test; accuracy)
- 44.687Classification
- MTEB MassiveIntentClassification (kn) (kn; test; accuracy)
- 59.193Classification
- MTEB MassiveIntentClassification (ko) (ko; test; accuracy)
- 66.338Classification
- MTEB MassiveIntentClassification (lv) (lv; test; accuracy)
- 60.340Classification
- MTEB MassiveIntentClassification (ml) (ml; test; accuracy)
- 63.093Classification
- MTEB MassiveIntentClassification (mn) (mn; test; accuracy)
- 58.759Classification
- MTEB MassiveIntentClassification (ms) (ms; test; accuracy)
- 62.485Classification
- MTEB MassiveIntentClassification (my) (my; test; accuracy)
- 58.564Classification
- MTEB MassiveIntentClassification (nb) (nb; test; accuracy)
- 66.180Classification
- MTEB MassiveIntentClassification (nl) (nl; test; accuracy)
- 67.303Classification
- MTEB MassiveIntentClassification (pl) (pl; test; accuracy)
- 68.369Classification
- MTEB MassiveIntentClassification (pt) (pt; test; accuracy)
- 68.981Classification
- MTEB MassiveIntentClassification (ro) (ro; test; accuracy)
- 65.538Classification
- MTEB MassiveIntentClassification (ru) (ru; test; accuracy)
- 69.018Classification
- MTEB MassiveIntentClassification (sl) (sl; test; accuracy)
- 62.347Classification
- MTEB MassiveIntentClassification (sq) (sq; test; accuracy)
- 61.234Classification
- MTEB MassiveIntentClassification (sv) (sv; test; accuracy)
- 68.541Classification
- MTEB MassiveIntentClassification (sw) (sw; test; accuracy)
- 55.999Classification
- MTEB MassiveIntentClassification (ta) (ta; test; accuracy)
- 58.712Classification
- MTEB MassiveIntentClassification (te) (te; test; accuracy)
- 59.724Classification
- MTEB MassiveIntentClassification (th) (th; test; accuracy)
- 65.595Classification
- MTEB MassiveIntentClassification (tl) (tl; test; accuracy)
- 60.861Classification
- MTEB MassiveIntentClassification (tr) (tr; test; accuracy)
- 67.408Classification
- MTEB MassiveIntentClassification (ur) (ur; test; accuracy)
- 61.523Classification
- MTEB MassiveIntentClassification (vi) (vi; test; accuracy)
- 66.170Classification
- MTEB MassiveIntentClassification (zh-CN) (zh-CN; test; accuracy)
- 69.156Classification
- MTEB MassiveIntentClassification (zh-TW) (zh-TW; test; accuracy)
- 64.650Classification
- MTEB MassiveScenarioClassification (af) (af; test; accuracy)
- 65.087Classification
- MTEB MassiveScenarioClassification (am) (am; test; accuracy)
- 58.524Classification
- MTEB MassiveScenarioClassification (ar) (ar; test; accuracy)
- 62.239Classification
- MTEB MassiveScenarioClassification (az) (az; test; accuracy)
- 63.749Classification
- MTEB MassiveScenarioClassification (bn) (bn; test; accuracy)
- 65.003Classification
- MTEB MassiveScenarioClassification (cy) (cy; test; accuracy)
- 52.838Classification
- MTEB MassiveScenarioClassification (da) (da; test; accuracy)
- 72.421Classification
- MTEB MassiveScenarioClassification (de) (de; test; accuracy)
- 71.954Classification
- MTEB MassiveScenarioClassification (el) (el; test; accuracy)
- 70.182Classification
- MTEB MassiveScenarioClassification (en) (en; test; accuracy)
- 77.081Classification
- MTEB MassiveScenarioClassification (es) (es; test; accuracy)
- 71.503Classification
- MTEB MassiveScenarioClassification (fa) (fa; test; accuracy)
- 70.245Classification
- MTEB MassiveScenarioClassification (fi) (fi; test; accuracy)
- 69.129Classification
- MTEB MassiveScenarioClassification (fr) (fr; test; accuracy)
- 71.893Classification
- MTEB MassiveScenarioClassification (he) (he; test; accuracy)
- 67.445Classification
- MTEB MassiveScenarioClassification (hi) (hi; test; accuracy)
- 69.163Classification
- MTEB MassiveScenarioClassification (hu) (hu; test; accuracy)
- 70.753Classification
- MTEB MassiveScenarioClassification (hy) (hy; test; accuracy)
- 63.144Classification
- MTEB MassiveScenarioClassification (id) (id; test; accuracy)
- 70.703Classification
- MTEB MassiveScenarioClassification (is) (is; test; accuracy)
- 60.938Classification
- MTEB MassiveScenarioClassification (it) (it; test; accuracy)
- 72.320Classification
- MTEB MassiveScenarioClassification (ja) (ja; test; accuracy)
- 74.654Classification
- MTEB MassiveScenarioClassification (jv) (jv; test; accuracy)
- 59.694Classification
- MTEB MassiveScenarioClassification (ka) (ka; test; accuracy)
- 54.375Classification
- MTEB MassiveScenarioClassification (km) (km; test; accuracy)
- 48.309Classification
- MTEB MassiveScenarioClassification (kn) (kn; test; accuracy)
- 62.152Classification
- MTEB MassiveScenarioClassification (ko) (ko; test; accuracy)
- 72.448Classification
- MTEB MassiveScenarioClassification (lv) (lv; test; accuracy)
- 62.814Classification
- MTEB MassiveScenarioClassification (ml) (ml; test; accuracy)
- 68.043Classification
- MTEB MassiveScenarioClassification (mn) (mn; test; accuracy)
- 61.439Classification
- MTEB MassiveScenarioClassification (ms) (ms; test; accuracy)
- 66.903Classification
- MTEB MassiveScenarioClassification (my) (my; test; accuracy)
- 61.638Classification
- MTEB MassiveScenarioClassification (nb) (nb; test; accuracy)
- 71.631Classification
- MTEB MassiveScenarioClassification (nl) (nl; test; accuracy)
- 72.108Classification
- MTEB MassiveScenarioClassification (pl) (pl; test; accuracy)
- 70.595Classification
- MTEB MassiveScenarioClassification (pt) (pt; test; accuracy)
- 70.834Classification
- MTEB MassiveScenarioClassification (ro) (ro; test; accuracy)
- 69.186Classification
- MTEB MassiveScenarioClassification (ru) (ru; test; accuracy)
- 72.993Classification
- MTEB MassiveScenarioClassification (sl) (sl; test; accuracy)
- 65.262Classification
- MTEB MassiveScenarioClassification (sq) (sq; test; accuracy)
- 66.486Classification
- MTEB MassiveScenarioClassification (sv) (sv; test; accuracy)
- 73.144Classification
- MTEB MassiveScenarioClassification (sw) (sw; test; accuracy)
- 59.886Classification
- MTEB MassiveScenarioClassification (ta) (ta; test; accuracy)
- 62.384Classification
- MTEB MassiveScenarioClassification (te) (te; test; accuracy)
- 62.586Classification
- MTEB MassiveScenarioClassification (th) (th; test; accuracy)
- 71.614Classification
- MTEB MassiveScenarioClassification (tl) (tl; test; accuracy)
- 62.737Classification
- MTEB MassiveScenarioClassification (tr) (tr; test; accuracy)
- 71.668Classification
- MTEB MassiveScenarioClassification (ur) (ur; test; accuracy)
- 64.640Classification
- MTEB MassiveScenarioClassification (vi) (vi; test; accuracy)
- 70.007Classification
- MTEB MassiveScenarioClassification (zh-CN) (zh-CN; test; accuracy)
- 75.420Classification
- MTEB MassiveScenarioClassification (zh-TW) (zh-TW; test; accuracy)
- 70.693Classification
- MTEB MedrxivClusteringP2P (test; v_measure)
- 28.917Clustering
- MTEB MedrxivClusteringS2S (test; v_measure)
- 28.434Clustering
- MTEB MindSmallReranking (test; map)
- 30.967Reranking
- MTEB NFCorpus (test; ndcg_at_10)
- 32.465Retrieval
- MTEB NQ (test; ndcg_at_10)
- 60.018Retrieval
- MTEB QuoraRetrieval (test; ndcg_at_10)
- 87.648Retrieval
- MTEB RedditClustering (test; v_measure)
- 42.413Clustering
- MTEB RedditClusteringP2P (test; v_measure)
- 55.171Clustering
- MTEB SCIDOCS (test; ndcg_at_10)
- 17.164Retrieval
- MTEB SICK-R (test; cos_sim_spearman)
- 78.512STS
- MTEB STS12 (test; cos_sim_spearman)
- 76.697STS
- MTEB STS13 (test; cos_sim_spearman)
- 78.026STS
- MTEB STS14 (test; cos_sim_spearman)
- 76.600STS
- MTEB STS15 (test; cos_sim_spearman)
- 88.157STS
- MTEB STS16 (test; cos_sim_spearman)
- 84.285STS
- MTEB STS17 (ko-ko) (ko-ko; test; cos_sim_spearman)
- 79.946STS
- MTEB STS17 (ar-ar) (ar-ar; test; cos_sim_spearman)
- 74.525STS
- MTEB STS17 (en-ar) (en-ar; test; cos_sim_spearman)
- 71.267STS
- MTEB STS17 (en-de) (en-de; test; cos_sim_spearman)
- 82.085STS
- MTEB STS17 (en-en) (en-en; test; cos_sim_spearman)
- 87.834STS
- MTEB STS17 (en-tr) (en-tr; test; cos_sim_spearman)
- 63.326STS
- MTEB STS17 (es-en) (es-en; test; cos_sim_spearman)
- 76.504STS
- MTEB STS17 (es-es) (es-es; test; cos_sim_spearman)
- 86.737STS
- MTEB STS17 (fr-en) (fr-en; test; cos_sim_spearman)
- 80.175STS
- MTEB STS17 (it-en) (it-en; test; cos_sim_spearman)
- 80.152STS
- MTEB STS17 (nl-en) (nl-en; test; cos_sim_spearman)
- 79.253STS
- MTEB STS22 (en) (en; test; cos_sim_spearman)
- 61.828STS
- MTEB STS22 (de) (de; test; cos_sim_spearman)
- 55.951STS
- MTEB STS22 (es) (es; test; cos_sim_spearman)
- 66.579STS
- MTEB STS22 (pl) (pl; test; cos_sim_spearman)
- 34.135STS
- MTEB STS22 (tr) (tr; test; cos_sim_spearman)
- 63.700STS
- MTEB STS22 (ar) (ar; test; cos_sim_spearman)
- 57.866STS
- MTEB STS22 (ru) (ru; test; cos_sim_spearman)
- 60.664STS
- MTEB STS22 (zh) (zh; test; cos_sim_spearman)
- 65.630STS
- MTEB STS22 (fr) (fr; test; cos_sim_spearman)
- 74.796STS
- MTEB STS22 (de-en) (de-en; test; cos_sim_spearman)
- 54.928STS
- MTEB STS22 (es-en) (es-en; test; cos_sim_spearman)
- 73.990STS
- MTEB STS22 (it) (it; test; cos_sim_spearman)
- 77.761STS
- MTEB STS22 (pl-en) (pl-en; test; cos_sim_spearman)
- 70.373STS
- MTEB STS22 (zh-en) (zh-en; test; cos_sim_spearman)
- 69.923STS
- MTEB STS22 (es-it) (es-it; test; cos_sim_spearman)
- 66.458STS
- MTEB STS22 (de-fr) (de-fr; test; cos_sim_spearman)
- 59.467STS
- MTEB STS22 (de-pl) (de-pl; test; cos_sim_spearman)
- 39.355STS
- MTEB STS22 (fr-pl) (fr-pl; test; cos_sim_spearman)
- 73.247STS
- MTEB STSBenchmark (test; cos_sim_spearman)
- 85.637STS
- MTEB SciDocsRR (test; map)
- 80.739Reranking
- MTEB SciFact (test; ndcg_at_10)
- 69.347Retrieval
- MTEB SprintDuplicateQuestions (test; cos_sim_ap)
- 93.015PairClassification
- MTEB SprintDuplicateQuestions (test; max_ap)
- 93.015PairClassification
- MTEB StackExchangeClustering (test; v_measure)
- 55.266Clustering
- MTEB StackExchangeClusteringP2P (test; v_measure)
- 30.464Clustering
- MTEB StackOverflowDupQuestions (test; map)
- 49.414Reranking
- MTEB SummEval (test; cos_sim_spearman)
- 30.108Summarization
- MTEB TRECCOVID (test; ndcg_at_10)
- 69.757Retrieval
- MTEB Tatoeba (sqi-eng) (sqi-eng; test; f1)
- 90.06BitextMining
- MTEB Tatoeba (fry-eng) (fry-eng; test; f1)
- 50.875BitextMining
- MTEB Tatoeba (kur-eng) (kur-eng; test; f1)
- 52.961BitextMining
- MTEB Tatoeba (tur-eng) (tur-eng; test; f1)
- 92.673BitextMining
- MTEB Tatoeba (deu-eng) (deu-eng; test; f1)
- 97.073BitextMining
- MTEB Tatoeba (nld-eng) (nld-eng; test; f1)
- 93.2BitextMining
- MTEB Tatoeba (ron-eng) (ron-eng; test; f1)
- 91.267BitextMining
- MTEB Tatoeba (ang-eng) (ang-eng; test; f1)
- 29.074BitextMining
- MTEB Tatoeba (ido-eng) (ido-eng; test; f1)
- 74.395BitextMining
- MTEB Tatoeba (jav-eng) (jav-eng; test; f1)
- 61.247BitextMining
- MTEB Tatoeba (isl-eng) (isl-eng; test; f1)
- 76.903BitextMining
- MTEB Tatoeba (slv-eng) (slv-eng; test; f1)
- 81.925BitextMining
- MTEB Tatoeba (cym-eng) (cym-eng; test; f1)
- 65.224BitextMining
- MTEB Tatoeba (kaz-eng) (kaz-eng; test; f1)
- 75.557BitextMining
- MTEB Tatoeba (est-eng) (est-eng; test; f1)
- 70.510BitextMining
- MTEB Tatoeba (heb-eng) (heb-eng; test; f1)
- 74.142BitextMining
- MTEB Tatoeba (gla-eng) (gla-eng; test; f1)
- 43.080BitextMining
- MTEB Tatoeba (mar-eng) (mar-eng; test; f1)
- 86.623BitextMining
- MTEB Tatoeba (lat-eng) (lat-eng; test; f1)
- 39.576BitextMining
- MTEB Tatoeba (bel-eng) (bel-eng; test; f1)
- 86.703BitextMining
- MTEB Tatoeba (pms-eng) (pms-eng; test; f1)
- 44.607BitextMining
- MTEB Tatoeba (gle-eng) (gle-eng; test; f1)
- 58.360BitextMining
- MTEB Tatoeba (pes-eng) (pes-eng; test; f1)
- 87.075BitextMining
- MTEB Tatoeba (nob-eng) (nob-eng; test; f1)
- 95.903BitextMining
- MTEB Tatoeba (bul-eng) (bul-eng; test; f1)
- 88.629BitextMining
- MTEB Tatoeba (cbk-eng) (cbk-eng; test; f1)
- 60.544BitextMining
- MTEB Tatoeba (hun-eng) (hun-eng; test; f1)
- 84.324BitextMining
- MTEB Tatoeba (uig-eng) (uig-eng; test; f1)
- 63.079BitextMining
- MTEB Tatoeba (rus-eng) (rus-eng; test; f1)
- 91.783BitextMining
- MTEB Tatoeba (spa-eng) (spa-eng; test; f1)
- 96.967BitextMining
- MTEB Tatoeba (hye-eng) (hye-eng; test; f1)
- 85.907BitextMining
- MTEB Tatoeba (tel-eng) (tel-eng; test; f1)
- 88.490BitextMining
- MTEB Tatoeba (afr-eng) (afr-eng; test; f1)
- 86.908BitextMining
- MTEB Tatoeba (mon-eng) (mon-eng; test; f1)
- 78.368BitextMining
- MTEB Tatoeba (arz-eng) (arz-eng; test; f1)
- 66.788BitextMining
- MTEB Tatoeba (hrv-eng) (hrv-eng; test; f1)
- 92.503BitextMining
- MTEB Tatoeba (nov-eng) (nov-eng; test; f1)
- 66.833BitextMining
- MTEB Tatoeba (gsw-eng) (gsw-eng; test; f1)
- 43.531BitextMining
- MTEB Tatoeba (nds-eng) (nds-eng; test; f1)
- 53.856BitextMining
- MTEB Tatoeba (ukr-eng) (ukr-eng; test; f1)
- 88.29BitextMining
- MTEB Tatoeba (uzb-eng) (uzb-eng; test; f1)
- 62.634BitextMining
- MTEB Tatoeba (lit-eng) (lit-eng; test; f1)
- 75.526BitextMining
- MTEB Tatoeba (ina-eng) (ina-eng; test; f1)
- 86.108BitextMining
- MTEB Tatoeba (lfn-eng) (lfn-eng; test; f1)
- 52.855BitextMining
- MTEB Tatoeba (zsm-eng) (zsm-eng; test; f1)
- 92.453BitextMining
- MTEB Tatoeba (ita-eng) (ita-eng; test; f1)
- 90.613BitextMining
- MTEB Tatoeba (cmn-eng) (cmn-eng; test; f1)
- 93.346BitextMining
- MTEB Tatoeba (lvs-eng) (lvs-eng; test; f1)
- 76.656BitextMining
- MTEB Tatoeba (glg-eng) (glg-eng; test; f1)
- 82.787BitextMining
- MTEB Tatoeba (ceb-eng) (ceb-eng; test; f1)
- 45.462BitextMining
- MTEB Tatoeba (bre-eng) (bre-eng; test; f1)
- 5.442BitextMining
- MTEB Tatoeba (ben-eng) (ben-eng; test; f1)
- 81.047BitextMining
- MTEB Tatoeba (swg-eng) (swg-eng; test; f1)
- 42.333BitextMining
- MTEB Tatoeba (arq-eng) (arq-eng; test; f1)
- 26.736BitextMining
- MTEB Tatoeba (kab-eng) (kab-eng; test; f1)
- 21.976BitextMining
- MTEB Tatoeba (fra-eng) (fra-eng; test; f1)
- 92.757BitextMining
- MTEB Tatoeba (por-eng) (por-eng; test; f1)
- 92.74BitextMining
- MTEB Tatoeba (tat-eng) (tat-eng; test; f1)
- 66.922BitextMining
- MTEB Tatoeba (oci-eng) (oci-eng; test; f1)
- 35.787BitextMining
- MTEB Tatoeba (pol-eng) (pol-eng; test; f1)
- 94.823BitextMining
- MTEB Tatoeba (war-eng) (war-eng; test; f1)
- 47.179BitextMining
- MTEB Tatoeba (aze-eng) (aze-eng; test; f1)
- 84.71BitextMining
- MTEB Tatoeba (vie-eng) (vie-eng; test; f1)
- 94.683BitextMining
- MTEB Tatoeba (nno-eng) (nno-eng; test; f1)
- 82.558BitextMining
- MTEB Tatoeba (cha-eng) (cha-eng; test; f1)
- 16.949BitextMining
- MTEB Tatoeba (mhr-eng) (mhr-eng; test; f1)
- 5.516BitextMining
- MTEB Tatoeba (dan-eng) (dan-eng; test; f1)
- 91.397BitextMining
- MTEB Tatoeba (ell-eng) (ell-eng; test; f1)
- 89.957BitextMining
- MTEB Tatoeba (amh-eng) (amh-eng; test; f1)
- 74.934BitextMining
- MTEB Tatoeba (pam-eng) (pam-eng; test; f1)
- 6.921BitextMining
- MTEB Tatoeba (hsb-eng) (hsb-eng; test; f1)
- 40.347BitextMining
- MTEB Tatoeba (srp-eng) (srp-eng; test; f1)
- 89.083BitextMining
- MTEB Tatoeba (epo-eng) (epo-eng; test; f1)
- 92.067BitextMining
- MTEB Tatoeba (kzj-eng) (kzj-eng; test; f1)
- 6.200BitextMining
- MTEB Tatoeba (awa-eng) (awa-eng; test; f1)
- 68.389BitextMining
- MTEB Tatoeba (fao-eng) (fao-eng; test; f1)
- 64.724BitextMining
- MTEB Tatoeba (mal-eng) (mal-eng; test; f1)
- 96.725BitextMining
- MTEB Tatoeba (ile-eng) (ile-eng; test; f1)
- 72.427BitextMining
- MTEB Tatoeba (bos-eng) (bos-eng; test; f1)
- 88.861BitextMining
- MTEB Tatoeba (cor-eng) (cor-eng; test; f1)
- 4.383BitextMining
- MTEB Tatoeba (cat-eng) (cat-eng; test; f1)
- 84.094BitextMining
- MTEB Tatoeba (eus-eng) (eus-eng; test; f1)
- 56.158BitextMining
- MTEB Tatoeba (yue-eng) (yue-eng; test; f1)
- 80.662BitextMining
- MTEB Tatoeba (swe-eng) (swe-eng; test; f1)
- 91.33BitextMining
- MTEB Tatoeba (dtp-eng) (dtp-eng; test; f1)
- 5.127BitextMining
- MTEB Tatoeba (kat-eng) (kat-eng; test; f1)
- 77.829BitextMining
- MTEB Tatoeba (jpn-eng) (jpn-eng; test; f1)
- 90.297BitextMining
- MTEB Tatoeba (csb-eng) (csb-eng; test; f1)
- 24.562BitextMining
- MTEB Tatoeba (xho-eng) (xho-eng; test; f1)
- 73.239BitextMining
- MTEB Tatoeba (orv-eng) (orv-eng; test; f1)
- 15.998BitextMining
- MTEB Tatoeba (ind-eng) (ind-eng; test; f1)
- 90.260BitextMining
- MTEB Tatoeba (tuk-eng) (tuk-eng; test; f1)
- 19.657BitextMining
- MTEB Tatoeba (max-eng) (max-eng; test; f1)
- 52.387BitextMining
- MTEB Tatoeba (swh-eng) (swh-eng; test; f1)
- 66.809BitextMining
- MTEB Tatoeba (hin-eng) (hin-eng; test; f1)
- 93BitextMining
- MTEB Tatoeba (dsb-eng) (dsb-eng; test; f1)
- 34.328BitextMining
- MTEB Tatoeba (ber-eng) (ber-eng; test; f1)
- 23.580BitextMining
- MTEB Tatoeba (tam-eng) (tam-eng; test; f1)
- 85.125BitextMining
- MTEB Tatoeba (slk-eng) (slk-eng; test; f1)
- 86.399BitextMining
- MTEB Tatoeba (tgl-eng) (tgl-eng; test; f1)
- 83.780BitextMining
- MTEB Tatoeba (ast-eng) (ast-eng; test; f1)
- 75.306BitextMining
- MTEB Tatoeba (mkd-eng) (mkd-eng; test; f1)
- 73.763BitextMining
- MTEB Tatoeba (khm-eng) (khm-eng; test; f1)
- 47.258BitextMining
- MTEB Tatoeba (ces-eng) (ces-eng; test; f1)
- 88.88BitextMining
- MTEB Tatoeba (tzl-eng) (tzl-eng; test; f1)
- 34.440BitextMining
- MTEB Tatoeba (urd-eng) (urd-eng; test; f1)
- 86.199BitextMining
- MTEB Tatoeba (ara-eng) (ara-eng; test; f1)
- 82.589BitextMining
- MTEB Tatoeba (kor-eng) (kor-eng; test; f1)
- 83.370BitextMining
- MTEB Tatoeba (yid-eng) (yid-eng; test; f1)
- 63.195BitextMining
- MTEB Tatoeba (fin-eng) (fin-eng; test; f1)
- 86.146BitextMining
- MTEB Tatoeba (tha-eng) (tha-eng; test; f1)
- 94.404BitextMining
- MTEB Tatoeba (wuu-eng) (wuu-eng; test; f1)
- 78.653BitextMining
- MTEB Touche2020 (test; ndcg_at_10)
- 21.353Retrieval
- MTEB ToxicConversationsClassification (test; accuracy)
- 69.785Classification
- MTEB TweetSentimentExtractionClassification (test; accuracy)
- 61.282Classification
- MTEB TwentyNewsgroupsClustering (test; v_measure)
- 35.972Clustering
- MTEB TwitterSemEval2015 (test; cos_sim_ap)
- 72.208PairClassification
- MTEB TwitterSemEval2015 (test; max_ap)
- 72.208PairClassification
- MTEB TwitterURLCorpus (test; cos_sim_ap)
- 85.482PairClassification
- MTEB TwitterURLCorpus (test; max_ap)
- 85.482PairClassification
- Avg MRR@10
- 65.9Benchmark Results on Mr. TyDi
- ar
- 72.3Benchmark Results on Mr. TyDi
- bn
- 65.0Benchmark Results on Mr. TyDi
- en
- 58.5Benchmark Results on Mr. TyDi
- fi
- 60.8Benchmark Results on Mr. TyDi
- id
- 64.9Benchmark Results on Mr. TyDi
- ja
- 56.6Benchmark Results on Mr. TyDi
- ko
- 55.8Benchmark Results on Mr. TyDi
- ru
- 62.7Benchmark Results on Mr. TyDi
- sw
- 69.0Benchmark Results on Mr. TyDi
- te
- 86.6Benchmark Results on Mr. TyDi
- th
- 72.7Benchmark Results on Mr. TyDi
Values as printed on the card, with the publisher's own settings (card section: Benchmark Results on Mr. TyDi); column “multilingual-e5-base”. Not comparable across publishers and not used in any ranking. Model card
Quality × memory
No comparable quality × memory pair
Embedding memory estimates cluster at a few GB, so a quality × memory chart would not separate these models; MTEB is ranked above instead.
Consider Multilingual E5 Base for retrieval and semantic search: it turns text into 768-dimension vectors.
The publisher states no memory figure; the hardware list uses a ~3 GB planning estimate, a ceiling and not a measurement. See the prompt format under How to run. PT-BR is confirmed by a source.
Runs on
Fast memory holds it 119
The planning estimate fits the memory the model can use quickly: graphics card VRAM, or unified memory within the macOS GPU share.
Show all 119
Hardware profiles grouped by the embedding planning estimate (8-bit weights, 20% allowance, 2 GB reserve). Not a measured fit.
Measured speed
No published measurement for this checkpoint
Throughput (texts per second) is shown only when a source publishes it with hardware, build and setup. It is never estimated.
How to run
The planning estimate uses 8-bit weights, 20% working allowance and a 2 GB reserve; it is a ceiling, not a measurement.
- Runs in
- Sentence Transformers, Transformerssource
- Query/document prompts
- Required: “query: ” and “passage: ” prefixes for retrieval; “query: ” alone for symmetric tasks, even for non-English text (model card).
- Languages · PT-BR
- 94 languages in the card metadata, Portuguese includedPT-BR confirmed by a source
Documented ways to run it
Copied as printed in the linked source (read 2026-10-18); not run by this site.
pip install sentence_transformers~=2.2.2from sentence_transformers import SentenceTransformer
model = SentenceTransformer('intfloat/multilingual-e5-base')
input_texts = [
'query: how much protein should a female eat',
'query: 南瓜的家常做法',
"passage: As a general guideline, the CDC's average requirement of protein for women ages 19 to 70 i s 46 grams per day. But, as you can see from this chart, you'll need to increase that if you're expecting or traini ng for a marathon. Check out the chart below to see how much protein you should be eating each day.",
"passage: 1.清炒南瓜丝 原料:嫩南瓜半个 调料:葱、盐、白糖、鸡精 做法: 1、南瓜用刀薄薄的削去表面一层皮 ,用勺子刮去瓤 2、擦成细丝(没有擦菜板就用刀慢慢切成细丝) 3、锅烧热放油,入葱花煸出香味 4、入南瓜丝快速翻炒一分钟左右, 放盐、一点白糖和鸡精调味出锅 2.香葱炒南瓜 原料:南瓜1只 调料:香葱、蒜末、橄榄油、盐 做法: 1、将南瓜去皮,切成片 2、油 锅8成热后,将蒜末放入爆香 3、爆香后,将南瓜片放入,翻炒 4、在翻炒的同时,可以不时地往锅里加水,但不要太多 5、放入盐,炒匀 6、南瓜差不多软和绵了之后,就可以关火 7、撒入香葱,即可出锅"
]
embeddings = model.encode(input_texts, normalize_embeddings=True)import torch.nn.functional as F
from torch import Tensor
from transformers import AutoTokenizer, AutoModel
def average_pool(last_hidden_states: Tensor,
attention_mask: Tensor) -> Tensor:
last_hidden = last_hidden_states.masked_fill(~attention_mask[..., None].bool(), 0.0)
return last_hidden.sum(dim=1) / attention_mask.sum(dim=1)[..., None]
# Each input text should start with "query: " or "passage: ", even for non-English texts.
# For tasks other than retrieval, you can simply use the "query: " prefix.
input_texts = ['query: how much protein should a female eat',
'query: 南瓜的家常做法',
"passage: As a general guideline, the CDC's average requirement of protein for women ages 19 to 70 is 46 grams per day. But, as you can see from this chart, you'll need to increase that if you're expecting or training for a marathon. Check out the chart below to see how much protein you should be eating each day.",
"passage: 1.清炒南瓜丝 原料:嫩南瓜半个 调料:葱、盐、白糖、鸡精 做法: 1、南瓜用刀薄薄的削去表面一层皮,用勺子刮去瓤 2、擦成细丝(没有擦菜板就用刀慢慢切成细丝) 3、锅烧热放油,入葱花煸出香味 4、入南瓜丝快速翻炒一分钟左右,放盐、一点白糖和鸡精调味出锅 2.香葱炒南瓜 原料:南瓜1只 调料:香葱、蒜末、橄榄油、盐 做法: 1、将南瓜去皮,切成片 2、油锅8成热后,将蒜末放入爆香 3、爆香后,将南瓜片放入,翻炒 4、在翻炒的同时,可以不时地往锅里加水,但不要太多 5、放入盐,炒匀 6、南瓜差不多软和绵了之后,就可以关火 7、撒入香葱,即可出锅"]
tokenizer = AutoTokenizer.from_pretrained('intfloat/multilingual-e5-base')
model = AutoModel.from_pretrained('intfloat/multilingual-e5-base')
# Tokenize the input texts
batch_dict = tokenizer(input_texts, max_length=512, padding=True, truncation=True, return_tensors='pt')
outputs = model(**batch_dict)
embeddings = average_pool(outputs.last_hidden_state, batch_dict['attention_mask'])
# normalize embeddings
embeddings = F.normalize(embeddings, p=2, dim=1)
scores = (embeddings[:2] @ embeddings[2:].T) * 100
print(scores.tolist())Technical details
What the source and the catalog store for this checkpoint. Missing fields are left out, never zero.
- Checkpoint / source
- intfloat/multilingual-e5-base
- Task
- embeddings for search (feature extraction)
- Library in source
- Sentence Transformers, Transformers
- Weight license
- MIT
- Commercial use
- Allowed MIT license text (SPDX) · read 2026-10-18license text
- Parameter basis
- Hub safetensors total (278,044,162 parameters, read 2026-10-07 from the Hub API); publishers round it in their names.
- Released
- Not published by the publisher. Card body read in full: only a paper year (2024) is stated, no model release date. The paper year is not used as a release date.Checked 2026-10-13.source checked
Small multilingual baseline (12 layers, 768 dimensions, 512-token inputs). Not in Ollama's official library.
Sources
Identity and published specifications come from the checkpoint page. Benchmark scores belong to the named release and do not measure speed on your computer.
- Publisher model card
- Hugging Face model page / card · 2026-10-07
- Hugging Face API (parameters, licence, library) · 2026-10-07
- MTEB results dataset (CC0), scores computed by scripts/ingest-mteb-results.mjs · 2026-10-25
Curated facts checked: 2026-10-07. Each value cites its source (the publisher's card or the MTEB results dataset); estimates are labelled as estimates, and a value no source states stays empty. A repository commit is not a model release date.






























































