RTX 5060 Ti · 8 GB VRAM
NVIDIA · RTX 5060 Ti
279 text models run well · 448 GB/s bandwidth
Models on this hardware
Start here
File Q4_K_M · 0.8 GB · bartowski/Llama-3.2-1B-Instruct-GGUF · What is Q4?
Memory Needs ~1 GB · ~3 GB on RTX 5060 Ti · 8 GB VRAM, including ~2 GB the system keeps
ollama run hf.co/bartowski/Llama-3.2-1B-Instruct-GGUF:Q4_K_M- Install Ollama
- Run the command above
- Ask:
Explain what a context window is, in two sentences.
File Q4_K_M · 2.2 GB · ibm-granite/granite-4.2-3b-GGUF · What is Q4?
Memory Needs ~3 GB · ~5 GB on RTX 5060 Ti · 8 GB VRAM, including ~2 GB the system keeps
ollama run hf.co/ibm-granite/granite-4.2-3b-GGUF:Q4_K_M- Install Ollama
- Run the command above
- Ask:
Explain what a context window is, in two sentences.
Text
Text · LMArena
rating · higher is better
- Color = publisher
Source: LMArena 2026-10-22 · collected 2026-10-25 · dataset · CC BY 4.0 · Models without a rating are left out, not scored as zero.
| Granite 4.2 3BQ4 · published params · source | 1,290 ± 12 | ~5 GB | Q4 · published params |
|---|---|---|---|
| Granite 4.2 8BQ4 · published params · source | 1,290 ± 11 | ~8 GBTight fit: Needs ~8 GB: runs well, nothing left beyond the system reserve | Q4 · published params |
| Llama 3.1 8B InstructQ4 · published params · source | 1,211 ± 4 | ~8 GBTight fit: Needs ~8 GB: runs well, nothing left beyond the system reserve | Q4 · published params |
| Llama 3.2 3B InstructQ4 · published params · source | 1,167 ± 8 | ~5 GB | Q4 · published params |
| Llama 3.2 1B InstructQ4 · published params · source | 1,111 ± 8 | ~3 GB | Q4 · published params |
| Gemma 4 E2BQ4 · published params · source | Not on the LMArena text leaderboard of 2026-10-22 | ~6 GB | Q4 · published params |
| Qwen3 4B Instruct 2507Q4 · published params · source | Not on the LMArena text leaderboard of 2026-10-22 | ~5 GB | Q4 · published params |
| Qwen3 1.7BQ4 · published params · source | Not on the LMArena text leaderboard of 2026-10-22 | ~4 GB | Q4 · published params |
No model within 8 GB has a LiveBench score, so the table has no LiveBench column. LMArena ratings in this table: LMArena 2026-10-22 · collected 2026-10-25 · dataset · CC BY 4.0
Tight fit: it runs, but leaves less than 1 GB free beyond the 2 GB the system keeps (the memory figure already includes that reserve).
Every reviewed text model here 37
Every one that runs here, well or slowly, scored or not (13 run well, 24 slowly); 20 of 37 have a LiveBench or LMArena result. Run well first, then tight fits, then slow; within each, by Hub downloads over 30 days, read 2026-11-19, not by quality.
| Gemma 4 E2B | Not in LiveBench 2026-06-25 | Not on the LMArena text leaderboard of 2026-10-22 | ~6 GB | 3.1 | Apache 2.0 | 2.8M |
|---|---|---|---|---|---|---|
| Qwen3 4B Instruct 2507 | Not in LiveBench 2026-06-25 | Not on the LMArena text leaderboard of 2026-10-22 | ~5 GB | 2.5 | Apache 2.0 | 2.8M |
| Qwen3 1.7B | Not in LiveBench 2026-06-25 | Not on the LMArena text leaderboard of 2026-10-22 | ~4 GB | 1.1 | Apache 2.0 | 2.7M |
| Llama 3.2 1B Instruct | Not in LiveBench 2026-06-25 | 1,111 | ~3 GB | 0.8 | Llama 3.2 | 1.3M |
| Llama 3.2 3B Instruct | Not in LiveBench 2026-06-25 | 1,167 | ~5 GB | 2.0 | Llama 3.2 | 823.8K |
| Phi-4 mini | Not in LiveBench 2026-06-25 | Not on the LMArena text leaderboard of 2026-10-22 | ~5 GB | 2.5 | MIT | 301.1K |
| SmolLM3 3B | Not in LiveBench 2026-06-25 | Not on the LMArena text leaderboard of 2026-10-22 | ~5 GB | 1.9 | Apache 2.0 | 185.3K |
| Ministral 3 3B | Not in LiveBench 2026-06-25 | Not on the LMArena text leaderboard of 2026-10-22 | ~5 GB | 2.1 | Apache 2.0 | 72.5K |
| Granite 4.2 3B | Not in LiveBench 2026-06-25 | 1,290 | ~5 GB | 2.2 | Apache 2.0 | 40.8K |
| Gemma 4 E4B | Not in LiveBench 2026-06-25 | Not on the LMArena text leaderboard of 2026-10-22 | ~8 GBTight fit | 5.0 | Apache 2.0 | 4.4M |
| Llama 3.1 8B Instruct | Not in LiveBench 2026-06-25 | 1,211 | ~8 GBTight fit | 4.9 | Llama 3.1 | 4.1M |
| Olmo 3 7B Instruct | Not in LiveBench 2026-06-25 | Not on the LMArena text leaderboard of 2026-10-22 | ~8 GBTight fit | 4.5 | Apache 2.0 | 133.1K |
| Granite 4.2 8B | Not in LiveBench 2026-06-25 | 1,290 | ~8 GBTight fit | 5.3 | Apache 2.0 | 59.5K |
| Qwen3 14B | Not in LiveBench 2026-06-25 | Not on the LMArena text leaderboard of 2026-10-22 | ~14 GBRuns slowly | 9.0 | Apache 2.0 | 13.2M |
| Qwen3.8 27B | 75.3 | 1,437 | ~23 GBRuns slowly | 16.5 | Apache 2.0 | 6.9M |
| Qwen3.5 9B | Not in LiveBench 2026-06-25 | Not on the LMArena text leaderboard of 2026-10-22 | ~9 GBRuns slowly | 5.7 | Apache 2.0 | 6.5M |
| Gemma 4 31B | Not in LiveBench 2026-06-25 | 1,452 | ~26 GBRuns slowly | 18.3 | Apache 2.0 | 6.3M |
| Qwen3 8B | Not in LiveBench 2026-06-25 | Not on the LMArena text leaderboard of 2026-10-22 | ~9 GBRuns slowly | 5.0 | Apache 2.0 | 6.1M |
| gpt-oss-20b | Not in LiveBench 2026-06-25 | 1,317 | ~18 GBRuns slowly | 11.6 | Apache 2.0 | 5.6M |
| Gemma 4 26B A4B | Not in LiveBench 2026-06-25 | 1,437 | ~21 GBRuns slowly | 16.9 | Apache 2.0 | 5M |
| Qwen3.6 27B | 64.0 | Not on the LMArena text leaderboard of 2026-10-22 | ~23 GBRuns slowly | 16.8 | Apache 2.0 | 2.5M |
| Qwen3 Coder 30B A3B | Not in LiveBench 2026-06-25 | Not on the LMArena text leaderboard of 2026-10-22 | ~25 GBRuns slowly | 18.6 | Apache 2.0 | 1.9M |
| Gemma 4 12B | Not in LiveBench 2026-06-25 | Not on the LMArena text leaderboard of 2026-10-22 | ~11 GBRuns slowly | 7.1 | Apache 2.0 | 1.6M |
| Qwen3.5 35B A3B | Not in LiveBench 2026-06-25 | 1,394 | ~29 GBRuns slowly | 22.0 | Apache 2.0 | 1.4M |
| Nemotron 3 Nano 30B A3B | Not in LiveBench 2026-06-25 | 1,314 | ~32 GBRuns slowly | 24.6 | NVIDIA Nemotron Open Model | 1.3M |
| GLM-4.7 Flash | Not in LiveBench 2026-06-25 | 1,365 | ~25 GBRuns slowly | 18.3 | MIT | 1.2M |
| Nemotron 3.5 Lightning 30B A3B | 44.5 | Arena rated the NVFP4 build, NVIDIA-Nemotron-3.5-Lightning-30B-A3B (NVFP4); this entry is the BF16 reference, which NVIDIA reports with different scores | ~25 GBRuns slowly | 18.9 | OpenMDW 1.1 | 974.1K |
| Qwen3 30B A3B Instruct 2507 | Not in LiveBench 2026-06-25 | 1,382 | ~25 GBRuns slowly | 18.6 | Apache 2.0 | 747.4K |
| DeepSeek R1 0528 Qwen3 8B | Not in LiveBench 2026-06-25 | Not on the LMArena text leaderboard of 2026-10-22 | ~9 GBRuns slowly | 5.0 | MIT | 523.8K |
| Ministral 3 14B | Not in LiveBench 2026-06-25 | Not on the LMArena text leaderboard of 2026-10-22 | ~13 GBRuns slowly | 8.2 | Apache 2.0 | 207.6K |
| Phi-4 | Not in LiveBench 2026-06-25 | 1,256 | ~13 GBRuns slowly | 8.0 | MIT | 199.5K |
| Mistral Small 3.2 24B | Not in LiveBench 2026-06-25 | 1,356 | ~21 GBRuns slowly | 14.3 | Apache 2.0 | 109.9K |
| Ministral 3 8B | Not in LiveBench 2026-06-25 | Not on the LMArena text leaderboard of 2026-10-22 | ~9 GBRuns slowly | 5.2 | Apache 2.0 | 90.7K |
| Granite 4.2 30B | Not in LiveBench 2026-06-25 | 1,340 | ~25 GBRuns slowly | 17.7 | Apache 2.0 | 37K |
| Devstral Small 2 24B | Not in LiveBench 2026-06-25 | Not on the LMArena text leaderboard of 2026-10-22 | ~20 GBRuns slowly | 14.3 | Apache 2.0 | 24.8K |
| Olmo 3 32B Think | Not in LiveBench 2026-06-25 | 1,306 | ~26 GBRuns slowly | 19.5 | Apache 2.0 | 11.8K |
| Smaug Mini | 76.9 | Not on the LMArena text leaderboard of 2026-10-22 | ~23 GBRuns slowly | 16.5 | Apache 2.0 | 1.1K |
Also runs slowly
Above the 8 GB of VRAM, the layers that do not fit run on the CPU from PC RAM, up to 32 GB in all. 32 GB of PC RAM assumed: this configuration lists none. Planning estimate, not a speed figure. The 24 reviewed models that run slowly are in the table above.
- Qwen3-8B-BaseQwen~9 GBruns well with 12 GB
- Llama-3.1-8Bmeta-llama~9 GBruns well with 12 GB
- Meta-Llama-3-8B-Instructmeta-llama~9 GBruns well with 12 GB
- shieldgemma-9bgoogle~9 GBruns well with 12 GB
- Llama-xLAM-2-8b-fc-rSalesforce~9 GBruns well with 12 GB
- gemma-2-9b-itgoogle~9 GBruns well with 12 GB
- Qwen3Guard-Gen-8BQwen~9 GBruns well with 12 GB
- Meta-Llama-3-8Bmeta-llama~9 GBruns well with 12 GB
- DeepSeek-R1-Distill-Llama-8Bdeepseek-ai~9 GBruns well with 12 GB
- Llama-Guard-3-8Bmeta-llama~9 GBruns well with 12 GB
- gemma-2-9bgoogle~9 GBruns well with 12 GB
- Llama3-ChatQA-1.5-8Bnvidia~9 GBruns well with 12 GB
- granite-guardian-4.1-8bibm-granite~9 GBruns well with 12 GB
- Infinity-Instruct-3M-0625-Llama3-8BBAAI~9 GBruns well with 12 GB
- Infinity-Instruct-3M-0625-Yi-1.5-9BBAAI~9 GBruns well with 12 GB
- Llama-3-Smaug-8Babacusai~9 GBruns well with 12 GB
- Llama-3.1-Nemotron-Nano-8B-v1nvidia~9 GBruns well with 12 GB
- Llama-3.1-Tulu-3-8B-SFTallenai~9 GBruns well with 12 GB
- Mistral-NeMo-Minitron-8B-Instructnvidia~9 GBruns well with 12 GB
- Llama-3.1-Tulu-3-8B-DPOallenai~9 GBruns well with 12 GB
- Seed-Coder-8B-InstructByteDance-Seed~9 GBruns well with 12 GB
- Llama-3.1-Tulu-3-8Ballenai~9 GBruns well with 12 GB
- granite-3.3-8b-baseibm-granite~9 GBruns well with 12 GB
- granite-guardian-3.3-8bibm-granite~9 GBruns well with 12 GB
- Nemotron-Orchestrator-8Bnvidia~9 GBruns well with 12 GB
- gemma-1.1-7b-itgoogle~9 GBruns well with 12 GB
- codegemma-7b-itgoogle~9 GBruns well with 12 GB
- Llama-3.1-Nemotron-8B-UltraLong-1M-Instructnvidia~9 GBruns well with 12 GB
- codegemma-7bgoogle~9 GBruns well with 12 GB
- Mistral-NeMo-Minitron-8B-Basenvidia~9 GBruns well with 12 GB
- granite-8b-code-base-4kibm-granite~9 GBruns well with 12 GB
- granite-3.0-8b-baseibm-granite~9 GBruns well with 12 GB
- HARC-Llama-3.1-8B-Instructmicrosoft~9 GBruns well with 12 GB
- Seed-Coder-8B-ReasoningByteDance-Seed~9 GBruns well with 12 GB
- Llama-3.1-Nemotron-8B-UltraLong-4M-Instructnvidia~9 GBruns well with 12 GB
- Llama-3.1-Tulu-3.1-8Ballenai~9 GBruns well with 12 GB
- granite-3.3-8b-math-prm-v2ibm-granite~9 GBruns well with 12 GB
- PaCoRe-8Bstepfun-ai~9 GBruns well with 12 GB
- MathForm-8Bopenbmb~9 GBruns well with 12 GB
- Llama-3.1-Nemotron-8B-UltraLong-2M-Instructnvidia~9 GBruns well with 12 GB
- granite-3.2-8b-instruct-previewibm-granite~9 GBruns well with 12 GB
- Seed-Coder-8B-Reasoning-bf16ByteDance-Seed~9 GBruns well with 12 GB
- Meta-Llama-Guard-2-8Bmeta-llama~9 GBruns well with 12 GB
- Qwen3-8B-FRlightonai~9 GBruns well with 12 GB
- granite-8b-code-instruct-128kibm-granite~9 GBruns well with 12 GB
- granite-3.1-8b-baseibm-granite~9 GBruns well with 12 GB
- Qwen3-8B-ABCOpenMOSS-Team~9 GBruns well with 12 GB
- RLPR-Llama3.1-8B-Instopenbmb~9 GBruns well with 12 GB
- granite-guardian-3.1-8bibm-granite~9 GBruns well with 12 GB
- KernelLLMfacebook~9 GBruns well with 12 GB
- Seed-Coder-8B-BaseByteDance-Seed~9 GBruns well with 12 GB
- UserLM-2.0microsoft~9 GBruns well with 12 GB
- WebWorld-8BQwen~9 GBruns well with 12 GB
- Nemotron-Terminal-8Bnvidia~9 GBruns well with 12 GB
- Nemotron-Cascade-8Bnvidia~9 GBruns well with 12 GB
- granite-8b-code-instruct-4kibm-granite~9 GBruns well with 12 GB
- OpenMath2-Llama3.1-8Bnvidia~9 GBruns well with 12 GB
- LLaMA-Pro-8BTencentARC~9 GBruns well with 12 GB
- gemma-7b-aps-itgoogle~9 GBruns well with 12 GB
- ContextPilot-8Btencent~9 GBruns well with 12 GB
- Nemotron-Cascade-8B-Thinkingnvidia~9 GBruns well with 12 GB
- granite-4.1-8b-llmon-previewibm-granite~9 GBruns well with 12 GB
- granite-guardian-3.0-8bibm-granite~9 GBruns well with 12 GB
- granite-8b-code-base-128kibm-granite~9 GBruns well with 12 GB
- LongWriter-llama3.1-8bzai-org~9 GBruns well with 12 GB
- OProver-8Bm-a-p~9 GBruns well with 12 GB
- granite-guardian-3.2-8b-factuality-detectionibm-granite~9 GBruns well with 12 GB
- txgemma-9b-chatgoogle~9 GBruns well with 12 GB
- layerskip-llama3-8Bfacebook~9 GBruns well with 12 GB
- txgemma-9b-predictgoogle~9 GBruns well with 12 GB
- RLVR-8B-0926stepfun-ai~9 GBruns well with 12 GB
- Llama-3.1-Tulu-3-8B-SFT-no-safety-dataallenai~9 GBruns well with 12 GB
- Llama-3.1-Tulu-3-8B-SFT-no-wildchat-dataallenai~9 GBruns well with 12 GB
- Llama-3.1-Tulu-3-8B-SFT-no-persona-dataallenai~9 GBruns well with 12 GB
- Llama-3.1-Tulu-3-8B-SFT-no-math-dataallenai~9 GBruns well with 12 GB
- Mistral_Pro_8B_v0.1TencentARC~9 GBruns well with 12 GB
- LLaMA-3-8B-SFR-Iterative-DPO-RSalesforce~9 GBruns well with 12 GB
- LLaMA-Pro-8B-InstructTencentARC~9 GBruns well with 12 GB
- granite-3.1-8b-lora-intrinsics-v0.1ibm-granite~9 GBruns well with 12 GB
- granite-3.0-8b-lora-intrinsics-v0.1ibm-granite~9 GBruns well with 12 GB
- MetaMath-Mistral-ProTencentARC~9 GBruns well with 12 GB
- codegemma-1.1-7b-itgoogle~9 GBruns well with 12 GB
- LLaMA-3-8B-SFR-SFT-RSalesforce~9 GBruns well with 12 GB
- omost-dolphin-2.9-llama3-8blllyasviel~9 GBruns well with 12 GB
- LLaMA-3-8B-SFR-Iterative-DPO-Concise-RSalesforce~9 GBruns well with 12 GB
- OProver-8B-Basem-a-p~9 GBruns well with 12 GB
- Qwen3-8B-SWlightonai~9 GBruns well with 12 GB
- Qwen3-8B-ZHlightonai~9 GBruns well with 12 GB
- Qwen3-8B-ZH-Swaplightonai~9 GBruns well with 12 GB
- Qwen3-8B-FR-Pivot-ENlightonai~9 GBruns well with 12 GB
- hercule-bnai4bharat~9 GBruns well with 12 GB
- llama-prometheusai4bharat~9 GBruns well with 12 GB
- Qwen3-8B-ESlightonai~9 GBruns well with 12 GB
- Qwen3-8B-SW-Swaplightonai~9 GBruns well with 12 GB
- Qwen3-8B-DElightonai~9 GBruns well with 12 GB
- trustalign_llama3_8bdeclare-lab~9 GBruns well with 12 GB
- Qwen3-8B-SW-Pivot-ENlightonai~9 GBruns well with 12 GB
- Qwen3-8B-ZH-Pivot-ENlightonai~9 GBruns well with 12 GB
- Qwen3-8B-ES-Pivot-ENlightonai~9 GBruns well with 12 GB
- Qwen3-8B-ES-Swaplightonai~9 GBruns well with 12 GB
- Qwen3-8B-FR-Swaplightonai~9 GBruns well with 12 GB
- r2egym_8b_rope_65k-step17laion~9 GBruns well with 12 GB
- Qwen3-8B-DE-Pivot-ENlightonai~9 GBruns well with 12 GB
- Qwen3-8B-ENlightonai~9 GBruns well with 12 GB
- Meta-Llama-Guard-2-8BEfficient-Large-Model~9 GBruns well with 12 GB
- Qwen3-8B-DE-Swaplightonai~9 GBruns well with 12 GB
- hercule-ur-loraai4bharat~9 GBruns well with 12 GB
- omost-llama-3-8blllyasviel~9 GBruns well with 12 GB
- OProver-8B-Round2m-a-p~9 GBruns well with 12 GB
- ablation-pymethods2test-seqmean-arm0-30-8Blaion~9 GBruns well with 12 GB
- ablation-pymethods2test-shaped-45-8Blaion~9 GBruns well with 12 GB
- hercule-deai4bharat~9 GBruns well with 12 GB
- hercule-hiai4bharat~9 GBruns well with 12 GB
- OProver-8B-Round1m-a-p~9 GBruns well with 12 GB
- symclip-30-8Blaion~9 GBruns well with 12 GB
- a3-rl-DCAgent_exp_rpt_e2egit-large_global_step_15laion~9 GBruns well with 12 GB
- SweSmith-8B-SFT-Rope-step62laion~9 GBruns well with 12 GB
- hercule-te-loraai4bharat~9 GBruns well with 12 GB
- Sera-4.6-Lite-T2-v4-316-axolotl__Qwen3-8Blaion~9 GBruns well with 12 GB
- hercule-frai4bharat~9 GBruns well with 12 GB
- hercule-hi-loraai4bharat~9 GBruns well with 12 GB
- hercule-teai4bharat~9 GBruns well with 12 GB
- hercule-urai4bharat~9 GBruns well with 12 GB
- ablation-pymethods2test-seqmean-arm0-15-8Blaion~9 GBruns well with 12 GB
- Infinity-Instruct-3M-0625-Llama3-8B-COIG-Pm-a-p~9 GBruns well with 12 GB
- Sera-4.6-Lite-T2-v4-1000-axolotl__Qwen3-8Blaion~9 GBruns well with 12 GB
- SweSmith-8B-SFT-NoRope-step58laion~9 GBruns well with 12 GB
- CoderForge-Preview-v6-1000-axolotl__Qwen3-8B-v8laion~9 GBruns well with 12 GB
- rl_r2egym-full_terminus-structuredlaion~9 GBruns well with 12 GB
- sera-subset-mixed-3160-axolotl__Qwen3-8B-v8laion~9 GBruns well with 12 GB
- CoderForge-Preview-v3-316-axolotl__Qwen3-8Blaion~9 GBruns well with 12 GB
- rl_r2egym-nl2bash-swesmith-pymethods2test_terminus-structuredlaion~9 GBruns well with 12 GB
- Sera-4.6-Lite-T2-v4-1000-axolotl__Qwen3-8B-v6laion~9 GBruns well with 12 GB
- Sera-4.6-Lite-T2-v4-316-axolotl__Qwen3-8B-v3laion~9 GBruns well with 12 GB
- sera-subset-mixed-316-axolotl__Qwen3-8B-v8laion~9 GBruns well with 12 GB
- swesmith_8b-step35laion~9 GBruns well with 12 GB
- hercule-bn-loraai4bharat~9 GBruns well with 12 GB
- hercule-fr-loraai4bharat~9 GBruns well with 12 GB
- rl_mixed-struct-step37_terminus-structuredlaion~9 GBruns well with 12 GB
- swesmith_8b_rope_65k-step37laion~9 GBruns well with 12 GB
- CoderForge-Preview-v3-1000-axolotl__Qwen3-8Blaion~9 GBruns well with 12 GB
- hercule-de-loraai4bharat~9 GBruns well with 12 GB
- Sera-4.5A-Full-T1-v3-1000-axolotl__Qwen3-8Blaion~9 GBruns well with 12 GB
- Sera-4.5A-Full-T1-v3-316-axolotl__Qwen3-8Blaion~9 GBruns well with 12 GB
- sera-subset-mixed-10000-axolotl__Qwen3-8B-v8laion~9 GBruns well with 12 GB
- swesmith-coldstart-complete-lt32k-2ep-8Blaion~9 GBruns well with 12 GB
- Sera-4.6-Lite-T2-v4-316-axolotl__Qwen3-8B-v2laion~9 GBruns well with 12 GB
- Sera-4.6-Lite-T2-v4-1000-axolotl__Qwen3-8B-v7laion~9 GBruns well with 12 GB
- sera-subset-mixed-1000-axolotl__Qwen3-8B-v8laion~9 GBruns well with 12 GB
- rl_pymethods2test-r2egym_terminus-structuredlaion~9 GBruns well with 12 GB
- Falcon3-10B-Instructtiiuae~10 GBruns well with 12 GB
- Falcon3-10B-Basetiiuae~10 GBruns well with 12 GB
- Falcon3-10B-Base-1.58bit-prequantizedtiiuae~10 GBruns well with 12 GB
- xgen-small-9B-instruct-rSalesforce~10 GBruns well with 12 GB
- xgen-small-9B-base-rSalesforce~10 GBruns well with 12 GB
- Llama-2-13b-chat-hfmeta-llama~12 GBruns well with 12 GB
- Llama-2-13b-hfmeta-llama~12 GBruns well with 12 GB
- bigstral-12b-32kabacusai~12 GBruns well with 12 GB
- StableBeluga-13Bstabilityai~12 GBruns well with 12 GB
- tulu-2-dpo-13ballenai~12 GBruns well with 12 GB
- agentlm-13bzai-org~12 GBruns well with 12 GB
- layerskip-llama2-13Bfacebook~12 GBruns well with 12 GB
- codellama13b_instruct_260k_synthesisstabilityai~12 GBruns well with 12 GB
- LLaMA-2-13b-GTL-Deltamicrosoft~12 GBruns well with 12 GB
- OpenMath-CodeLlama-13b-Python-hfnvidia~12 GBruns well with 12 GB
- tulu-v2.5-ppo-13b-uf-meanallenai~12 GBruns well with 12 GB
- tulu-v2.5-dpo-13b-uf-meanallenai~12 GBruns well with 12 GB
- tulu-v2.5-dpo-13b-hh-rlhfallenai~12 GBruns well with 12 GB
- tulu-v2.5-ppo-13b-hh-rlhf-60kallenai~12 GBruns well with 12 GB
- tulu-v2.5-dpo-13b-hh-rlhf-60kallenai~12 GBruns well with 12 GB
- tulu-v2.5-dpo-13b-stackexchange-60kallenai~12 GBruns well with 12 GB
- tulu-v2.5-dpo-13b-prm-phase-2allenai~12 GBruns well with 12 GB
- tulu-v2.5-ppo-13b-stackexchange-60kallenai~12 GBruns well with 12 GB
- tulu-v2.5-dpo-13b-argilla-orca-pairsallenai~12 GBruns well with 12 GB
- CodeLlama-13b-Instruct-hfmeta-llama~12 GBruns well with 12 GB
- Giraffe-13b-32k-v3abacusai~12 GBruns well with 12 GB
- CodeLlama-13b-hfmeta-llama~12 GBruns well with 12 GB
- bigstral-12b-v0.2-32kabacusai~12 GBruns well with 12 GB
- CodeLlama-13b-Python-hfmeta-llama~12 GBruns well with 12 GB
- Qwen1.5-MoE-A2.7BQwen~13 GBQ4 · tensor count
- Phi-4-reasoningmicrosoft~13 GBQ4 · tensor count
- Qwen1.5-MoE-A2.7B-ChatQwen~13 GBQ4 · tensor count
- OLMo-2-1124-13B-Instructallenai~13 GBQ4 · tensor count
- Qwen1.5-14B-ChatQwen~13 GBQ4 · tensor count
- Qwen1.5-14BQwen~13 GBQ4 · tensor count
- Phi-4-reasoning-plusmicrosoft~13 GBQ4 · tensor count
- OLMo-2-1124-13B-DPOallenai~13 GBQ4 · tensor count
- OLMo-2-1124-13B-Instruct-RLVR1allenai~13 GBQ4 · tensor count
- OLMo-2-1124-13B-Instruct-previewallenai~13 GBQ4 · tensor count
- OLMo-2-1124-13B-Instruct-RLVR2allenai~13 GBQ4 · tensor count
- Qwen2.5-Coder-14B-InstructQwen~14 GBQ4 · tensor count
- Qwen2.5-14B-InstructQwen~14 GBQ4 · tensor count
- Qwen2.5-14B-Instruct-1MQwen~14 GBQ4 · tensor count
- DeepSeek-R1-Distill-Qwen-14Bdeepseek-ai~14 GBQ4 · tensor count
- Qwen3-14B-BaseQwen~14 GBQ4 · tensor count
- bigyi-15babacusai~14 GBQ4 · tensor count
- Qwen2.5-Coder-14BQwen~14 GBQ4 · tensor count
- Apriel-Nemotron-15b-ThinkerServiceNow-AI~14 GBQ4 · tensor count
- OpenReasoning-Nemotron-14Bnvidia~14 GBQ4 · tensor count
- MagenticBrainmicrosoft~14 GBQ4 · tensor count
- ContextPilot-14Btencent~14 GBQ4 · tensor count
- Nemotron-Cascade-14B-Thinkingnvidia~14 GBQ4 · tensor count
- JanusCoder-14Binternlm~14 GBQ4 · tensor count
- E1-Code-14BSalesforce~14 GBQ4 · tensor count
- NextCoder-14Bmicrosoft~14 GBQ4 · tensor count
- E1-AceReason-14BSalesforce~14 GBQ4 · tensor count
- OpenMath-Nemotron-14Bnvidia~14 GBQ4 · tensor count
- OpenMath-Nemotron-14B-Kagglenvidia~14 GBQ4 · tensor count
- WebWorld-14BQwen~14 GBQ4 · tensor count
- AceReason-Nemotron-14Bnvidia~14 GBQ4 · tensor count
- OpenCodeReasoning-Nemotron-14Bnvidia~14 GBQ4 · tensor count
- Nemotron-Terminal-14Bnvidia~14 GBQ4 · tensor count
- Qwen3-14B-MLX-bf16Qwen~14 GBQ4 · tensor count
- OpenCodeReasoning-Nemotron-1.1-14Bnvidia~14 GBQ4 · tensor count
- CriticLeanGPT-Qwen2.5-14B-Instruct-SFTm-a-p~14 GBQ4 · tensor count
- delphi-1e23-wc50m-warmup-levanter-sftlaion~21 GBQ4 · tensor count
- delphi-1e23-magpie-warmup-levanter-sftlaion~21 GBQ4 · tensor count
- gemma-2-27b-itgoogle~23 GBQ4 · tensor count
- gemma-2-27bgoogle~23 GBQ4 · tensor count
- txgemma-27b-chatgoogle~23 GBQ4 · tensor count
- shieldgemma-27bgoogle~23 GBQ4 · tensor count
- datagemma-rag-27b-itgoogle~23 GBQ4 · tensor count
- datagemma-rig-27b-itgoogle~23 GBQ4 · tensor count
- txgemma-27b-predictgoogle~23 GBQ4 · tensor count
- granite-4.1-30bibm-granite~24 GBQ4 · tensor count
- granite-4.1-30b-baseibm-granite~24 GBQ4 · tensor count
- Qwen3-30B-A3BQwen~25 GBQ4 · tensor count
- Qwen3-30B-A3B-Thinking-2507Qwen~25 GBQ4 · tensor count
- Qwen3-30B-A3B-BaseQwen~25 GBQ4 · tensor count
- Tongyi-DeepResearch-30B-A3BAlibaba-NLP~25 GBQ4 · tensor count
- SciJudge-30BOpenMOSS-Team~25 GBQ4 · tensor count
- Rubicon-PreviewinclusionAI~25 GBQ4 · tensor count
- SciJudge-30B-2605OpenMOSS-Team~25 GBQ4 · tensor count
- SciThinker-30BOpenMOSS-Team~25 GBQ4 · tensor count
- browsesafeperplexity-ai~25 GBQ4 · tensor count
- tt-x15-megatron-51-30Blaion~25 GBQ4 · tensor count
- tt-x2_clip-hi0p2-60-30Blaion~25 GBQ4 · tensor count
- tt-x10-fsdp2-fa2-117-30Blaion~25 GBQ4 · tensor count
- tt-x2_clip-hi0p05-10-30Blaion~25 GBQ4 · tensor count
- tt-x4_temperature-t0p7-45-30Blaion~25 GBQ4 · tensor count
- tt-x1_lr-lr8e6-60-30Blaion~25 GBQ4 · tensor count
- tt-x16-entropy0p003-42-30Blaion~25 GBQ4 · tensor count
- tt-x2_clip-hi0p01-15-30Blaion~25 GBQ4 · tensor count
- tt-x1_lr-lr4e6-30-30Blaion~25 GBQ4 · tensor count
- tt-x4_temperature-t1p0-45-30Blaion~25 GBQ4 · tensor count
- tt-x0_verifier-shaped-20-30Blaion~25 GBQ4 · tensor count
- tt-x0_verifier-binary-20-30Blaion~25 GBQ4 · tensor count
- tt-x5_gradnorm-gn1p8laion~25 GBQ4 · tensor count
- tt-x5_gradnorm-gn0p9laion~25 GBQ4 · tensor count
- tt-x3_kl-kl0laion~25 GBQ4 · tensor count
- Qwen3-32BQwen~27 GBQ4 · tensor count
- Qwen2.5-32B-InstructQwen~27 GBQ4 · tensor count
- Qwen2.5-Coder-32B-InstructQwen~27 GBQ4 · tensor count
- DeepSeek-R1-Distill-Qwen-32Bdeepseek-ai~27 GBQ4 · tensor count
- Qwen1.5-32B-ChatQwen~27 GBQ4 · tensor count
- QwQ-32BQwen~27 GBQ4 · tensor count
- Qwen1.5-32BQwen~27 GBQ4 · tensor count
- QwQ-32B-PreviewQwen~27 GBQ4 · tensor count
- OLMo-2-0325-32B-Instructallenai~27 GBQ4 · tensor count
- OLMo-2-0325-32Ballenai~27 GBQ4 · tensor count
- Qwen2.5-Coder-32BQwen~27 GBQ4 · tensor count
- Qwen3-Nemotron-32B-GenRM-Principlenvidia~27 GBQ4 · tensor count
- SWE-Dev-32Bzai-org~27 GBQ4 · tensor count
- StepFun-Prover-Preview-32Bstepfun-ai~27 GBQ4 · tensor count
- Skywork-SWE-32BSkywork~27 GBQ4 · tensor count
- Qwen3-Nemotron-32B-RLBFFnvidia~27 GBQ4 · tensor count
- NFT-32Bnvidia~27 GBQ4 · tensor count
- Qwen3-32B-AWorldinclusionAI~27 GBQ4 · tensor count
- OpenReasoning-Nemotron-32Bnvidia~27 GBQ4 · tensor count
- SynLogic-32BMiniMaxAI~27 GBQ4 · tensor count
- Nemotron-Terminal-32Bnvidia~27 GBQ4 · tensor count
- OpenMath-Nemotron-32Bnvidia~27 GBQ4 · tensor count
- OpenCodeReasoning-Nemotron-32Bnvidia~27 GBQ4 · tensor count
- xLAM-2-32b-fc-rSalesforce~27 GBQ4 · tensor count
- WebDancer-32BAlibaba-NLP~27 GBQ4 · tensor count
- SynLogic-Mix-3-32BMiniMaxAI~27 GBQ4 · tensor count
- OpenCodeReasoning-Nemotron-1.1-32Bnvidia~27 GBQ4 · tensor count
- StepFun-Formalizer-32Bstepfun-ai~27 GBQ4 · tensor count
- NextCoder-32Bmicrosoft~27 GBQ4 · tensor count
- OpenCodeReasoning-Nemotron-32B-IOInvidia~27 GBQ4 · tensor count
- OREAL-32Binternlm~27 GBQ4 · tensor count
- DRIVE-RLtencent~27 GBQ4 · tensor count
- DRIVE-SFTtencent~27 GBQ4 · tensor count
- OProver-32Bm-a-p~27 GBQ4 · tensor count
- Qwen3-32B-ABCOpenMOSS-Team~27 GBQ4 · tensor count
- OProver-32B-Basem-a-p~27 GBQ4 · tensor count
- GLM-4.6-stackexchange-overflow-sandboxes-32eps-65k-reasoning_warmup-ratio_0-05_Qwen3-32Blaion~27 GBQ4 · tensor count
- GLM-4.6-stackexchange-overflow-sandboxes-32eps-65k-reasoning_adam-beta1_0-93_Qwen3-32Blaion~27 GBQ4 · tensor count
- GLM-4.6-stackexchange-overflow-sandboxes-32eps-65k-reasoning_lr_1e-5_Qwen3-32Blaion~27 GBQ4 · tensor count
- GLM-4.6-stackexchange-overflow-sandboxes-32eps-65k-reasoning_adam-beta1_0-95_Qwen3-32Blaion~27 GBQ4 · tensor count
- GLM-4.6-stackexchange-overflow-sandboxes-32eps-65k-reasoning_warmup-ratio_0-01_Qwen3-32Blaion~27 GBQ4 · tensor count
- GLM-4.6-stackexchange-overflow-sandboxes-32eps-65k-reasoning_global-batch-size_64_Qwen3-32Blaion~27 GBQ4 · tensor count
- GLM-4.6-stackexchange-overflow-sandboxes-32eps-65k-reasoning_Qwen3-32Blaion~27 GBQ4 · tensor count
- a2-rl-e2egit_large-50-32Blaion~27 GBQ4 · tensor count
- GLM-4.6-stackexchange-overflow-sandboxes-32eps-65k-reasoning_adam-beta1_0-91_Qwen3-32Blaion~27 GBQ4 · tensor count
- sft__g1_gptlong_top8_train_on_obs_fa3__40-0__Qwen3-32Blaion~27 GBQ4 · tensor count
- GLM-4.6-stackexchange-overflow-sandboxes-32eps-65k-reasoning_num-train-epochs_4.0_Qwen3-32Blaion~27 GBQ4 · tensor count
- nemotron-terminal-corpus-unified-10000__Qwen3-32Blaion~27 GBQ4 · tensor count
- GLM-4.6-stackexchange-overflow-sandboxes-32eps-65k-reasoning_num-train-epochs_7.0_Qwen3-32Blaion~27 GBQ4 · tensor count
- OProver-32B-Round1m-a-p~27 GBQ4 · tensor count
- GLM-4.6-stackexchange-overflow-sandboxes-32eps-65k-reasoning_adam-beta1_0-97_Qwen3-32Blaion~27 GBQ4 · tensor count
- GLM-4.6-stackexchange-overflow-sandboxes-32eps-65k-reasoning_global-batch-size_32_Qwen3-32Blaion~27 GBQ4 · tensor count
- nemosci-tasrep-a1mfc-dev1-maxeps-swes-r2eg-32b__Qwen3-32Blaion~27 GBQ4 · tensor count
- nemosci-tasrep-a1mfc-gfistaqc-scaff-maxeps-swes-r2eg-32b__Qwen3-32Blaion~27 GBQ4 · tensor count
- nemotron-terminal-corpus-unified-31600__Qwen3-32Blaion~27 GBQ4 · tensor count
- GLM-4.6-stackexchange-overflow-sandboxes-32eps-65k-reasoning_learning-rate_1e-06_Qwen3-32Blaion~27 GBQ4 · tensor count
- GLM-4.6-stackexchange-overflow-sandboxes-32eps-65k-reasoning_num-train-epochs_8-0_Qwen3-32Blaion~27 GBQ4 · tensor count
- Qwen3-32B-NL2Bash-31steplaion~27 GBQ4 · tensor count
- syh-r2eg-askl-glm_4-7_trac_jupi_-gfi-swes-rand-filt-10K_glm_4-7_trac_jupi_32Blaion~27 GBQ4 · tensor count
- nemotron-terminal-corpus-unified-316__Qwen3-32Blaion~27 GBQ4 · tensor count
- sft_GLM-4-7-swesmith-sandboxes-with_tests-oracle_verified_120s-maxeps-131k_Qwen3-32Blaion~27 GBQ4 · tensor count
- nemosci-tasrep-a1mfc-dev1-maxeps-32b__Qwen3-32Blaion~27 GBQ4 · tensor count
- nemosci-tasrep-a1unix-a1mfc-gfistaqc-scaff-maxeps-swes-r2eg-32b__Qwen3-32Blaion~27 GBQ4 · tensor count
- sft_r2egym-nl2bash-stackoverflow-inferredbugs-32B_Qwen3-32Blaion~27 GBQ4 · tensor count
- g1_selective_top8_diverse_31600_glm47_traces_32Blaion~27 GBQ4 · tensor count
- Qwen3-32B-SweSmith-20steplaion~27 GBQ4 · tensor count
- tasrep-a1mfc-gfistaqc-dev1-scaff-maxeps-swes-r2eg-32b__Qwen3-32Blaion~27 GBQ4 · tensor count
- nemosci-tasrep-a1mfc-gfistaqc-dev1-scaff-maxeps-swes-r2eg-32b-10pct__Qwen3-32Blaion~27 GBQ4 · tensor count
- nemotron-terminal-corpus-unified-3160__Qwen3-32Blaion~27 GBQ4 · tensor count
- nemotron-terminal-corpus-unified-1000__Qwen3-32Blaion~27 GBQ4 · tensor count
- nemosci-tasrep-a1mfc-gfistaqc-dev1-scaff-maxeps-swes-r2eg-32b-3pct__Qwen3-32Blaion~27 GBQ4 · tensor count
- nemosci-tasrep-nemodebug-a1mfc-gfistaqc-scaff-maxeps-swes-r2eg-32b__Qwen3-32Blaion~27 GBQ4 · tensor count
- deepseek-coder-33b-instructdeepseek-ai~28 GBQ4 · tensor count
- Smaug-34B-v0.1abacusai~28 GBQ4 · tensor count
- deepseek-coder-33b-basedeepseek-ai~28 GBQ4 · tensor count
- CodeLlama-34b-Instruct-hfmeta-llama~28 GBQ4 · tensor count
- OpenMath-CodeLlama-34b-Python-hfnvidia~28 GBQ4 · tensor count
- MetaMath-Bagel-DPO-34Babacusai~28 GBQ4 · tensor count
- CodeLlama-34b-hfmeta-llama~28 GBQ4 · tensor count
- MetaMath-bagel-34b-v0.2-c1500abacusai~28 GBQ4 · tensor count
- MM-Orc-Vic-bagel-34b-c1000abacusai~28 GBQ4 · tensor count
- MM-OV-bagel-DPO-34b-c1000-250abacusai~28 GBQ4 · tensor count
- layerskip-codellama-34Bfacebook~28 GBQ4 · tensor count
- Kun-LabelModelm-a-p~28 GBQ4 · tensor count
- CodeLlama-34b-Python-hfmeta-llama~28 GBQ4 · tensor count
Adjust the estimate: quantization, context, reserve
Vision
Vision · LMArena
rating · higher is better
Source: LMArena 2026-10-19 · collected 2026-10-25 · dataset · CC BY 4.0 · Models without a rating are left out, not scored as zero.
| Phi-3.5-vision-instructQ4 · Hugging Face count · source | 919 ± 16 | ~6 GB | Q4 · Hugging Face count |
|---|---|---|---|
| Gemma 4 E2BQ4 · published params · source | Not on the LMArena vision leaderboard of 2026-10-19 | ~6 GB | Q4 · published params |
| gemma-3n-E2BQ4 · Hugging Face count · source | Not reviewed for LMArena | ~7 GB | Q4 · Hugging Face count |
| gemma-3n-E2B-itQ4 · Hugging Face count · source | Not reviewed for LMArena | ~7 GB | Q4 · Hugging Face count |
| metaclip-2-worldwide-huge-37816-bit est. · Hugging Face count · source | Not reviewed for LMArena | ~7 GB | 16-bit est. · Hugging Face count |
| metaclip-2-worldwide-huge-quickgelu16-bit est. · Hugging Face count · source | Not reviewed for LMArena | ~7 GB | 16-bit est. · Hugging Face count |
| Phi-4-multimodal-instructQ4 · Hugging Face count · source | Not on the LMArena vision leaderboard of 2026-10-19 | ~7 GB | Q4 · Hugging Face count |
| siglip2-giant-opt-patch16-25616-bit est. · Hugging Face count · source | Not reviewed for LMArena | ~7 GB | 16-bit est. · Hugging Face count |
LMArena ratings in this table: LMArena 2026-10-19 · collected 2026-10-25 · dataset · CC BY 4.0
Tight fit: it runs, but leaves less than 1 GB free beyond the 2 GB the system keeps (the memory figure already includes that reserve).
Also runs slowly
Above the 8 GB of VRAM, the layers that do not fit run on the CPU from PC RAM, up to 32 GB in all. 32 GB of PC RAM assumed: this configuration lists none. Planning estimate, not a speed figure.
- Qwen3.5 9BAlibaba~9 GBruns well with 12 GB
- Gemma 4 12BGoogle~11 GBruns well with 12 GB
- Gemma 4 26B A4BGoogle~21 GBQ4 · published params
- Qwen3.6 27BAlibaba~23 GBQ4 · published params
- Qwen3.8 27BAlibaba~23 GBQ4 · published params
- Smaug MiniAbacus AI~23 GBQ4 · published params
- Gemma 4 31BGoogle~26 GBQ4 · published params
- Qwen3.5 35B A3BAlibaba~29 GBQ4 · published params
- AesCode-8Bmicrosoft~9 GBruns well with 12 GB
- AgentCPM-GUIopenbmb~9 GBruns well with 12 GB
- ARC-Hunyuan-Video-7BTencentARC~9 GBruns well with 12 GB
- ARC-Qwen-Video-7BTencentARC~9 GBruns well with 12 GB
- ARC-Qwen-Video-7B-NarratorTencentARC~9 GBruns well with 12 GB
- ArmorOCRinclusionAI~9 GBruns well with 12 GB
- aya-vision-8bCohereLabs~9 GBruns well with 12 GB
- Bunny-v1_1-Llama-3-8B-VBAAI~9 GBruns well with 12 GB
- CapRL-InternVL3.5-8Binternlm~9 GBruns well with 12 GB
- chandradatalab-to~9 GBruns well with 12 GB
- ChartVerse-8Bopendatalab~9 GBruns well with 12 GB
- Cosmos-Reason1-7Bnvidia~9 GBruns well with 12 GB
- Cosmos-Reason2-8Bnvidia~9 GBruns well with 12 GB
- Docopilot-8BOpenGVLab~9 GBruns well with 12 GB
- DSR_Suite-ModelTencentARC~9 GBruns well with 12 GB
- Eagle2-9Bnvidia~9 GBruns well with 12 GB
- Eagle2.5-8Bnvidia~9 GBruns well with 12 GB
- EGM-8Bnvidia~9 GBruns well with 12 GB
- Emu3-Chat-hfBAAI~9 GBruns well with 12 GB
- Emu3-Gen-hfBAAI~9 GBruns well with 12 GB
- EvoQualityByteDance~9 GBruns well with 12 GB
- Fara-7Bmicrosoft~9 GBruns well with 12 GB
- Game-RL-InternVL2.5-8BOpenMOSS-Team~9 GBruns well with 12 GB
- Game-RL-Qwen2.5-VL-7BOpenMOSS-Team~9 GBruns well with 12 GB
- GTA1-7BSalesforce~9 GBruns well with 12 GB
- GTA1-7B-2507Salesforce~9 GBruns well with 12 GB
- GUI-Actor-7B-Qwen2-VLmicrosoft~9 GBruns well with 12 GB
- GUI-Actor-7B-Qwen2.5-VLmicrosoft~9 GBruns well with 12 GB
- Holo1-7BHcompany~9 GBruns well with 12 GB
- Holo1.5-7BHcompany~9 GBruns well with 12 GB
- Holo2-8BHcompany~9 GBruns well with 12 GB
- idefics2-8bHuggingFaceM4~9 GBruns well with 12 GB
- idefics2-8b-baseHuggingFaceM4~9 GBruns well with 12 GB
- idefics2-8b-chattyHuggingFaceM4~9 GBruns well with 12 GB
- Idefics3-8B-Llama3HuggingFaceM4~9 GBruns well with 12 GB
- Intern-S1-miniinternlm~9 GBruns well with 12 GB
- InternOmniOpenGVLab~9 GBruns well with 12 GB
- InternVideo2_5_Chat_8BOpenGVLab~9 GBruns well with 12 GB
- InternVideo2_chat_8B_HDOpenGVLab~9 GBruns well with 12 GB
- InternVideo2_Chat_8B_InternLM2_5OpenGVLab~9 GBruns well with 12 GB
- InternVideo2-Chat-8BOpenGVLab~9 GBruns well with 12 GB
- InternVL_2_5_HiCo_R16OpenGVLab~9 GBruns well with 12 GB
- InternVL_2_5_HiCo_R64OpenGVLab~9 GBruns well with 12 GB
- InternVL2_5-8BOpenGVLab~9 GBruns well with 12 GB
- InternVL2_5-8B-MPOOpenGVLab~9 GBruns well with 12 GB
- InternVL2_5-8B-MPO-hfOpenGVLab~9 GBruns well with 12 GB
- InternVL2-8BOpenGVLab~9 GBruns well with 12 GB
- InternVL2-8B-MPOOpenGVLab~9 GBruns well with 12 GB
- InternVL3_5-8BOpenGVLab~9 GBruns well with 12 GB
- InternVL3_5-8B-FlashOpenGVLab~9 GBruns well with 12 GB
- InternVL3_5-8B-HFOpenGVLab~9 GBruns well with 12 GB
- InternVL3_5-8B-InstructOpenGVLab~9 GBruns well with 12 GB
- InternVL3_5-8B-MPOOpenGVLab~9 GBruns well with 12 GB
- InternVL3_5-8B-PretrainedOpenGVLab~9 GBruns well with 12 GB
- InternVL3-9BOpenGVLab~9 GBruns well with 12 GB
- InternVL3-9B-InstructOpenGVLab~9 GBruns well with 12 GB
- InternVL3-9B-PretrainedOpenGVLab~9 GBruns well with 12 GB
- JanusCoder-8Binternlm~9 GBruns well with 12 GB
- JanusCoderV-7Binternlm~9 GBruns well with 12 GB
- JanusCoderV-8Binternlm~9 GBruns well with 12 GB
- JoyAI-VL-Interactionjdopensource~9 GBruns well with 12 GB
- JoyAI-VL-Interaction-Previewjdopensource~9 GBruns well with 12 GB
- Keye-VL-1_5-8BKwai-Keye~9 GBruns well with 12 GB
- Keye-VL-8B-PreviewKwai-Keye~9 GBruns well with 12 GB
- Llama-3.1-Nemotron-Nano-VL-8B-V1nvidia~9 GBruns well with 12 GB
- llama3-llava-next-8b-hfllava-hf~9 GBruns well with 12 GB
- llava-interleave-qwen-7b-dpo-hfllava-hf~9 GBruns well with 12 GB
- llava-interleave-qwen-7b-hfllava-hf~9 GBruns well with 12 GB
- LLaVA-OneVision-1.5-8B-Baselmms-lab~9 GBruns well with 12 GB
- LLaVA-OneVision-1.5-8B-Instructlmms-lab~9 GBruns well with 12 GB
- llava-onevision-qwen2-7b-ov-chat-hfllava-hf~9 GBruns well with 12 GB
- llava-onevision-qwen2-7b-ov-hfllava-hf~9 GBruns well with 12 GB
- llava-onevision-qwen2-7b-si-hfllava-hf~9 GBruns well with 12 GB
- LLaVA-Video-7B-Qwen2lmms-lab~9 GBruns well with 12 GB
- MAI-UI-8BTongyi-MAI~9 GBruns well with 12 GB
- MEDEAIndexTeam~9 GBruns well with 12 GB
- MiMo-Embodied-7BXiaomiMiMo~9 GBruns well with 12 GB
- MiMo-VL-7B-RLXiaomiMiMo~9 GBruns well with 12 GB
- MiMo-VL-7B-RL-2508XiaomiMiMo~9 GBruns well with 12 GB
- MiMo-VL-7B-SFTXiaomiMiMo~9 GBruns well with 12 GB
- MiMo-VL-7B-SFT-2508XiaomiMiMo~9 GBruns well with 12 GB
- MiniCPM-Llama3-V-2_5openbmb~9 GBruns well with 12 GB
- MiniCPM-V-2_6openbmb~9 GBruns well with 12 GB
- MiniCPM-V-4_5openbmb~9 GBruns well with 12 GB
- Molmo-7B-D-0924allenai~9 GBruns well with 12 GB
- Molmo2-8Ballenai~9 GBruns well with 12 GB
- MolmoPoint-8Ballenai~9 GBruns well with 12 GB
- MolmoPoint-GUI-8Ballenai~9 GBruns well with 12 GB
- MolmoWeb-8Ballenai~9 GBruns well with 12 GB
- moondream3-previewmoondream~9 GBruns well with 12 GB
- moondream3.1-9B-A2Bmoondream~9 GBruns well with 12 GB
- nemotron-labs-audio-visual-flamingo-hfnvidia~9 GBruns well with 12 GB
- Nemotron-Labs-Diffusion-VLM-8Bnvidia~9 GBruns well with 12 GB
- olmOCR-2-7B-1025allenai~9 GBruns well with 12 GB
- olmOCR-7B-0225-previewallenai~9 GBruns well with 12 GB
- olmOCR-7B-0725allenai~9 GBruns well with 12 GB
- olmOCR-7B-0825allenai~9 GBruns well with 12 GB
- POINTS-GUI-Gtencent~9 GBruns well with 12 GB
- Qianfan-VL-8Bbaidu~9 GBruns well with 12 GB
- qwen2_5vl-7b-wolfv2-tunedEfficient-Large-Model~9 GBruns well with 12 GB
- Qwen2-VL-7BQwen~9 GBruns well with 12 GB
- Qwen2-VL-7B-InstructQwen~9 GBruns well with 12 GB
- Qwen2.5-VL-7B-InstructQwen~9 GBruns well with 12 GB
- Qwen2.5-VL-7B-Surg-CholecT50nvidia~9 GBruns well with 12 GB
- Qwen3-VL-8B-InstructQwen~9 GBruns well with 12 GB
- Qwen3-VL-8B-ThinkingQwen~9 GBruns well with 12 GB
- Sa2VA-8BByteDance~9 GBruns well with 12 GB
- Sa2VA-InternVL3-8BByteDance~9 GBruns well with 12 GB
- Sa2VA-Qwen2_5-VL-7BByteDance~9 GBruns well with 12 GB
- SAGE-MM-Molmo2-8B-SFTallenai~9 GBruns well with 12 GB
- SAGE-MM-Molmo2-8B-SFT_RLallenai~9 GBruns well with 12 GB
- SAGE-MM-Qwen2.5-VL-7B-SFTallenai~9 GBruns well with 12 GB
- SAGE-MM-Qwen2.5-VL-7B-SFT_RLallenai~9 GBruns well with 12 GB
- SAGE-MM-Qwen3-VL-8B-SFTallenai~9 GBruns well with 12 GB
- SAGE-MM-Qwen3-VL-8B-SFT_RLallenai~9 GBruns well with 12 GB
- ScaleCUA-7BOpenGVLab~9 GBruns well with 12 GB
- SkyCaptioner-V1Skywork~9 GBruns well with 12 GB
- Skywork-VL-Reward-7BSkywork~9 GBruns well with 12 GB
- Spark-VL-7Binternlm~9 GBruns well with 12 GB
- Spatial-SSRL-7Binternlm~9 GBruns well with 12 GB
- Thyme-RLKwai-Keye~9 GBruns well with 12 GB
- Thyme-SFTKwai-Keye~9 GBruns well with 12 GB
- TimeLens-7BTencentARC~9 GBruns well with 12 GB
- TimeLens-8BTencentARC~9 GBruns well with 12 GB
- TimePLEKlingTeam~9 GBruns well with 12 GB
- UI-TARS-1.5-7BByteDance-Seed~9 GBruns well with 12 GB
- UI-TARS-7B-DPOByteDance-Seed~9 GBruns well with 12 GB
- UI-TARS-7B-SFTByteDance-Seed~9 GBruns well with 12 GB
- UI-Venus-1.5-8BinclusionAI~9 GBruns well with 12 GB
- UI-Venus-Ground-7BinclusionAI~9 GBruns well with 12 GB
- UI-Venus-Navi-7BinclusionAI~9 GBruns well with 12 GB
- UniRG-CXRmicrosoft~9 GBruns well with 12 GB
- VidEmo-7BKlingTeam~9 GBruns well with 12 GB
- Video-XL-2BAAI~9 GBruns well with 12 GB
- VideoChat-Flash-Qwen2_5-7B_InternVideo2-1BOpenGVLab~9 GBruns well with 12 GB
- VideoChat-R1_5-7BOpenGVLab~9 GBruns well with 12 GB
- VideoChat-R1_7BOpenGVLab~9 GBruns well with 12 GB
- VideoChat-R1_7B_captionOpenGVLab~9 GBruns well with 12 GB
- VideoChat-R1-thinking_7BOpenGVLab~9 GBruns well with 12 GB
- VideoChat-TPOOpenGVLab~9 GBruns well with 12 GB
- VideoTemp-o3Kwai-Keye~9 GBruns well with 12 GB
- ViLaSRinclusionAI~9 GBruns well with 12 GB
- viscon-contextual-captionertiiuae~9 GBruns well with 12 GB
- VisualPRM-8BOpenGVLab~9 GBruns well with 12 GB
- X-Reasoner-7Bmicrosoft~9 GBruns well with 12 GB
- ZeroGUI-AndroidLab-7BOpenGVLab~9 GBruns well with 12 GB
- ZeroGUI-OSWorld-7BOpenGVLab~9 GBruns well with 12 GB
- ZwZ-7BinclusionAI~9 GBruns well with 12 GB
- ZwZ-8BinclusionAI~9 GBruns well with 12 GB
- exp_tas_optimal_combined_traces-Qwen3.5-9Blaion~10 GBruns well with 12 GB
- Fara1.5-9Bmicrosoft~10 GBruns well with 12 GB
- flux-3-image-klein-pupblack-forest-labs~10 GBruns well with 12 GB
- GLM-4.1V-9B-Basezai-org~10 GBruns well with 12 GB
- GLM-4.1V-9B-Thinkingzai-org~10 GBruns well with 12 GB
- GLM-4.6V-Flashzai-org~10 GBruns well with 12 GB
- Glyphzai-org~10 GBruns well with 12 GB
- Holo-3.1-9BHcompany~10 GBruns well with 12 GB
- liftdatalab-to~10 GBruns well with 12 GB
- Llama-3.2-11B-Visionmeta-llama~10 GBruns well with 12 GB
- MiMo-V2.6-Distill-Qwen-9BXiaomiMiMo~10 GBruns well with 12 GB
- nemosci-tasrep-a1mfc-gfistaqc-scaff-maxeps-swes-r2eg-9B__Qwen3.5-9Blaion~10 GBruns well with 12 GB
- paligemma2-10b-ft-docci-448google~10 GBruns well with 12 GB
- paligemma2-10b-mix-224google~10 GBruns well with 12 GB
- paligemma2-10b-mix-448google~10 GBruns well with 12 GB
- paligemma2-10b-pt-224google~10 GBruns well with 12 GB
- paligemma2-10b-pt-448google~10 GBruns well with 12 GB
- paligemma2-10b-pt-896google~10 GBruns well with 12 GB
- Perception-LM-8Bfacebook~10 GBruns well with 12 GB
- PVC-InternVL2-8BOpenGVLab~10 GBruns well with 12 GB
- Qwen3.5-9B-BaseQwen~10 GBruns well with 12 GB
- SingGuard-NSFA-9BinclusionAI~10 GBruns well with 12 GB
- Step3-VL-10Bstepfun-ai~10 GBruns well with 12 GB
- Step3-VL-10B-Basestepfun-ai~10 GBruns well with 12 GB
- UI-Mate-9Btencent~10 GBruns well with 12 GB
- UI2Code_Nzai-org~10 GBruns well with 12 GB
- VISTA-9BinclusionAI~10 GBruns well with 12 GB
- WebVIA-Agentzai-org~10 GBruns well with 12 GB
- ZAYA1-VL-8BZyphra~10 GBruns well with 12 GB
- ZwZ2-9BinclusionAI~10 GBruns well with 12 GB
- falcon-11B-vlmtiiuae~11 GBruns well with 12 GB
- gemma-4-12Bgoogle~11 GBruns well with 12 GB
- Llama-3.2-11B-Vision-Instructmeta-llama~11 GBruns well with 12 GB
- Llama-Guard-3-11B-Visionmeta-llama~11 GBruns well with 12 GB
- moss-video-preview-baseOpenMOSS-Team~11 GBruns well with 12 GB
- moss-video-preview-realtime-sftOpenMOSS-Team~11 GBruns well with 12 GB
- moss-video-preview-sftOpenMOSS-Team~11 GBruns well with 12 GB
- MOSS-VL-Base-0408OpenMOSS-Team~11 GBruns well with 12 GB
- MOSS-VL-Base-0708OpenMOSS-Team~11 GBruns well with 12 GB
- MOSS-VL-Instruct-0408OpenMOSS-Team~11 GBruns well with 12 GB
- MOSS-VL-Instruct-0708OpenMOSS-Team~11 GBruns well with 12 GB
- MOSS-VL-Instruct-0708-NF4OpenMOSS-Team~11 GBruns well with 12 GB
- MOSS-VL-RealtimeOpenMOSS-Team~11 GBruns well with 12 GB
- MOSS-VL-Realtime-NF4OpenMOSS-Team~11 GBruns well with 12 GB
- MOSS-VL-Realtime-SGLANGOpenMOSS-Team~11 GBruns well with 12 GB
- blip2-flan-t5-xxlSalesforce~12 GBruns well with 12 GB
- cogvlm2-llama3-captionzai-org~12 GBruns well with 12 GB
- DepthLMfacebook~12 GBruns well with 12 GB
- gemma-3-12b-itgoogle~12 GBruns well with 12 GB
- gemma-3-12b-ptgoogle~12 GBruns well with 12 GB
- Holotron-12BHcompany~12 GBruns well with 12 GB
- instructblip-flan-t5-xxlSalesforce~12 GBruns well with 12 GB
- Llama-Guard-4-12Bmeta-llama~12 GBruns well with 12 GB
- NVIDIA-Nemotron-Nano-12B-v2-VL-BF16nvidia~12 GBruns well with 12 GB
- NVIDIA-Nemotron-Nano-12B-v2-VL-FP8nvidia~12 GBruns well with 12 GB
- translategemma-12b-itgoogle~12 GBruns well with 12 GB
- cogagent-9b-20241220zai-org~13 GBQ4 · Hugging Face count
- instructblip-vicuna-13bSalesforce~13 GBQ4 · Hugging Face count
- llava-1.5-13b-hfllava-hf~13 GBQ4 · Hugging Face count
- llava-v1.6-vicuna-13b-hfllava-hf~13 GBQ4 · Hugging Face count
- PIIP-LLaVA_CLIP-BL_512-448_13BOpenGVLab~13 GBQ4 · Hugging Face count
- PIIP-LLaVA_ConvNeXt-B_CLIP-L_1024-336_13BOpenGVLab~13 GBQ4 · Hugging Face count
- PIIP-LLaVA_ConvNeXt-L_CLIP-L_1024-336_13BOpenGVLab~13 GBQ4 · Hugging Face count
- vip-llava-13b-hfllava-hf~13 GBQ4 · Hugging Face count
- Apriel-1.5-15b-ThinkerServiceNow-AI~14 GBQ4 · Hugging Face count
- Apriel-1.6-15b-ThinkerServiceNow-AI~14 GBQ4 · Hugging Face count
- InternVL3_5-14BOpenGVLab~14 GBQ4 · Hugging Face count
- InternVL3_5-14B-FlashOpenGVLab~14 GBQ4 · Hugging Face count
- InternVL3_5-14B-HFOpenGVLab~14 GBQ4 · Hugging Face count
- InternVL3_5-14B-InstructOpenGVLab~14 GBQ4 · Hugging Face count
- InternVL3_5-14B-MPOOpenGVLab~14 GBQ4 · Hugging Face count
- InternVL3_5-14B-PretrainedOpenGVLab~14 GBQ4 · Hugging Face count
- InternVL3-14BOpenGVLab~14 GBQ4 · Hugging Face count
- InternVL3-14B-hfOpenGVLab~14 GBQ4 · Hugging Face count
- InternVL3-14B-InstructOpenGVLab~14 GBQ4 · Hugging Face count
- InternVL3-14B-PretrainedOpenGVLab~14 GBQ4 · Hugging Face count
- Phi-4-reasoning-vision-15Bmicrosoft~14 GBQ4 · Hugging Face count
- Sa2VA-InternVL3-14BByteDance~14 GBQ4 · Hugging Face count
- deepseek-vl2-smalldeepseek-ai~15 GBQ4 · Hugging Face count
- Kimi-VL-A3B-Instructmoonshotai~15 GBQ4 · Hugging Face count
- Kimi-VL-A3B-Thinkingmoonshotai~15 GBQ4 · Hugging Face count
- Kimi-VL-A3B-Thinking-2506moonshotai~15 GBQ4 · Hugging Face count
- LLaDA-UIinclusionAI~15 GBQ4 · Hugging Face count
- InternVL3_5-GPT-OSS-20B-A4B-Preview-HFOpenGVLab~18 GBQ4 · Hugging Face count
- Ariarhymes-ai~21 GBQ4 · Hugging Face count
- Aria-Base-64Krhymes-ai~21 GBQ4 · Hugging Face count
- Aria-Base-8Krhymes-ai~21 GBQ4 · Hugging Face count
- Aria-Chatrhymes-ai~21 GBQ4 · Hugging Face count
- Aria-sequential_mlprhymes-ai~21 GBQ4 · Hugging Face count
- diffusiongemma-26B-A4B-itgoogle~22 GBQ4 · Hugging Face count
- gemma-4-26B-A4Bgoogle~22 GBQ4 · Hugging Face count
- InternVL-Chat-V1-5OpenGVLab~22 GBQ4 · Hugging Face count
- InternVL2_5-26BOpenGVLab~22 GBQ4 · Hugging Face count
- InternVL2_5-26B-MPOOpenGVLab~22 GBQ4 · Hugging Face count
- InternVL2-26BOpenGVLab~22 GBQ4 · Hugging Face count
- Sa2VA-26BByteDance~22 GBQ4 · Hugging Face count
- AREX-2BAAI~23 GBQ4 · Hugging Face count
- deepseek-vl2deepseek-ai~23 GBQ4 · Hugging Face count
- Fara1.5-27Bmicrosoft~23 GBQ4 · Hugging Face count
- Flora-Captionernvidia~23 GBQ4 · Hugging Face count
- Flora-Rewardernvidia~23 GBQ4 · Hugging Face count
- gemma-3-27b-itgoogle~23 GBQ4 · Hugging Face count
- gemma-3-27b-ptgoogle~23 GBQ4 · Hugging Face count
- Holo4-27BHcompany~23 GBQ4 · Hugging Face count
- medgemma-27b-itgoogle~23 GBQ4 · Hugging Face count
- paligemma2-28b-mix-224google~23 GBQ4 · Hugging Face count
- paligemma2-28b-mix-448google~23 GBQ4 · Hugging Face count
- paligemma2-28b-pt-224google~23 GBQ4 · Hugging Face count
- paligemma2-28b-pt-448google~23 GBQ4 · Hugging Face count
- paligemma2-28b-pt-896google~23 GBQ4 · Hugging Face count
- Qwen-Image-BenchQwen~23 GBQ4 · Hugging Face count
- Qwen3.5-27BQwen~23 GBQ4 · Hugging Face count
- Smaug-Political-Uncensoredabacusai~23 GBQ4 · Hugging Face count
- Smaug-Uncensoredabacusai~23 GBQ4 · Hugging Face count
- translategemma-27b-itgoogle~23 GBQ4 · Hugging Face count
- UI-Mate-27Btencent~23 GBQ4 · Hugging Face count
- UI-Mate-democua-27Btencent~23 GBQ4 · Hugging Face count
- ZwZ2-27BinclusionAI~23 GBQ4 · Hugging Face count
- ERNIE-4.5-VL-28B-A3B-Base-Paddlebaidu~25 GBQ4 · Hugging Face count
- ERNIE-4.5-VL-28B-A3B-Base-PTbaidu~25 GBQ4 · Hugging Face count
- ERNIE-4.5-VL-28B-A3B-Paddlebaidu~25 GBQ4 · Hugging Face count
- ERNIE-4.5-VL-28B-A3B-PTbaidu~25 GBQ4 · Hugging Face count
- ERNIE-4.5-VL-28B-A3B-Thinkingbaidu~25 GBQ4 · Hugging Face count
- Hy-Embodied-VLM-1.0tencent~25 GBQ4 · Hugging Face count
- gemma-4-31Bgoogle~26 GBQ4 · Hugging Face count
- Holo2-30B-A3BHcompany~26 GBQ4 · Hugging Face count
- InternVL3_5-30B-A3BOpenGVLab~26 GBQ4 · Hugging Face count
- InternVL3_5-30B-A3B-FlashOpenGVLab~26 GBQ4 · Hugging Face count
- InternVL3_5-30B-A3B-HFOpenGVLab~26 GBQ4 · Hugging Face count
- InternVL3_5-30B-A3B-InstructOpenGVLab~26 GBQ4 · Hugging Face count
- InternVL3_5-30B-A3B-MPOOpenGVLab~26 GBQ4 · Hugging Face count
- InternVL3_5-30B-A3B-PretrainedOpenGVLab~26 GBQ4 · Hugging Face count
- Ising-Calibration-1.5-31B-BF16nvidia~26 GBQ4 · Hugging Face count
- Keye-VL-2.0-30B-A3BKwai-Keye~26 GBQ4 · Hugging Face count
- Prompt-RefineHiDream-ai~26 GBQ4 · Hugging Face count
- Qwen3-VL-30B-A3B-InstructQwen~26 GBQ4 · Hugging Face count
- Qwen3-VL-30B-A3B-ThinkingQwen~26 GBQ4 · Hugging Face count
- UI-Venus-1.5-30B-A3BinclusionAI~26 GBQ4 · Hugging Face count
- aya-vision-32bCohereLabs~27 GBQ4 · Hugging Face count
- Holotron-3-NanoHcompany~27 GBQ4 · Hugging Face count
- Holotron4-30B-A3BHcompany~27 GBQ4 · Hugging Face count
- LLaVA-NeXT-Video-32B-Qwenlmms-lab~27 GBQ4 · Hugging Face count
- AesCode-32Bmicrosoft~28 GBQ4 · Hugging Face count
- chameleon-30bfacebook~28 GBQ4 · Hugging Face count
- Cosmos-Reason2-32Bnvidia~28 GBQ4 · Hugging Face count
- GTA1-32BSalesforce~28 GBQ4 · Hugging Face count
- OriOn-Qwen-SR1lightonai~28 GBQ4 · Hugging Face count
- Qwen2.5-VL-32B-InstructQwen~28 GBQ4 · Hugging Face count
- Qwen3-VL-32B-InstructQwen~28 GBQ4 · Hugging Face count
- Qwen3-VL-32B-ThinkingQwen~28 GBQ4 · Hugging Face count
- ScaleCUA-32BOpenGVLab~28 GBQ4 · Hugging Face count
- AdvancedMathBench-AutoVerifierinternlm~29 GBQ4 · Hugging Face count
- fibo-scene-analyzerbriaai~29 GBQ4 · Hugging Face count
- Holo-3.1-35B-A3BHcompany~29 GBQ4 · Hugging Face count
- Holo3-35B-A3BHcompany~29 GBQ4 · Hugging Face count
- Holo4-35B-A3BHcompany~29 GBQ4 · Hugging Face count
- Intern-S2-Mobiusinternlm~29 GBQ4 · Hugging Face count
- LLaVA-NeXT-Video-34B-DPOlmms-lab~29 GBQ4 · Hugging Face count
- LLaVA-NeXT-Video-34B-DPO-hfllava-hf~29 GBQ4 · Hugging Face count
- LLaVA-NeXT-Video-34B-hfllava-hf~29 GBQ4 · Hugging Face count
- llava-v1.6-34b-hfllava-hf~29 GBQ4 · Hugging Face count
- MiniCPM-V-4.7-35B-A3Bopenbmb~29 GBQ4 · Hugging Face count
- Qwen3.5-35B-A3B-BaseQwen~29 GBQ4 · Hugging Face count
- Qwen3.6-35B-A3BQwen~29 GBQ4 · Hugging Face count
- Intern-S2-Previewinternlm~30 GBQ4 · Hugging Face count
- InternVL2_5-38BOpenGVLab~31 GBQ4 · Hugging Face count
- InternVL2_5-38B-MPOOpenGVLab~31 GBQ4 · Hugging Face count
- InternVL3_5-38BOpenGVLab~31 GBQ4 · Hugging Face count
- InternVL3_5-38B-HFOpenGVLab~31 GBQ4 · Hugging Face count
- InternVL3_5-38B-InstructOpenGVLab~31 GBQ4 · Hugging Face count
- InternVL3_5-38B-MPOOpenGVLab~31 GBQ4 · Hugging Face count
- InternVL3_5-38B-PretrainedOpenGVLab~31 GBQ4 · Hugging Face count
- InternVL3-38BOpenGVLab~31 GBQ4 · Hugging Face count
- InternVL3-38B-hfOpenGVLab~31 GBQ4 · Hugging Face count
- InternVL3-38B-InstructOpenGVLab~31 GBQ4 · Hugging Face count
- InternVL3-38B-PretrainedOpenGVLab~31 GBQ4 · Hugging Face count
- Skywork-R1V-38BSkywork~31 GBQ4 · Hugging Face count
- Skywork-R1V2-38BSkywork~31 GBQ4 · Hugging Face count
- Skywork-R1V3-38BSkywork~31 GBQ4 · Hugging Face count
- SkyworkVL-38BSkywork~31 GBQ4 · Hugging Face count
- InternVL3_5-38B-FlashOpenGVLab~32 GBQ4 · Hugging Face count
With 12 GB you also run… 4
The next memory size on this ladder runs these well. Figures are the requirement on this hardware type.
- internimage_g_22kto1k_512OpenGVLab~10 GB16-bit est. · Hugging Face count
- internimage_g_jointto22k_384OpenGVLab~10 GB16-bit est. · Hugging Face count
- metaclip-2-worldwide-giantfacebook~11 GB16-bit est. · Hugging Face count
- metaclip-2-worldwide-giant-378facebook~11 GB16-bit est. · Hugging Face count
471 more vision models in the catalog have no usable memory figure or parameter count for this profile. Browse Vision models
Image
Image · Prompt alignment · GenEval
0–1 · higher is better
Source: GenEval · 2023 · reviewed 2026-10-05 · Published quality in the original benchmark preset; not measured on this hardware.
| Stable Diffusion XL 1.0Platform path documented · stable-diffusion.cpp · source | 0.55 | Not on the LMArena text-to-image leaderboard of 2026-10-07 | Documented path without a memory figure | Platform path documented |
|---|---|---|---|---|
| Stable Diffusion 1.5Platform path documented · stable-diffusion.cpp · source | 0.43 | Not on the LMArena text-to-image leaderboard of 2026-10-07 | Documented path without a memory figure | Platform path documented |
| stable-diffusion-3-medium-diffusers16-bit est. · params · source | No comparable published result | Not reviewed for LMArena | ~8 GB | 16-bit est. · params |
| stable-diffusion-xl-refiner-0.916-bit est. · params · source | No comparable published result | Not reviewed for LMArena | ~8 GB | 16-bit est. · params |
| stable-diffusion-xl-refiner-1.016-bit est. · params · source | No comparable published result | Not reviewed for LMArena | ~8 GB | 16-bit est. · params |
| URSA-1.7B-IBQ102416-bit est. · params · source | No comparable published result | Not reviewed for LMArena | ~8 GB | 16-bit est. · params |
| URSA-1.7B-IBQ51216-bit est. · params · source | No comparable published result | Not reviewed for LMArena | ~8 GB | 16-bit est. · params |
| Lumina Image v216-bit est. · params · source | No comparable published result | Not on the LMArena text-to-image leaderboard of 2026-10-07 | ~7 GB | 16-bit est. · params |
LMArena ratings in this table: LMArena 2026-10-07 · collected 2026-10-25 · dataset · CC BY 4.0
With 12 GB you also run… 15
The next memory size on this ladder. Figures are the requirement on this hardware type.
- CogView3-Plus-3Bzai-org~9 GB16-bit est. · params
- Illustrious-xl-early-release-v0OnomaAIResearch~9 GB16-bit est. · params
- japanese-stable-diffusion-xlstabilityai~9 GB16-bit est. · params
- KolorsKwai-Kolors~9 GB16-bit est. · params
- Kolors-InpaintingKwai-Kolors~9 GB16-bit est. · params
- playground-v2-1024px-aestheticplaygroundai~9 GB16-bit est. · params
- playground-v2-256px-baseplaygroundai~9 GB16-bit est. · params
- playground-v2-512px-baseplaygroundai~9 GB16-bit est. · params
- sdxl-turbostabilityai~9 GB16-bit est. · params
- stable-diffusion-xl-base-0.9stabilityai~9 GB16-bit est. · params
- Stable Diffusion 3.5 MediumStability AI~10 GBPublisher minimum
- Stable Diffusion 3.5 LargeStability AI~11 GBPublisher minimum
- BagelByteDance~12 GBPublisher minimum
- FOFPredSalesforce~12 GB16-bit est. · params
- OmniGen-v1BAAI~12 GB16-bit est. · params
231 more image models in the catalog have no usable memory figure or parameter count for this profile. Browse Image models
Video
| Kandinsky-S2V-1.0-Lite-Diffusers16-bit est. · params · source | ~8 GB | 16-bit est. · params |
|---|---|---|
| Kandinsky-S2V-1.0-Lite-distill-Diffusers16-bit est. · params · source | ~8 GB | 16-bit est. · params |
| VACE-Wan2.1-1.3B-Preview16-bit est. · params · source | ~8 GB | 16-bit est. · params |
| Wan2.1-VACE-1.3B16-bit est. · params · source | ~8 GB | 16-bit est. · params |
| Wan2.1-VACE-1.3B-diffusers16-bit est. · params · source | ~8 GB | 16-bit est. · params |
| CogVideoX-2b16-bit est. · params · source | ~7 GB | 16-bit est. · params |
| Kandinsky-WM-1.0-I2V-5s-AV16-bit est. · params · source | ~7 GB | 16-bit est. · params |
| Kandinsky-WM-1.0-I2V-5s-PH16-bit est. · params · source | ~7 GB | 16-bit est. · params |
How this list works Documented execution paths on this hardware first, then publisher minimums (CUDA or Apple MPS).
With 12 GB you also run… 9
The next memory size on this ladder. Figures are the requirement on this hardware type.
- Wan2.1 T2V 1.3BWan-AI~8 GBPublished requirement
- Wan2.1-T2V-1.3B-DiffusersWan-AI~8 GBPublisher minimum
- Allegrorhymes-ai~9 GB16-bit est. · params
- Allegro-T2V-40x360Prhymes-ai~9 GB16-bit est. · params
- Allegro-T2V-40x720Prhymes-ai~9 GB16-bit est. · params
- Allegro-TI2Vrhymes-ai~9 GB16-bit est. · params
- Kandinsky-6.0-Lite-5s-Diffuserskandinskylab~10 GB16-bit est. · params
- Kandinsky-6.0-Lite-distill-5s-Diffuserskandinskylab~10 GB16-bit est. · params
- Kandinsky-6.0-Lite-pretrain-5s-Diffuserskandinskylab~10 GB16-bit est. · params
124 more video models in the catalog have no usable memory figure or parameter count for this profile. Browse Video models
Audio
Audio · Word error rate · Open ASR
% · lower is better
Source: Word error rate · Open ASR · reviewed 2026-10-20 · Published quality in the original benchmark preset; not measured on this hardware.
| Whisper large-v3-turboPlatform path documented · whisper.cpp / CUDA · source | 7.83 | Documented path without a memory figure | Platform path documented |
|---|---|---|---|
| Whisper large-v3Platform path documented · whisper.cpp / CUDA · source | 7.44 | Documented path without a memory figure | Platform path documented |
| acestep-v15-base16-bit est. · params · source | No comparable published result | ~8 GB | 16-bit est. · params |
| acestep-v15-sft16-bit est. · params · source | No comparable published result | ~8 GB | 16-bit est. · params |
| acestep-v15-turbo-continuous16-bit est. · params · source | No comparable published result | ~8 GB | 16-bit est. · params |
| acestep-v15-turbo-shift116-bit est. · params · source | No comparable published result | ~8 GB | 16-bit est. · params |
| acestep-v15-turbo-shift316-bit est. · params · source | No comparable published result | ~8 GB | 16-bit est. · params |
| cohere-transcribe-03-202616-bit est. · params · source | No comparable published result | ~8 GB | 16-bit est. · params |
With 12 GB you also run… 55
The next memory size on this ladder. Figures are the requirement on this hardware type.
- canary-qwen-2.5bnvidia~9 GB16-bit est. · params
- higgs-audio-v3-sttbosonai~9 GB16-bit est. · params
- higgs-audio-v3-stt-v2bosonai~9 GB16-bit est. · params
- musicgen-melody-largefacebook~9 GB16-bit est. · params
- musicgen-stereo-melody-largefacebook~9 GB16-bit est. · params
- stt-2.6b-enkyutai~9 GB16-bit est. · params
- stt-2.6b-en-candlekyutai~9 GB16-bit est. · params
- stt-2.6b-en-mlxkyutai~9 GB16-bit est. · params
- stt-2.6b-en-trfskyutai~9 GB16-bit est. · params
- VibeVoice-ASR-Streaming-1.5Bmicrosoft~9 GB16-bit est. · params
- 3b-de-ft-research_releasecanopylabs~10 GB16-bit est. · params
- 3b-es_it-ft-research_releasecanopylabs~10 GB16-bit est. · params
- 3b-fr-ft-research_releasecanopylabs~10 GB16-bit est. · params
- 3b-hi-ft-research_releasecanopylabs~10 GB16-bit est. · params
- 3b-ko-ft-research_releasecanopylabs~10 GB16-bit est. · params
- 3b-zh-ft-research_releasecanopylabs~10 GB16-bit est. · params
- granite-speech-3.3-2bibm-granite~10 GB16-bit est. · params
- laionbox-v0.4-wiplaion~10 GB16-bit est. · params
- Llama-3.2-3B-Instructmeta-llama~10 GB16-bit est. · params
- MERaLiON-3-3B-ASRMERaLiON~10 GB16-bit est. · params
- MOSS-TTS-Local-TransformerOpenMOSS-Team~10 GB16-bit est. · params
- musicgen-largefacebook~10 GB16-bit est. · params
- TaDiCodec-TTS-AR-Qwen2.5-3Bamphion~10 GB16-bit est. · params
- whisper-largeopenai~10 GBPublisher minimum
- whisper-large-v2openai~10 GBPublisher minimum
- MERaLiON-2-3BMERaLiON~11 GB16-bit est. · params
- musicgen-stereo-largefacebook~11 GB16-bit est. · params
- Step-Audio-TTS-3Bstepfun-ai~11 GB16-bit est. · params
- YuE2-3Bm-a-p~11 GB16-bit est. · params
- 3b-de-pretrain-research_releasecanopylabs~12 GB16-bit est. · params
- 3b-es_it-pretrain-research_releasecanopylabs~12 GB16-bit est. · params
- 3b-fr-pretrain-research_releasecanopylabs~12 GB16-bit est. · params
- 3b-ko-pretrain-research_releasecanopylabs~12 GB16-bit est. · params
- 3b-zh-pretrain-research_releasecanopylabs~12 GB16-bit est. · params
- Breeze TTS 2BreezeBlue~12 GBPublisher minimum
- Humaneness-Singing-Voice-0.1-Alphalaion~12 GB16-bit est. · params
- Humaneness-Voice-Large-1.2-Alphalaion~12 GB16-bit est. · params
- Humaneness-Voice-Large-1.3-Alphalaion~12 GB16-bit est. · params
- Humaneness-Voice-Large-1.7laion~12 GB16-bit est. · params
- Humaneness-Voice-Large-1.7-Singing-Experimentallaion~12 GB16-bit est. · params
- Humaneness-Voice-Large-NotebookLM-Editionlaion~12 GB16-bit est. · params
- Humanness-Voice-Podcastlaion~12 GB16-bit est. · params
- Llasa-3BHKUSTAudio~12 GB16-bit est. · params
- Llasa-3B-Preserve-TextChatHKUSTAudio~12 GB16-bit est. · params
- LongCat-AudioDiT-3.5Bmeituan-longcat~12 GB16-bit est. · params
- MetaVoice v1MetaVoice~12 GBPublisher minimum
- moss-1.5-roleplay-finetunelaion~12 GB16-bit est. · params
- moss-tts-local-transformer-4.55b-voice-actinglaion~12 GB16-bit est. · params
- moss-tts-local-transformer-4.55b-voice-acting-v2laion~12 GB16-bit est. · params
- moss-tts-local-transformer-4.55b-voice-acting-v2-sftlaion~12 GB16-bit est. · params
- moss-tts-local-transformer-4.55b-voice-acting-v2-sft-dpolaion~12 GB16-bit est. · params
- moss-tts-local-transformer-4.55b-voice-acting-v2-sft3laion~12 GB16-bit est. · params
- OpenAudio S1 MiniFish Audio~12 GBPublisher minimum
- orpheus-3b-0.1-ftcanopylabs~12 GB16-bit est. · params
- orpheus-3b-0.1-pretrainedcanopylabs~12 GB16-bit est. · params
1,984 more audio models in the catalog have no usable memory figure or parameter count for this profile. Browse Audio models
Embeddings
Embeddings · MTEB (Multilingual, v2) · mean(task)
0–100 · higher is better
- Color = publisher
| Qwen3-Embedding 4B8-bit · published params · source | 69.5 | ~7 GB | 8-bit · published params |
|---|---|---|---|
| Harrier OSS v1 (0.6B)8-bit · published params · source | 69.0 | ~3 GB | 8-bit · published params |
| Qwen3-Embedding 0.6B8-bit · published params · source | 64.3 | ~3 GB | 8-bit · published params |
| Multilingual E5 Large Instruct8-bit · published params · source | 63.2 | ~3 GB | 8-bit · published params |
| EmbeddingGemma 28-bit · published params · source | 61.4 | ~3 GB | 8-bit · published params |
| EmbeddingGemma (300M)8-bit · published params · source | 61.1 | ~3 GB | 8-bit · published params |
| BGE-M38-bit · published params · source | 59.6 | ~3 GB | 8-bit · published params |
| Nomic Embed Text v2 (MoE)8-bit · published params · source | 57.6 | ~3 GB | 8-bit · published params |
With 12 GB you also run… 49
The next memory size on this ladder runs these well. Figures are the requirement on this hardware type.
- InternViT-6B-448px-V1-2OpenGVLab~9 GB8-bit · Hub count
- InternViT-6B-448px-V1-5OpenGVLab~9 GB8-bit · Hub count
- InternViT-6B-448px-V2_5OpenGVLab~9 GB8-bit · Hub count
- pixio-vit5b16facebook~9 GB8-bit · Hub count
- sapiens2-pretrain-5bfacebook~9 GB8-bit · Hub count
- WeMM-Embedding-4Btencent~9 GB8-bit · Hub count
- webssl-dino7b-full8b-224facebook~10 GB8-bit · Hub count
- webssl-dino7b-full8b-378facebook~10 GB8-bit · Hub count
- webssl-dino7b-full8b-518facebook~10 GB8-bit · Hub count
- bge-en-iclBAAI~11 GB8-bit · Hub count
- cocom-v1-128-mistral-7bnaver~11 GB8-bit · Hub count
- cocom-v1-16-mistral-7bnaver~11 GB8-bit · Hub count
- cocom-v1-4-mistral-7bnaver~11 GB8-bit · Hub count
- dinov3-vit7b16-pretrain-lvd1689mfacebook~11 GB8-bit · Hub count
- dinov3-vit7b16-pretrain-sat493mfacebook~11 GB8-bit · Hub count
- e5-mistral-7b-instructintfloat~11 GB8-bit · Hub count
- LLARA-beirBAAI~11 GB8-bit · Hub count
- LLARA-documentBAAI~11 GB8-bit · Hub count
- LLARA-passageBAAI~11 GB8-bit · Hub count
- LLARA-pretrainBAAI~11 GB8-bit · Hub count
- MusiLingo-long-v1m-a-p~11 GB8-bit · Hub count
- MusiLingo-musicqa-v1m-a-p~11 GB8-bit · Hub count
- MusiLingo-short-v1m-a-p~11 GB8-bit · Hub count
- nomic-embed-codenomic-ai~11 GB8-bit · Hub count
- NV-EmbedCode-7b-v1nvidia~11 GB8-bit · Hub count
- NV-Retriever-v1nvidia~11 GB8-bit · Hub count
- qwen2.5-coder-7B-instruct-bdnomic-ai~11 GB8-bit · Hub count
- SFR-Embedding-2_RSalesforce~11 GB8-bit · Hub count
- SFR-Embedding-MistralSalesforce~11 GB8-bit · Hub count
- Qwen3-Embedding 8BAlibaba (Qwen)~12 GB8-bit · published params
- bge-reasoner-embed-qwen3-8b-0923BAAI~12 GB8-bit · Hub count
- BGE-VL-MLLM-S1BAAI~12 GB8-bit · Hub count
- BGE-VL-MLLM-S2BAAI~12 GB8-bit · Hub count
- BGE-VL-v1.5-mmebBAAI~12 GB8-bit · Hub count
- BGE-VL-v1.5-zsBAAI~12 GB8-bit · Hub count
- E2Rank-8BAlibaba-NLP~12 GB8-bit · Hub count
- gme-Qwen2-VL-7B-InstructAlibaba-NLP~12 GB8-bit · Hub count
- gte-Qwen1.5-7B-instructAlibaba-NLP~12 GB8-bit · Hub count
- gte-Qwen2-7B-instructAlibaba-NLP~12 GB8-bit · Hub count
- GVE-7BAlibaba-NLP~12 GB8-bit · Hub count
- LaSER-Qwen3-8BAlibaba-NLP~12 GB8-bit · Hub count
- llama-embed-nemotron-8bnvidia~12 GB8-bit · Hub count
- Nemotron-3-Embed-8B-BF16nvidia~12 GB8-bit · Hub count
- NV-Embed-v1nvidia~12 GB8-bit · Hub count
- NV-Embed-v2nvidia~12 GB8-bit · Hub count
- Qwen3-Reranker-8BQwen~12 GB8-bit · Hub count
- Qwen3-VL-Embedding-8BQwen~12 GB8-bit · Hub count
- Qwen3Guard-Stream-8BQwen~12 GB8-bit · Hub count
- SciCore-Omicsopenbmb~12 GB8-bit · Hub count
Runs well within 8 GB of VRAM · planning estimates, not measured speed
Measurements
Speed on this hardware
We have not yet included a verifiable measurement for this exact configuration. The memory estimates above do not indicate tokens per second or time to first token.Specifications
19 sourced fields; the source is named once per group, and a field from another source links to it. Official specifications
Marker: the lightest text model that does not run well here but runs well with 12 GB. No text model that runs well here has a LiveBench score. Q4 planning estimate, not a measured fit.
Reviewed · Manufacturer source
- Graphics processor
- NVIDIA GeForce RTX 5060 Ti
- GPU runtime status
- Not stated by the source
- Memory capacity
- 8 GB
- Memory kind
- Dedicated VRAM
- Power connectors
- 1x PCIe 8-pin cables / OR / 300 W or greater PCIe Gen 5 cable (adapter in box)
- AI performance (TOPS, manufacturer)
- 759 TOPS
- GPU architecture
- Blackwell
- Memory bandwidth
- 448 GB/s
- GPU base clock
- 2,410 MHz
- GPU boost clock
- 2,570 MHz
- CUDA compute capability
- 12.0
- CUDA cores
- 4,608
- GPU memory type
- GDDR7
- GPU power
- 180 W
- Memory interface
- 128 bit
- Minimum power supply
- 600 W
- PCIe interface
- Gen 5
NVIDIA GeForce RTX 5060 Ti with 8 GB VRAM. Runtime support and local inference speed are not verified.
Photo: ASUS partner-board photo of a GeForce RTX 5060 Ti 8 GB · other partner boards vary. · Manufacturer source
Memory bandwidth is not measured model speed; verify runtime and checkpoint compatibility. Hardware specification reviewed: 2026-10-13.
How estimates work
- Candidates
- Reviewed pages use published parameter counts; automatic text candidates use official repository tensor counts (packed quantized weights and unsupported architectures excluded).
- Planning
- Q4 weights + 20% allowance + reserve: 25% of unified or system memory (at least 2 GB, at most 8 GB; 2 GB here) or 2 GB per dedicated GPU. Adjustable in “Adjust the estimate”. No KV cache is calculated from context.
- Fit tiers
- Runs well: the estimate fits the fast memory (VRAM, or unified memory within the macOS GPU share). Runs slowly: within the machine's memory but outside the fast part; a graphics card offloads layers to PC RAM (the listed RAM, or 32 GB assumed). Doesn't run: above both. Tiers are planning estimates, never a speed.
- Vision
- Vision-language models use the Q4 planning estimate from the parameter count (published by the model page, or read from Hugging Face). Classic vision models (classify, detect, segment) use a 16-bit estimate. No vision benchmark is tracked, so rows carry no score.
- Media and embeddings
- Media rows use documented execution paths (exact hardware or platform) and publisher minimums; a published requirement above this memory moves a model to the next tier. Without either, a 16-bit estimate from the published parameter count (× 1.2 + 2 GB), labelled as such. Embeddings use 8-bit weights + 20% + 2 GB.
Local AI basics: parameters, Q4 and memory · Full model catalog · Data and methodology
Alternatives
Other machines on the same memory ladder (VRAM); each page lists the models that fit it.
Also 8 GB 8
Less memory · 6 GB 4
More memory · 12 GB 8
- RTX 5070 · 12 GB VRAM
- RTX 3060 · 12 GB VRAM
- RTX 4070 · 12 GB VRAM
- RTX 4070 SUPER · 12 GB VRAM
- Dell Alienware 16X Aurora (AC16251) · Core Ultra 9 290HX Plus · RTX 5070 Ti 12 GB · 32 GB
- HP ZBook Fury 16 G11 · Core i9-14900HX · RTX 4000 Ada 12 GB · 32 GB
- ROG Zephyrus G14 (2025) · Ryzen AI 9 HX 370 · RTX 5070 Ti · 32 GB
- RTX 5070 Laptop GPU · 12 GB VRAM
