Skip to content
Local AI Wizard
Your machine
Theme

What are the best local AI models for 8 GB?

The reviewed models that run well on 8 GB, ranked by each quality source.

Memory · updated

Short answer

13models

13 reviewed text models run well on 8 GB, on a graphics card or a Mac. The strongest by each source:

  • LMArena: Granite 4.2 3B, Granite 4.2 8B, and Llama 3.1 8B Instruct
  • LiveBench: No scored model fits.
  • Two separate rankings: the site never mixes them.

Computed from the reviewed catalog with the site's fit rule; scores from LiveBench and LMArena. Methodology

How this list is made

This page is computed from the site's catalog every time it is built, so it moves with the data instead of going stale. It takes every reviewed open text model with a published parameter count and asks the same question the hardware pages ask: does its Q4 file, plus working room and the machine's reserve, fit in fast memory? A model is listed here when it runs well on both reference machines: RTX 4060 · 8 GB VRAM, which keeps 2 GB of the card aside, and Mac mini M2 · 8 GB unified, which keeps 25% of its memory (2 GB) for macOS and your apps.

Quality comes from two sources that are never mixed: LiveBench (2026-06-25), test questions scored 0 to 100, and LMArena (2026-10-22), a rating from blind human votes. Each has its own table below. 8 of the 13 models have neither score yet; they still run well and are in the full table below. How to read the scores.

Top by LMArena

Blind human preference, 2026-10-22 release. Q4 need includes each machine's reserve.

Top reviewed models by LMArena 2026-10-22 that run well on 8 GB.
Model · publisher · parametersLMArena 2026-10-22 (rating)Q4 need, card / Mac (GB)
Granite 4.2 3B
IBM · 3B
1,2905 / 5
Granite 4.2 8B
IBM · 8B
1,2908 / 8
Llama 3.1 8B Instruct
Meta · 8B
1,2118 / 8
Llama 3.2 3B Instruct
Meta · 3.2B
1,1675 / 5
Llama 3.2 1B Instruct
Meta · 1.2B
1,1113 / 3

Top by LiveBench

Test questions, 2026-06-25 release, 0–100. Q4 need includes each machine's reserve.

No LiveBench-scored model runs well on 8 GB

Every reviewed model with a LiveBench score needs more memory than these machines offer by the site's estimate. No score is borrowed from a larger sibling.

Every model that runs well

13 reviewed text models, scored or not. Ordered by Hub downloads over 30 days, read 2026-10-25, not by quality; sort a score column to rank by that source alone.

Every reviewed text model that runs well on 8 GB
Llama 3.1 8B InstructMeta · 8BNot in LiveBench 2026-06-251,2118 / 84.9Llama 3.14.8M
Qwen3 1.7BAlibaba · 1.7BNot in LiveBench 2026-06-25Not on the LMArena text leaderboard of 2026-10-224 / 41.1Apache 2.04.1M
Gemma 4 E4BGoogle · 8BNot in LiveBench 2026-06-25Not on the LMArena text leaderboard of 2026-10-228 / 85.0Apache 2.04M
Llama 3.2 1B InstructMeta · 1.2BNot in LiveBench 2026-06-251,1113 / 30.8Llama 3.23.5M
Gemma 4 E2BGoogle · 5.1BNot in LiveBench 2026-06-25Not on the LMArena text leaderboard of 2026-10-226 / 63.1Apache 2.03M
Qwen3 4B Instruct 2507Alibaba · 4BNot in LiveBench 2026-06-25Not on the LMArena text leaderboard of 2026-10-225 / 52.5Apache 2.02.6M
Llama 3.2 3B InstructMeta · 3.2BNot in LiveBench 2026-06-251,1675 / 52.0Llama 3.21.1M
SmolLM3 3BHugging Face · 3BNot in LiveBench 2026-06-25Not on the LMArena text leaderboard of 2026-10-225 / 51.9Apache 2.0718.7K
8 of 13

The full lists

Each hardware page lists every model, scored or not, with files and sources.

RTX 4060 · 8 GB VRAM
13 reviewed text models run well24 more run slowly with part of the model in PC RAM (32 GB assumed).
Mac mini M2 · 8 GB unified
13 reviewed text models run wellThe Mac shares this memory with macOS; at this size its reserve, 25% of memory, is 2 GB, the same as the card's, so both need the same for a file.