Skip to content
Local AI Wizard
Your machine
Theme

Models on this hardware

Start here

Text

Within 56 GB: 773 run well · 2 tight · 37 reviewed · 66 more run slowly (66 of them run well with 96 GB)

Text · LiveBench · overall

0–100 · higher is better

  • Color = publisher

Source: LiveBench 2026-06-25 · collected 2026-10-18 · Open models without a score are not drawn (no score ≠ 0).

Rows run well first, then tight fits; within each, reviewed models, then Hub downloads over 30 days, not quality. Sort a score column to rank by that source alone. All 66 text models that would run well with 96 GB but not here already run here, slowly.
Text models that run well within 56 GB
Smaug MiniAbacus AI · 27BQ4 · published params · source76.9Not on the LMArena text leaderboard of 2026-10-22~29 GBQ4 · published paramssource
Qwen3.8 27BAlibaba · 27B · LMArena 1,437Q4 · published params · source75.31,437 ± 5~29 GBQ4 · published paramssource
Qwen3.6 27BAlibaba · 27BQ4 · published params · source64.0Not on the LMArena text leaderboard of 2026-10-22~29 GBQ4 · published paramssource
Nemotron 3.5 Lightning 30B A3BNVIDIA · 30BQ4 · published params · source44.5Arena rated the NVFP4 build, NVIDIA-Nemotron-3.5-Lightning-30B-A3B (NVFP4); this entry is the BF16 reference, which NVIDIA reports with different scores~31 GBQ4 · published paramssource
Qwen3 14BAlibaba · 14.8BQ4 · published params · sourceNo comparable published resultNot on the LMArena text leaderboard of 2026-10-22~20 GBQ4 · published paramssource
Qwen3.5 9BAlibaba · 9BQ4 · published params · sourceNo comparable published resultNot on the LMArena text leaderboard of 2026-10-22~15 GBQ4 · published paramssource
Gemma 4 31BGoogle · 30.7B · LMArena 1,452Q4 · published params · sourceNo comparable published result1,452 ± 7~32 GBQ4 · published paramssource
Qwen3 8BAlibaba · 8.2BQ4 · published params · sourceNo comparable published resultNot on the LMArena text leaderboard of 2026-10-22~15 GBQ4 · published paramssource
8 of 775

LMArena ratings in this table: LMArena 2026-10-22 · collected 2026-10-25 · dataset · CC BY 4.0

Tight fit: it runs, but leaves less than 5.6 GB free beyond the 8 GB the system keeps (the memory figure already includes that reserve).

Every reviewed text model here 37

Every one that runs here, well or slowly, scored or not; 20 of 37 have a LiveBench or LMArena result. Run well first, then tight fits, then slow; within each, by Hub downloads over 30 days, read 2026-11-19, not by quality.

Reviewed text models that run on Mac mini M5 Pro · 64 GB unified
Qwen3 14BAlibaba · 14.8BNot in LiveBench 2026-06-25Not on the LMArena text leaderboard of 2026-10-22~20 GB9.0Apache 2.013.2M
Qwen3.8 27BAlibaba · 27B75.31,437~29 GB16.5Apache 2.06.9M
Qwen3.5 9BAlibaba · 9BNot in LiveBench 2026-06-25Not on the LMArena text leaderboard of 2026-10-22~15 GB5.7Apache 2.06.5M
Gemma 4 31BGoogle · 30.7BNot in LiveBench 2026-06-251,452~32 GB18.3Apache 2.06.3M
Qwen3 8BAlibaba · 8.2BNot in LiveBench 2026-06-25Not on the LMArena text leaderboard of 2026-10-22~15 GB5.0Apache 2.06.1M
gpt-oss-20bOpenAI · 21BNot in LiveBench 2026-06-251,317~24 GB11.6Apache 2.05.6M
Gemma 4 26B A4BGoogle · 25.2BNot in LiveBench 2026-06-251,437~27 GB16.9Apache 2.05M
Gemma 4 E4BGoogle · 8BNot in LiveBench 2026-06-25Not on the LMArena text leaderboard of 2026-10-22~14 GB5.0Apache 2.04.4M
8 of 37
Also runs slowly66 models

Above the macOS default GPU share (56 GB here, reserve included) but within the 64 GB installed: the rest runs on the CPU unless the limit is raised. Planning estimate, not a speed figure.

6 of 66

Browse Text models

Adjust the estimate: quantization, context, reserveloads the live catalog

Vision

Within 56 GB: 1,062 run well · 10 reviewed · 17 more run slowly (17 of them run well with 96 GB) · 11 more with 96 GB

Vision · LMArena

rating · higher is better

  • Color = publisher

Source: LMArena 2026-10-19 · collected 2026-10-25 · dataset · CC BY 4.0 · Models without a rating are left out, not scored as zero.

Rows run well first, then tight fits; within each, reviewed models, then Hub downloads over 30 days, not quality. Sort a score column to rank by that source alone.
Vision models that run well within 56 GB
Gemma 4 31BGoogle · 30.7B · Image to text · LMArena 1,262Q4 · published params · source1,262 ± 6~32 GBQ4 · published paramssource
Qwen3.8 27BAlibaba · 27B · Image to text · LMArena 1,242Q4 · published params · source1,242 ± 8~29 GBQ4 · published paramssource
Gemma 4 26B A4BGoogle · 25.2B · Image to text · LMArena 1,242Q4 · published params · source1,242 ± 6~27 GBQ4 · published paramssource
gemma-3-27b-itgoogle · 27.43B · Image to text · LMArena 1,160Q4 · Hugging Face count · source1,160 ± 8~29 GBQ4 · Hugging Face countsource
Qwen2.5-VL-32B-InstructQwen · 33.45B · Image to text · LMArena 1,119Q4 · Hugging Face count · source1,119 ± 15~34 GBQ4 · Hugging Face countsource
Molmo2-8Ballenai · 8.66B · Image to text · LMArena 1,112Q4 · Hugging Face count · source1,112 ± 20~15 GBQ4 · Hugging Face countsource
Qwen2-VL-7B-InstructQwen · 8.29B · Image to text · LMArena 1,031Q4 · Hugging Face count · source1,031 ± 11~15 GBQ4 · Hugging Face countsource
Molmo-7B-D-0924allenai · 8.02B · Image to text · LMArena 994Q4 · Hugging Face count · source994 ± 14~15 GBQ4 · Hugging Face countsource
8 of 1,062

LMArena ratings in this table: LMArena 2026-10-19 · collected 2026-10-25 · dataset · CC BY 4.0

Also runs slowly17 models

Above the macOS default GPU share (56 GB here, reserve included) but within the 64 GB installed: the rest runs on the CPU unless the limit is raised. Planning estimate, not a speed figure.

6 of 17

With 96 GB you also run… 11

The next memory size on this ladder runs these well. Figures are the requirement on this hardware type.

6 of 11

471 more vision models in the catalog have no usable memory figure or parameter count for this profile. Browse Vision models

Image

171 within 56 GB · 2 more with 96 GB

Image · Prompt alignment · GenEval

0–1 · higher is better

Source: GenEval · 2023 · reviewed 2026-10-05 · Published quality in the original benchmark preset; not measured on this hardware.

Image models within 56 GB
Stable Diffusion XL 1.0Stability AI · 2.6B · Text to imagePlatform path documented · Apple Core ML · source0.55Not on the LMArena text-to-image leaderboard of 2026-10-07Documented path without a memory figurePlatform path documentedApple Core ML · source
Stable Diffusion 1.5Stability AI · 0.98B · Text to imagePlatform path documented · Apple Core ML · source0.43Not on the LMArena text-to-image leaderboard of 2026-10-07Documented path without a memory figurePlatform path documentedApple Core ML · source
CoTyleKwai-Kolors · 20.4B · Text to image16-bit est. · params · sourceNo comparable published resultNot reviewed for LMArena~51 GB16-bit est. · paramssource
Qwen-Image-EditQwen · 20.4B · Image to image16-bit est. · params · sourceNo comparable published resultNot reviewed for LMArena~51 GB16-bit est. · paramssource
Qwen-Image-Edit-2509Qwen · 20.4B · Image to image16-bit est. · params · sourceNo comparable published resultNot reviewed for LMArena~51 GB16-bit est. · paramssource
Qwen-Image-Edit-2511Qwen · 20.4B · Image to image16-bit est. · params · sourceNo comparable published resultNot reviewed for LMArena~51 GB16-bit est. · paramssource
Qwen-Image-Edit-NVPCB-OVSL2SLnvidia · 20.4B · Image to image16-bit est. · params · sourceNo comparable published resultNot reviewed for LMArena~51 GB16-bit est. · paramssource
Qwen-Image-Flashnvidia · 20.4B · Text to image16-bit est. · params · sourceNo comparable published resultNot reviewed for LMArena~51 GB16-bit est. · paramssource
8 of 171

LMArena ratings in this table: LMArena 2026-10-07 · collected 2026-10-25 · dataset · CC BY 4.0

With 96 GB you also run… 2

The next memory size on this ladder. Figures are the requirement on this hardware type.

231 more image models in the catalog have no usable memory figure or parameter count for this profile. Browse Image models

Video

122 within 56 GB · 7 more with 96 GB
Video models within 56 GB
LTX-2.3 FastLightricks · 22B · Text to video16-bit est. · params · source~55 GB16-bit est. · paramssource
LTX-2.3 ProLightricks · 22B · Text to video16-bit est. · params · source~55 GB16-bit est. · paramssource
LTX-2.5 FastLightricks · 22B · Text to video16-bit est. · params · source~55 GB16-bit est. · paramssource
LTX-2.5 ProLightricks · 22B · Text to video16-bit est. · params · source~55 GB16-bit est. · paramssource
Kandinsky-S2V-1.0-Pro-Diffuserskandinskylab · 21.4B · Image to video16-bit est. · params · source~54 GB16-bit est. · paramssource
Kandinsky-S2V-1.0-Pro-distill-Diffuserskandinskylab · 21.4B · Image to video16-bit est. · params · source~54 GB16-bit est. · paramssource
Video-As-Prompt-Wan2.1-14BByteDance · 20.7B · Image to video16-bit est. · params · source~52 GB16-bit est. · paramssource
JoyAI-Echojdopensource · 19B · Image to video16-bit est. · params · source~48 GB16-bit est. · paramssource
8 of 122

How this list works Documented execution paths on this hardware first, then publisher minimums (CUDA or Apple MPS).

With 96 GB you also run… 7

The next memory size on this ladder. Figures are the requirement on this hardware type.

6 of 7

125 more video models in the catalog have no usable memory figure or parameter count for this profile. Browse Video models

Audio

381 within 56 GB · 2 more with 96 GB

Audio · Word error rate · Open ASR

% · lower is better

Source: Word error rate · Open ASR · reviewed 2026-10-20 · Published quality in the original benchmark preset; not measured on this hardware.

Audio models within 56 GB
Whisper large-v3-turboOpenAI · 0.81B · Speech to textPlatform path documented · whisper.cpp / Metal · source7.83Documented path without a memory figurePlatform path documentedwhisper.cpp / Metal · source
Whisper large-v3OpenAI · 1.55B · Speech to textPlatform path documented · whisper.cpp / Metal · source7.44Documented path without a memory figurePlatform path documentedwhisper.cpp / Metal · source
Ming-omni-tts-16.8B-A3BinclusionAI · 17.9B · Text to speech16-bit est. · params · sourceNo comparable published result~45 GB16-bit est. · paramssource
acestep-captionerACE-Step · 10.7B · Sound effects and audio16-bit est. · params · sourceNo comparable published result~28 GB16-bit est. · paramssource
acestep-transcriberACE-Step · 10.7B · Speech to text16-bit est. · params · sourceNo comparable published result~28 GB16-bit est. · paramssource
MERaLiON-2-10BMERaLiON · 10.1B · Speech to text16-bit est. · params · sourceNo comparable published result~27 GB16-bit est. · paramssource
MERaLiON-2-10B-ASRMERaLiON · 10.1B · Speech to text16-bit est. · params · sourceNo comparable published result~27 GB16-bit est. · paramssource
Kimi-Audio-7Bmoonshotai · 9.8B · Text to speech16-bit est. · params · sourceNo comparable published result~26 GB16-bit est. · paramssource
8 of 381

With 96 GB you also run… 2

The next memory size on this ladder. Figures are the requirement on this hardware type.

1,986 more audio models in the catalog have no usable memory figure or parameter count for this profile. Browse Audio models

Embeddings

654 run well within 56 GB

Embeddings · MTEB (Multilingual, v2) · mean(task)

0–100 · higher is better

  • Color = publisher

Source: MTEB results (curated rows, sourced per model)

Embeddings models that run well within 56 GB
Qwen3-Embedding 8BAlibaba (Qwen)8-bit · published params · source70.6~12 GB8-bit · published paramssource
Qwen3-Embedding 4BAlibaba (Qwen)8-bit · published params · source69.5~7 GB8-bit · published paramssource
Harrier OSS v1 (0.6B)Microsoft8-bit · published params · source69.0~3 GB8-bit · published paramssource
Qwen3-Embedding 0.6BAlibaba (Qwen)8-bit · published params · source64.3~3 GB8-bit · published paramssource
Multilingual E5 Large Instructintfloat8-bit · published params · source63.2~3 GB8-bit · published paramssource
EmbeddingGemma 2Google8-bit · published params · source61.4~3 GB8-bit · published paramssource
EmbeddingGemma (300M)Google8-bit · published params · source61.1~3 GB8-bit · published paramssource
BGE-M3BAAI8-bit · published params · source59.6~3 GB8-bit · published paramssource
8 of 654

Browse Embeddings models

Runs well within 56 GB of unified memory · planning estimates, not measured speed live catalog · 19,444 repositories · checked

Measurements

Published tokens per second, exactly as measured; never estimated.

Published measurements on this hardware
Llama 2 7B Q4_0ggml-org/Llama-2-7B-GGUF:Q4_0Mac mini M5 Pro · 15 CPU / 16 GPU cores · 64 GB · macOS 27.067.59 ± 0.05Q4_0
0 / 128 · Single llama-bench process;…
Metal / BLAS
llama.cpp commit 60081bb2b (11046)
llama.cpp Apple Silicon · community result
2026-09-26

Specifications

18 sourced fields; the source is named once per group, and a field from another source links to it. Official specifications

Unified memory64 GBShared by CPU and GPU · source
Memory bandwidth307 GB/sManufacturer spec · not model speed · source
Where to buyApple StoreManufacturer link · this configuration · US · recorded

Markers: the best LiveBench-scored text model that runs well here, and the lightest text model that does not run well here but runs well with 96 GB. Q4 planning estimates, not measured fits.

Selected configuration

Latest check · Manufacturer source

Memory capacity
64 GB
Memory type
64 GB unified
Chip / processor
Apple M5 Pro
Memory bandwidth
307 GB/s
CPU
Apple M5 Pro
Memory type
LPDDR5X

Family specification

Latest check · Manufacturer source

Storage options (family)
512 GB · 1 TB · 2 TB · 4 TB · 8 TB SSD
Ports
3 × Thunderbolt 5 · 2 × USB-C (10 Gb/s) · HDMI · 2.5Gb Ethernet · 3.5 mm
Maximum continuous power (specification)
155 W
Release date
2026-09-22
Wi-Fi
Wi-Fi 7 (802.11be)
Bluetooth
Bluetooth 6
Dimensions (cm)
12.7 × 12.7 × 5.0 (W × D × H)
Operating system
macOS
Neural Engine cores
16
Maximum Thunderbolt rate
120 Gb/s
Weight
0.73 kg
Introduced
2026

64 GB unified-memory configuration. The operating system and other processes share this pool. Confirm an Apple Silicon runtime and compatible checkpoint; CUDA evidence does not establish Metal support.

Photo: Official manufacturer image. · Manufacturer source

Memory bandwidth is not measured model speed; verify runtime and checkpoint compatibility. Hardware specification reviewed: 2026-10-13.

How estimates work
Candidates
Reviewed pages use published parameter counts; automatic text candidates use official repository tensor counts (packed quantized weights and unsupported architectures excluded).
Planning
Q4 weights + 20% allowance + reserve: 25% of unified or system memory (at least 2 GB, at most 8 GB; 8 GB here) or 2 GB per dedicated GPU. Adjustable in “Adjust the estimate”. No KV cache is calculated from context.
Fit tiers
Runs well: the estimate fits the fast memory (VRAM, or unified memory within the macOS GPU share). Runs slowly: within the machine's memory but outside the fast part; a graphics card offloads layers to PC RAM (the listed RAM, or 32 GB assumed). Doesn't run: above both. Tiers are planning estimates, never a speed.
Vision
Vision-language models use the Q4 planning estimate from the parameter count (published by the model page, or read from Hugging Face). Classic vision models (classify, detect, segment) use a 16-bit estimate. No vision benchmark is tracked, so rows carry no score.
Media and embeddings
Media rows use documented execution paths (exact hardware or platform) and publisher minimums; a published requirement above this memory moves a model to the next tier. Without either, a 16-bit estimate from the published parameter count (× 1.2 + 2 GB), labelled as such. Embeddings use 8-bit weights + 20% + 2 GB.

Local AI basics: parameters, Q4 and memory · Full model catalog · Data and methodology

Alternatives

Other machines on the same memory ladder (unified memory); each page lists the models that fit it.