Skip to content
Local AI Wizard
Your machine
Theme

Qwen3-4B-Instruct-2507-4bit

mlx-community · mlx-community/Qwen3-4B-Instruct-2507-4bit

Weights license: Apache 2.0 · code and components may use other terms

Measured speed134.5 tok/sMLX q4 · 1 machine · mlx-lm BENCHMARKS.md · all rows
Memory neededNot verifiedNo estimate without a verified parameter basis
ParametersNot reported, or a community distributionNot reported, or a community distribution
Repository updated2026-01-02A commit is not a release date

Quality

No comparable score

We track no public, comparable benchmark that covers this model yet. No score is inferred.

Reported by the publisher

This model card has not been read for benchmark results yet. card not read yet

Runs on

No memory requirement to match

Without a parameter count with a known basis or a documented memory path, no hardware is grouped. Nothing is guessed.

Measured speed

Tokens per second by machine

Output tok/s · 1 machine · every row in the table · What is a token?

Apple M4 Max · 64 GB, 134.52 · MLX q4134.5
Measured speed
Apple M4 Max · 64 GB (GPU cores not stated)134.52MLX q42048 / 128 · Single mlx_lm.benchmark processMLX (mlx-lm)mlx 0.29.2.dev20251008+85a8824a8 · mlx-lm 0.28.2 · macOS 26.1mlx-community/Qwen3-4B-Instruct-2507-4bit

Source: mlx-lm BENCHMARKS.md · maintainer result (checked 2026-10-25) · MLX (mlx-lm) · mlx 0.29.2.dev20251008+85a8824a8 · mlx-lm 0.28.2 · macOS 26.1 · not estimated

How to run

Runtime compatibility and tokens per second have not been measured for this entry. Published metadata and a memory estimate do not prove a successful local run.

Library in source: mlx

Choose my computer

Technical details

What the source and the catalog store for this checkpoint. Missing fields are left out, never zero.

Task
text-generation
Architecture
Qwen3ForCausalLM
Library in source
mlx
Weight license
Apache 2.0
Commercial use
Allowed Apache License 2.0 text (SPDX) · read 2026-10-18license text
Every stored field13 fields
Revision checked
50d427756c6b1b2fe0c0a10f67fbda1fc8e82c1b
Architecture
Qwen3ForCausalLM
Library
mlx
Hub task tag
text-generation
Declared base models
Qwen/Qwen3-4B-Instruct-2507
Distributions in this group
Qwen/Qwen3-4B-Instruct-2507
Formats
mlx, safetensors
Access
Open download
Publisher kind
Community distribution
Repository created
2025-08-06creation is not the model's release
Repository updated
2026-01-02a commit is not a release date
Hub downloads (30 days) · likes
42,387 · 15this repository only · read 2026-10-25
Catalog state
Hub config or weights found; no inventory benchmark link

Sources

Identity and published specifications come from the checkpoint page. Benchmark scores belong to the named release and do not measure speed on your computer.

Valid source snapshot: 2026-09-26. This source record has not received a complete technical review. Missing data remain unknown; a repository commit is not a model release date.