Local AI Wizard
Abacus AI / text + image

Smaug Mini

The Smaug Mini checkpoint is published by Abacus AI for language and reasoning. Its weights are available under Apache 2.0; that alone does not establish that its code and all components are open source.

When to consider it

Consider this agent-oriented fine-tune of Qwen3.8-27B when you need to compare tool use with the base model.

Check before choosing

The publisher documents vLLM serving and agent-specific settings, but this site has not verified a hardware minimum or reproduced its tests.

What is documented

Checkpoint / version
abacusai/Smaug-Mini ↗
Weight license
Apache 2.0 ↗
Task and modality
language and reasoning · text + image
Count and basis
27B · manufacturer specification · 27B active
Context
262,144 tokens published for this model
Quality evidence
76.9 · LiveBench 2026-06-25 overall · source ↗
Runtime and precision
Publisher documents vLLM. Precision and local execution are not verified by this site.

Run locally: known and unknown

~29 GB generic Q4 planning memory. Formula: parameters × 0.625 bytes, plus 20% working allowance and 8 GB reserve. This is neither measured VRAM nor checkpoint download size.

Q4 planning estimate only. Check checkpoint format, runtime support, KV cache, context, batch size and offload before choosing hardware.

Publisher's example

Publisher's reference command for agent use; required hardware is not specified or tested here. deployment instructions ↗

vllm serve abacusai/Smaug-Mini --max-model-len 262144 --reasoning-parser qwen3 --enable-auto-tool-choice --tool-call-parser qwen3_coder

Evidence level: Generic estimate only; no execution reproduced by this site.

Before downloading

  1. Check the exact checkpoint and license linked here.
  2. Confirm a compatible runtime and precision or quantization for your platform.
  3. Allow for context, batch size and any extra media components beyond the weights.

Catalog reviewed: 2026-09-25. Benchmark release: 2026-06-25; snapshot collected: 2026-09-22.