Ternary Bonsai 4B

At the default Q2_0, 149 of 151 phones have enough estimated usable memory; 149 also reach 3+ tokens/s. On Mac, 54 of 54 exact configurations pass using that quant or a smaller tracked fallback.

Params
4B
Family
bonsai
Released
2026-04
Tags
chat

Downloads & memory by quant

The download is only the weights — add KV cache and runtime to get what your phone actually needs. “Memory-fit” only means it can load; “usable” also requires an estimated 3+ tokens/s. Each row uses that row's quant. ★ = recommended.

QuantDownloadMemory neededPhone reality
Q2_0 ★1.1 GB~2 GB149 memory-fit · 149 usable
Q2_0_g641.1 GB~2 GB149 memory-fit · 149 usable

Ternary Bonsai 4B at Q2_0 on 151 phones

This table is fixed to the recommended Q2_0, on each phone's largest RAM option. Counts for smaller quants above will differ. All phones are shown, sorted by fit and estimated experience; tap one for the full report.

PhoneChip · RAMNeedsSpeedVerdict

~ = bandwidth-based estimate · ✓ = measured on real hardware

Ternary Bonsai 4B on 54 Mac configurations

Each Mac uses the recommended Q2_0 at 4K context when it fits, or the largest smaller tracked quant that fits. Each row links to the full report with a macOS-specific setup guide.

MacUnified memoryQuantWorking budgetNeedsEstimated speedVerdict

FAQ

How much RAM do I need to run Ternary Bonsai 4B on a phone?

At Q2_0, Ternary Bonsai 4B needs ~2GB of usable memory (weights + KV cache + runtime). In practice that means a 6GB+ Android phone or a 6GB+ iPhone — iOS lets a single app use less of its RAM than Android does.

How fast does Ternary Bonsai 4B run on a flagship phone?

On the Galaxy S25 Ultra (Snapdragon 8 Elite) it runs at ~31.4 tokens/s at Q2_0, estimated from memory bandwidth. Anything above ~8 tokens/s feels smooth for chat.

Can an iPhone run Ternary Bonsai 4B?

Yes — the iPhone 16 Pro Max runs it at ~24.5 tokens/s at Q2_0, using 2GB of its ~5.2GB usable memory.

What is the best quantization of Ternary Bonsai 4B for mobile?

Q2_0 (1.1GB download) is the size/quality sweet spot of the 2 quants available. Total memory needed is ~2GB once the KV cache and runtime are counted — the download size alone understates it.

How many phones can run Ternary Bonsai 4B?

149 of the 151 phones we track have enough estimated usable memory at Q2_0; 149 also reach our usable-speed threshold of 3 tokens/s, and 136 run smoothly. Memory-fit alone does not mean a good experience.

Which Macs can run Ternary Bonsai 4B?

54 of the 54 exact Mac configurations we track have enough estimated working memory. Each Mac uses the recommended Q2_0 when it fits, or the largest smaller tracked quant that fits, and separates installed unified memory, the macOS reserve, and estimated speed.

What is Ternary Bonsai 4B good for on a phone?

It's tagged for chat. At 4B parameters, it's a fast, lightweight pick for quick tasks.

Guides for Ternary

How to Run Bonsai 27B on Your Phone (iPhone & Android, Step by Step)
Can Your Phone Run Bonsai 27B? RAM Requirements & Speed Estimates (July 2026)
Bonsai 27B vs Qwen3.6 27B on Phones: Is 1-Bit Worth It?

Similar models

Bonsai 27B (1-bit)Ternary Bonsai 27BTernary Bonsai 8BTernary Bonsai 1.7BQwen3 4B