Quiet Local AI Desk

Mac mini M4 16 GB: Measured Ollama Speed and Memory for Qwen3.5 4B and 9B

Affiliate disclosure: Some links are affiliate links. As an Amazon Associate I earn from qualifying purchases. See Disclosure.

This page holds numbers I measured on my own desk machine, not estimates. If a model or a Mac is not in the table, I have not tested it, and I would rather leave the cell out than guess.

The machine and the method

Results

Modelnum_ctxGen tok/s (3 runs)Resident memory (GB, /api/ps)
qwen3.5:4b409618.4 (cold), 22.4, 22.54.1 to 4.3
qwen3.5:4b819221.1, 23.2, 23.54.3 to 4.4
qwen3.5:9b409619.4, 19.4, 19.27.8 to 7.9
qwen3.5:9b819219.2, 19.3, 17.88.0 to 8.1

Cold-load time was 6.3 s for the 4B model and 10.1 s for the 9B model from the internal SSD.

Longer runs: big prompts and 1,024-token answers

Run 2 November 2026, 12:30 to 12:39 IST, same machine and Ollama version. Each run used a fresh prompt (so nothing was cached) and generated the full 1,024 tokens; two runs per cell.

Modelnum_ctxPrompt tokensPrompt tok/s (2 runs)Gen tok/s (2 runs)Peak resident (GB)
qwen3.5:4b81921,976376, 38623.0, 23.34.4
qwen3.5:4b163847,796357, 34621.7, 21.85.3
qwen3.5:9b81921,977200, 19022.7, 23.68.1
qwen3.5:9b163847,797180, 17922.4, 21.49.1

Reading these: prompt processing on the 9B model ran at about half the 4B rate (roughly 180 to 200 against 345 to 385 tok/s), so a 7,800-token prompt took the 9B model about 43 seconds before it wrote anything. Resident memory grew with context, peaking at 9.1 GB for the 9B model at 16K. Generation on the 9B model was faster in these runs than in the short runs above; I have not worked out why, so I report both as measured rather than pick one.

What I take from it

  1. The 9B model is barely slower than the 4B one here. About 19 tok/s against about 22 tok/s warm. On this box the 4B tag does not buy the doubling in speed that its size suggests, so I keep the 4B for short extraction jobs where its smaller footprint matters, not for raw speed.
  2. Both fit in 16 GB with room left. The 9B model sat at about 8 GB resident at 8K context, leaving several GB for macOS and a static-site build. At 16K context it peaked at about 9.1 GB (see the longer runs). I have not measured a second loaded model.
  3. Short runs flatter the numbers. 256 tokens is a quick test. The longer runs above add large prompts and 1,024-token answers; prompt processing is where the 9B model is clearly slower.

If you are choosing a Mac mini for this

For one 4B to 9B model at a time, the 16 GB base M4 handled it in my runs. The M4 has since been replaced: Apple now sells the Mac mini with the M6 (16, 24 or 32 GB; Apple lists 153 GB/s for 16 GB and 170 GB/s for 24 and 32 GB) and the M5 Pro (24 to 64 GB, 307 GB/s). I have not run these tests on either, so every number on this page describes the M4 only. The current 16 GB model: Mac mini M6 16 GB (Amazon.in) ยท Amazon.co.uk. If you want headroom for longer contexts or a browser full of tabs beside the model, 24 GB is the safer buy: Mac mini M6 24 GB (Amazon.in) ยท Amazon.co.uk. Runtime: Ollama.

The raw run data is published as /benchmarks.json, and the RAM calculator uses the same measured rows.