Search results

Critical Bug: APC Cache Fails on Second Run If Cache Folder Deleted (Only Triggered Without Code Changes)

bugSomething isn't workingSomething isn't working

Status: Open.

#1146 In Blaizzy/mlx-vlm;

· NeoInBJ opened on May 7, 2026

Gemma 4 MTP drafter: corrupt output + ~0.30 acceptance at B≥2 via mlx_vlm.server (gemma-4-26B-A4B-it-bf16)

bugSomething isn't workingSomething isn't working

Status: Open.

#1144 In Blaizzy/mlx-vlm;

· jeremi opened on May 7, 2026

Add tools / function-calling support to /v1/responses

Status: Open.

#1136 In Blaizzy/mlx-vlm;

· jasonvassallo opened on May 7, 2026

RuntimeError: There is no Stream(gpu, N) in current thread when calling generate from FastAPI worker threads

Status: Open.

#1134 In Blaizzy/mlx-vlm;

· emunozd opened on May 6, 2026

No model is included in the JSON response when making a request to http://127.0.0.1:8080/v1/models

Status: Open.

#1133 In Blaizzy/mlx-vlm;

· slushhh opened on May 6, 2026

mlx_vlm.server crashes if the ~/.cache/huggingface/hub directory is missing

Status: Open.

#1132 In Blaizzy/mlx-vlm;

· slushhh opened on May 6, 2026

mlx_vlm.generate fails with error in presence of --draft-model when model is gemma-4-26b-a4b

Status: Open.

#1122 In Blaizzy/mlx-vlm;

· boutell opened on May 6, 2026

Gemma 4 MTP drafter shows negative speedup on Apple Silicon (regression vs target-only)

Status: Open.

#1121 In Blaizzy/mlx-vlm;

· davidsantin-iam opened on May 6, 2026

Server generation exceptions can spin in a hot error loop

enhancementNew feature or requestNew feature or request

Status: Open.

#1107 In Blaizzy/mlx-vlm;

· eloe opened on May 5, 2026

2026-05-01 -- Diagnostics Report — 2 failure(s), 9 harness issue(s) (mlx-vlm 0.4.5+)

Status: Open.

#1100 In Blaizzy/mlx-vlm;

· jrp2014 opened on May 1, 2026

mlx_vlm.server: error: unrecognized arguments: --draft-model

Status: Open.

#1096 In Blaizzy/mlx-vlm;

· aioloszcy opened on May 1, 2026

MiniCPM-o-4_5 quantized: vision tower crashes with Invalid input array with type uint32 from conv2d

Status: Open.

#1091 In Blaizzy/mlx-vlm;

· madr1c opened on Apr 29, 2026