Know a great AI tool or AI news source? Submit it to AiByts

Ternary Bonsai 2 9B GGUF: Run a 2.4GB Vision Model Locally

Prism ML's ternary Bonsai 2 9B shrinks Qwen 3.5 9B to a 2.4GB GGUF file. Here's how it runs on llama.cpp and how well it actually performs.

By MindStudio TeamMindStudio Blog
Ternary Bonsai 2 9B GGUF: Run a 2.4GB Vision Model Locally

Read the full story

Originally published by MindStudio Blog on Oct 16, 2026.

Read on MindStudio Blog(opens in a new tab)

Comments

Sign in to join the discussion.

No comments yet — be the first to share your thoughts.