GGUF local model

Ternary Bonsai 2 9B GGUF: Run a 2.4GB Vision Model Locally

Prism ML's ternary Bonsai 2 9B shrinks Qwen 3.5 9B to a 2.4GB GGUF file. Here's how it runs on llama.cpp and how well it actually performs.