Distillation in Practice: Ablating Gemma 3 27B with synthetic data from Sonnet 4

A hands-on experiment fine-tuning Gemma 3 27B using synthetic data from Sonnet 4, achieving performance that rivals GPT-4o on specific tasks while being smaller and cheaper to run.