ThunderAgent: 2x Faster Agentic Inference for Synthetic Data Generation at Scale

ThunderAgent is a program-aware scheduler for agentic inference. By treating each agent workflow as a schedulable program, it eliminates KV cache thrashing to deliver more than 2x single-node throughput and near-linear multi-node scaling.