SGLang17 min read
With software alone, one B200 beats the LPU and gets close to Cerebras
Stock SGLang served gpt-oss-120b at 411 tokens per second on one rented B200. Four settings took the same card and the same weights to 1,366, and single prompts to 2,215. No kernel written, nothing recompiled.
By Jaber JaberRunInfra Blog

Read the full story
Originally published by RunInfra Blog on Aug 6, 2026.
Comments
Sign in to join the discussion.