How distributed inference keeps large AI models moving
Distributed inference serving is an air traffic control tower for AI traffic, and agentic workflows make it more necessary than ever.
IBM Research Blog12 min read
AI for Code
2 stories
How llm-d makes the most of the hardware you already have
IBM Research and Red Hat deployed a 753B open model on H100 GPUs, serving thousands of concurrent coding agents at 5-10x lower cost than commercial APIs.
IBM Research Blog8 min read
Showing 2 of 2 stories
You're all caught up.
AiByts Weekly Brief
Get the top AI news and tools straight to your inbox every week.
Weekly · AI news
Join 15,000+ AI enthusiasts