Harness5 min read
Google Releases TPU Sync: Open-Source KV Cache Transfer for TPUs
Google released TPU Sync, an open-source C++ library that moves KV caches and weights across TPU HBM, host DRAM, storage and network. Google reports over 90% lower KV transfer latency on 235B to 480B MoE models.
By Michal SutterMarkTechPost

Read the full story
Originally published by MarkTechPost on Nov 13, 2026.
Comments
Sign in to join the discussion.