To Infinity and Beyond: ThunderKittens Now on NVIDIA Vera Rubin NVL72!
We ported ThunderKittens to NVIDIA's Vera Rubin NVL72 and rebuilt our NVFP4 GEMM around the new hardware, taking it from 42% of roofline to over 22 PFLOPS — competitive with cuBLAS and CuTe DSL. Here is what changed in the ISA and how we used it.
Together AI Blog10 min read