PyTorch2 min read
Moore Threads Open-Sources Megatron-MUSA-Titan for Trillion-Parameter MoE Training on Its GPUs
Moore Threads has open-sourced Megatron-MUSA-Titan, the training stack it uses for trillion-parameter MoE pretraining on 10,000-GPU clusters, with blockwise FP8 and support for slime and miles RL.
By PandailyPandaily

Read the full story
Originally published by Pandaily on Oct 29, 2026.
Comments
Sign in to join the discussion.