Know a great AI tool or AI news source? Submit it to AiByts
PyTorch2 min read

Moore Threads Open-Sources Megatron-MUSA-Titan for Trillion-Parameter MoE Training on Its GPUs

Moore Threads has open-sourced Megatron-MUSA-Titan, the training stack it uses for trillion-parameter MoE pretraining on 10,000-GPU clusters, with blockwise FP8 and support for slime and miles RL.

By PandailyPandaily
Moore Threads Open-Sources Megatron-MUSA-Titan for Trillion-Parameter MoE Training on Its GPUs

Read the full story

Originally published by Pandaily on Oct 29, 2026.

Read on Pandaily(opens in a new tab)

Comments

Sign in to join the discussion.

No comments yet — be the first to share your thoughts.