PyTorch18 min read
Distributed training with Ray Train DLCs and EFA on EKS
The Ray Train Deep Learning Container ships the full CUDA-through-EFA stack, so you build no image. This post walks through a reproducible sample that fine-tunes Qwen2.5-1.5B with PyTorch FSDP across eight GPUs on two EFA-enabled g6.12xlarge instances on Amazon EKS, using the container exactly as…
By Sunita KopparAWS ML Blog

Read the full story
Originally published by AWS ML Blog on Oct 28, 2026.
Comments
Sign in to join the discussion.