TRACE: Transformer Residual Activation Codebook Encoding for Communication-efficient Distributed Edge Inference

Distributed Transformer inference across co-located edge devices is fundamentally communication-bound, as exchanging activations between sequence-parallel partitions dominates inference latency under commodity edge bandwidths.