SignMuon: Communication-Efficient Distributed Muon Optimization

Sign-Muon is a novel 1-bit, matrix-aware optimizer proposed for communication-efficient distributed training of large neural networks. It combines sign aggregation with a polar-step framework, achieving an O(1/√T) nonconvex rate and reducing the stochastic term by 1/√M for M workers.