Communication-Efficient Distributed Training for Collaborative Flat Optima Recovery in Deep Learning
We propose a communication-efficient distributed training framework (DPPF) that introduces a pushing force to promote wide minima recovery, improving generalization without incurring significant computational or communication overhead.