Stochastic Gradient Descent on a.devhttps://aditya08.github.io/tags/stochastic-gradient-descent/Recent content in Stochastic Gradient Descent on a.devHugo -- 0.148.0enMon, 13 Jan 2025 00:00:00 +0000Communication-Efficient, 2D Parallel Stochastic Gradient Descent for Distributed-Memory Optimizationhttps://aditya08.github.io/publications/hybridsgd/Mon, 13 Jan 2025 00:00:00 +0000https://aditya08.github.io/publications/hybridsgd/This paper presents HybridSGD, a 2D parallel stochastic gradient descent method that trades off communication between s-step SGD and Federated Averaging