CA-BCD speedup heatmaps on mnist8m

Avoiding Communication in Primal and Dual Block Coordinate Descent Methods

This work develops communication-avoiding variants of primal and dual block coordinate descent for regularized least-squares problems. The variants communicate every $s$ iterations instead of every iteration and attain strong-scaling speedups up to 6.1x on a Cray XC30 supercomputer.

January 2019 · Aditya Devarakonda, Kimon Fountoulakis, James Demmel, Michael W. Mahoney