percoordinate
Percoordinate is a concept describing operations that treat each coordinate of a vector independently. In mathematics and numerical analysis, a per-coordinate approach updates one component at a time, holding the others fixed, or applies a function independently to each coordinate.
In optimization, percoordinate methods include coordinate descent, where the objective is minimized with respect to a
Variants include per-coordinate gradient updates, per-coordinate learning rates, and per-coordinate preconditioning, such as diagonal matrices that
Advantages of percoordinate methods include low per-iteration cost, simplicity, and good performance on sparse or separable
See also: coordinate descent; block coordinate descent; diagonal preconditioner.