Comment by chestervonwinch

> Conjugate gradient can be seen as a special form of momentum

Just to be clear, though, CG doesn't use the negative gradients as search directions, as steepest descent would.