← Back to context

Comment by gabrielgoh

9 years ago

Author here - yes! It can be used to solve symmetric PSD Systems, as the solution of Ax = b is also the minimizer of 0.5*x'Ax - b'x. Conjugate gradient can be seen as a special form of momentum with adaptive alphas and betas

> Conjugate gradient can be seen as a special form of momentum

Just to be clear, though, CG doesn't use the negative gradients as search directions, as steepest descent would.