Which optimizer adapts learning rates per parameter using first and second moments?

Question

MLQuiz · Accepted Answer

Adam (Adaptive Moment Estimation) combines momentum and RMSprop, maintaining per-parameter learning rates and often working well out-of-the-box for many problems.