A unified convergence theory for adaptive first-order methods in the nonconvex case, including AdaNorm, full and diagonal AdaGrad, Shampoo and Muon

Serge Gratton
, Philippe Toint

Namur Institute for Complex Systems

Research output: Working paper › Preprint

6 Downloads (Pure)

2 Invited talk

2 results
- Title
- Start date(ascending)

A unified convergence theory for adaptive first-order methods in the nonconvex case, including AdaNorm, full and diagonal AdaGrad, Shampoo and Muon
Toint, P. (Speaker)
26 Jun 2026 → 1 Jul 2026
Activity: Talk or presentation types › Invited talk
A unified convergence theory for adaptive first-order methods in the nonconvex case, including AdaNorm, full and diagonal AdaGrad, Shampoo and Muon
Toint, P. (Speaker)
4 Jun 2026
Activity: Talk or presentation types › Invited talk