A unified convergence theory for adaptive first-order methods in the nonconvex case, including AdaNorm, full and diagonal AdaGrad, Shampoo and Muon

Serge Gratton
, Philippe Toint

Namur Institute for Complex Systems

Research output: Working paper › Preprint

6 Downloads (Pure)

2 Article
2 Working paper
1 Conference contribution
1 Preprint

2 results

Filter

2026
Stochastic convergence of parallel asynchronous adaptive first-order methods
Gratton, S. & Toint, P., Jun 2026, Arxiv.
Research output: Working paper

File
6 Downloads (Pure)
2025
Fast Stochastic Second-Order Adagrad for Nonconvex Bound-Constrained Optimization
Bellavia, S., Gratton, S., Morini, B. & Toint, P., 2025, Arxiv.
Research output: Working paper

File
21 Downloads (Pure)