An algorithm for the minimization of nonsmooth nonconvex functions using inexact evaluations and its worst-case complexity

Research output: Contribution to journalArticlepeer-review

58 Downloads (Pure)

Abstract

An adaptive regularization algorithm using inexact function and derivatives evaluations is proposed for the solution of composite nonsmooth nonconvex optimization. It is shown that this algorithm needs at most O(|log(ϵ)|ϵ-2) evaluations of the problem’s functions and their derivatives for finding an ϵ-approximate first-order stationary point. This complexity bound therefore generalizes that provided by Bellavia et al. (Theoretical study of an adaptive cubic regularization method with dynamic inexact Hessian information. arXiv:1808.06239, 2018) for inexact methods for smooth nonconvex problems, and is within a factor | log (ϵ) | of the optimal bound known for smooth and nonsmooth nonconvex minimization with exact evaluations. A practically more restrictive variant of the algorithm with worst-case complexity O(| log (ϵ) | + ϵ - 2) is also presented.

Original languageEnglish
Pages (from-to)1-24
Number of pages19
JournalMathematical Programming
Volume187
Issue number1-2
DOIs
Publication statusPublished - 21 Jan 2020

Funding

The third author is grateful to the ENSEEIHT (INP, Toulouse) for providing a friendly research environment for the duration of this research project. Ph. L. Toint: Partially supported by ANR-11-LABX-0040-CIMI within the program ANR-11-IDEX-0002-02. Funding was provided by Agence Nationale de Recherche (FR) (Grant No. ANR-11-LABX-0040-CIMI). Acknowledgements

FundersFunder number
ENSEEIHT
Agence Nationale de la RechercheANR-11-LABX-0040-CIMI, ANR-11-IDEX-0002

    Keywords

    • evaluation complexity
    • nonsmooth problems
    • nonconvex optimization
    • inexact evaluations
    • composite functions
    • Evaluation complexity
    • Nonconvex optimization
    • Composite functions
    • Nonsmooth problems
    • Inexact evaluations

    Fingerprint

    Dive into the research topics of 'An algorithm for the minimization of nonsmooth nonconvex functions using inexact evaluations and its worst-case complexity'. Together they form a unique fingerprint.

    Cite this