High-Order Evaluation Complexity for Convexly-Constrained Optimization with Non-Lipschitzian Group Sparsity Terms

Xiaojun Chen, Philippe Toint

Research output: Contribution to journalArticle

Abstract

This paper studies high-order evaluation complexity for partially separable
convexly-constrained optimization involving non-Lipschitzian group sparsity
terms in a nonconvex objective function. We propose a partially separable
adaptive regularization algorithm using a p-th order Taylor model and show
that the algorithm can produce an (epsilon,delta)-approximate q-th-order
stationary point at most O(epsilon^{-(p+1)/(p-q+1)}) evaluations of the
objective function and its first p derivatives (whenever they exist). Our
model uses the underlying rotational symmetry of the Euclidean norm function
to build a Lipschitzian approximation for the non-Lipschitzian group sparsity
terms, which are defined by the group \ell_2-\ell_a norm with a in (0,1). The
new result shows that the partially-separable structure and non-Lipschitzian
group sparsity terms in the objective function may not affect the worst-case
evaluation complexity order.
Original languageEnglish
Pages (from-to)1-27
Number of pages27
JournalMathematical Programming
Volume1902.10767
DOIs
Publication statusAccepted/In press - 1 Jan 2020

Keywords

  • complexity theory, nonlinear optimization, non-Lipschitz functions, partially-separable problems, group sparsity, isotropic model
  • nonlinear optimization
  • non-Lipschitz functions
  • partially-separable problems
  • group sparsity
  • isotropic model

Fingerprint Dive into the research topics of 'High-Order Evaluation Complexity for Convexly-Constrained Optimization with Non-Lipschitzian Group Sparsity Terms'. Together they form a unique fingerprint.

  • Projects

    Complexity in nonlinear optimization

    TOINT, P., Gould, N. I. M. & Cartis, C.

    1/11/08 → …

    Project: Research

    Activities

    • 1 Invited talk
    • 1 Visiting an external academic institution

    Departement of Applied Mathematics, Polytechnic University of Hong Kong

    Philippe Toint (Visiting researcher)

    15 Nov 201815 Dec 2018

    Activity: Visiting an external institution typesVisiting an external academic institution

    Cite this