
AbstractThis paper examines worst-case evaluation bounds for finding weak minimizers in unconstrained optimization. For the cubic regularization algorithm, Nesterov and Polyak (2006) [15] and Cartis et al. (2010) [3] show that at most O(ϵ−3) iterations may have to be performed for finding an iterate which is within ϵ of satisfying second-order optimality conditions. We first show that this bound can be derived for a version of the algorithm, which only uses one-dimensional global optimization of the cubic model and that it is sharp. We next consider the standard trust-region method and show that a bound of the same type may also be derived for this method, and that it is also sharp in some cases. We conclude by showing that a comparison of the bounds on the worst-case behaviour of the cubic regularization and trust-region algorithms favours the first of these methods.
Evaluation complexity, Statistics and Probability, evaluation complexity, Numerical Analysis, Algebra and Number Theory, Control and Optimization, nonconvex optimization, Applied Mathematics, worst-case analysis, Second-order optimality conditions, second-order optimality conditions, Nonconvex optimization, Worst-case analysis
Evaluation complexity, Statistics and Probability, evaluation complexity, Numerical Analysis, Algebra and Number Theory, Control and Optimization, nonconvex optimization, Applied Mathematics, worst-case analysis, Second-order optimality conditions, second-order optimality conditions, Nonconvex optimization, Worst-case analysis
| citations This is an alternative to the "Influence" indicator, which also reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically). | 55 | |
| popularity This indicator reflects the "current" impact/attention (the "hype") of an article in the research community at large, based on the underlying citation network. | Top 10% | |
| influence This indicator reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically). | Top 10% | |
| impulse This indicator reflects the initial momentum of an article directly after its publication, based on the underlying citation network. | Top 10% |
