
arXiv: 2304.14907
A stochastic-gradient-based interior-point algorithm for minimizing a continuously differentiable objective function (that may be nonconvex) subject to bound constraints is presented, analyzed, and demonstrated through experimental results. The algorithm is unique from other interior-point methods for solving smooth nonconvex optimization problems since the search directions are computed using stochastic gradient estimates. It is also unique in its use of inner neighborhoods of the feasible region -- defined by a positive and vanishing neighborhood-parameter sequence -- in which the iterates are forced to remain. It is shown that with a careful balance between the barrier, step-size, and neighborhood sequences, the proposed algorithm satisfies convergence guarantees in both deterministic and stochastic settings. The results of numerical experiments show that in both settings the algorithm can outperform projection-based methods.
FOS: Computer and information sciences, Numerical optimization and variational techniques, Computer Science - Machine Learning, Numerical mathematical programming methods, Optimization and Control (math.OC), stochastic gradient methods, interior-point methods, FOS: Mathematics, stochastic optimization, Mathematics - Optimization and Control, Machine Learning (cs.LG)
FOS: Computer and information sciences, Numerical optimization and variational techniques, Computer Science - Machine Learning, Numerical mathematical programming methods, Optimization and Control (math.OC), stochastic gradient methods, interior-point methods, FOS: Mathematics, stochastic optimization, Mathematics - Optimization and Control, Machine Learning (cs.LG)
| selected citations These citations are derived from selected sources. This is an alternative to the "Influence" indicator, which also reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically). | 1 | |
| popularity This indicator reflects the "current" impact/attention (the "hype") of an article in the research community at large, based on the underlying citation network. | Average | |
| influence This indicator reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically). | Average | |
| impulse This indicator reflects the initial momentum of an article directly after its publication, based on the underlying citation network. | Average |
