
arXiv: 2311.07847
Abstract In this paper, we propose the approximate Bregman proximal gradient algorithm (ABPG) for solving composite nonconvex optimization problems. ABPG employs a new distance that approximates the Bregman distance, making the subproblem of ABPG simpler to solve compared to existing Bregman-type algorithms. The subproblem of ABPG is often expressed in a closed form. Similarly to existing Bregman-type algorithms, ABPG does not require the global Lipschitz continuity for the gradient of the smooth part. Instead, assuming the smooth adaptable property, we establish the global subsequential convergence under standard assumptions. Additionally, assuming that the Kurdyka–Łojasiewicz property holds, we prove the global convergence for a special case. Our numerical experiments on the $$\ell _p$$ ℓ p regularized least squares problem, the $$\ell _p$$ ℓ p loss problem, and the nonnegative linear system show that ABPG outperforms existing algorithms especially when the gradient of the smooth part is not globally Lipschitz or even locally Lipschitz continuous.
nonnegative linear system, Kullback-Leibler divergence, \(\ell_p\) loss problem, Kurdyka-Łojasiewicz property, composite nonconvex nonsmooth optimization, Nonconvex programming, global optimization, \(\ell_p\) regularized least squares problem, Bregman proximal gradient algorithms, 90C26, 49M37, 65K05, Numerical mathematical programming methods, Optimization and Control (math.OC), FOS: Mathematics, Mathematics - Optimization and Control
nonnegative linear system, Kullback-Leibler divergence, \(\ell_p\) loss problem, Kurdyka-Łojasiewicz property, composite nonconvex nonsmooth optimization, Nonconvex programming, global optimization, \(\ell_p\) regularized least squares problem, Bregman proximal gradient algorithms, 90C26, 49M37, 65K05, Numerical mathematical programming methods, Optimization and Control (math.OC), FOS: Mathematics, Mathematics - Optimization and Control
| selected citations These citations are derived from selected sources. This is an alternative to the "Influence" indicator, which also reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically). | 2 | |
| popularity This indicator reflects the "current" impact/attention (the "hype") of an article in the research community at large, based on the underlying citation network. | Top 10% | |
| influence This indicator reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically). | Average | |
| impulse This indicator reflects the initial momentum of an article directly after its publication, based on the underlying citation network. | Average |
