
arXiv: 1504.07699
We present a preconditioning of a generalized forward-backward splitting algorithm for finding a zero of a sum of maximally monotone operators $\sum_{i=1}^{n} A_i + B$ with $B$ cocoercive, involving only the computation of $B$ and of the resolvent of each $A_i$ separately. This allows in particular to minimize functionals of the form $\sum_{i=1}^n g_i + f$ with $f$ smooth, using only the computation of the gradient of $f$ and of the proximity operator of each $g_i$ separately. By adapting the underlying metric, such preconditioning can serve two practical purposes: first, it might accelerate the convergence, or second, it might simplify the computation of the resolvent of $A_i$ for some $i$. In addition, in many cases of interest, our preconditioning strategy allows the economy of storage and computation concerning some auxiliary variables. In particular, we show how this approach can handle large-scale, nonsmooth, convex optimization problems structured on graphs, which arises in many image processing or learning applications, and that it compares favorably to alternatives in the literature.
35 pages, 5 figures
Convex programming, aggregating spatial statistics, graph learning, proximal splitting, forward-backward splitting, graph sparsity, geoinformatics, quasi-Newton methods, preconditioning, FOS: Mathematics, monotone operator splitting, Mathematics - Optimization and Control, [MATH.MATH-OC] Mathematics [math]/Optimization and Control [math.OC], [MATH.MATH-NA] Mathematics [math]/Numerical Analysis [math.NA], 47N10, 90C25, 94A08, 62H11, 91D20, Mathematical geography and demography, total variation, Optimization and Control (math.OC), Mumford-Shah functional, Applications of operator theory in optimization, convex analysis, mathematical programming, economics, Image processing (compression, reconstruction, etc.) in information and communication theory, nonsmooth convex optimization, Directional data; spatial statistics
Convex programming, aggregating spatial statistics, graph learning, proximal splitting, forward-backward splitting, graph sparsity, geoinformatics, quasi-Newton methods, preconditioning, FOS: Mathematics, monotone operator splitting, Mathematics - Optimization and Control, [MATH.MATH-OC] Mathematics [math]/Optimization and Control [math.OC], [MATH.MATH-NA] Mathematics [math]/Numerical Analysis [math.NA], 47N10, 90C25, 94A08, 62H11, 91D20, Mathematical geography and demography, total variation, Optimization and Control (math.OC), Mumford-Shah functional, Applications of operator theory in optimization, convex analysis, mathematical programming, economics, Image processing (compression, reconstruction, etc.) in information and communication theory, nonsmooth convex optimization, Directional data; spatial statistics
| selected citations These citations are derived from selected sources. This is an alternative to the "Influence" indicator, which also reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically). | 24 | |
| popularity This indicator reflects the "current" impact/attention (the "hype") of an article in the research community at large, based on the underlying citation network. | Top 10% | |
| influence This indicator reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically). | Top 10% | |
| impulse This indicator reflects the initial momentum of an article directly after its publication, based on the underlying citation network. | Top 10% |
