
arXiv: 2106.02519
AbstractWe propose a novel method for sampling and optimization tasks based on a stochastic interacting particle system. We explain how this method can be used for the following two goals: (i) generating approximate samples from a given target distribution and (ii) optimizing a given objective function. The approach is derivative‐free and affine invariant, and is therefore well‐suited for solving inverse problems defined by complex forward models: (i) allows generation of samples from the Bayesian posterior and (ii) allows determination of the maximum a posteriori estimator. We investigate the properties of the proposed family of methods in terms of various parameter choices, both analytically and by means of numerical simulations. The analysis and numerical simulation establish that the method has potential for general purpose optimization tasks over Euclidean space; contraction properties of the algorithm are established under suitable conditions, and computational experiments demonstrate wide basins of attraction for various specific problems. The analysis and experiments also demonstrate the potential for the sampling methodology in regimes in which the target distribution is unimodal and close to Gaussian; indeed we prove that the method recovers a Laplace approximation to the measure in certain parametric regimes and provide numerical evidence that this Laplace approximation attracts a large set of initial conditions in a number of examples.
Optimization, sampling, Stochastic particle methods, [MATH] Mathematics [math], Dynamical Systems (math.DS), Numerical Analysis (math.NA), 510, stochastic interacting particle systems, Stochastic interacting particle systems, Stochastic methods (Fokker-Planck, Langevin, etc.) applied to problems in time-dependent statistical mechanics, FOS: Mathematics, Interacting particle systems in time-dependent statistical mechanics, Mathematics - Numerical Analysis, 62F15, 65C35, 65N21, 35G25, Mathematics - Dynamical Systems, Sampling, Fokker-Planck equations, optimization
Optimization, sampling, Stochastic particle methods, [MATH] Mathematics [math], Dynamical Systems (math.DS), Numerical Analysis (math.NA), 510, stochastic interacting particle systems, Stochastic interacting particle systems, Stochastic methods (Fokker-Planck, Langevin, etc.) applied to problems in time-dependent statistical mechanics, FOS: Mathematics, Interacting particle systems in time-dependent statistical mechanics, Mathematics - Numerical Analysis, 62F15, 65C35, 65N21, 35G25, Mathematics - Dynamical Systems, Sampling, Fokker-Planck equations, optimization
| selected citations These citations are derived from selected sources. This is an alternative to the "Influence" indicator, which also reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically). | 27 | |
| popularity This indicator reflects the "current" impact/attention (the "hype") of an article in the research community at large, based on the underlying citation network. | Top 10% | |
| influence This indicator reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically). | Top 10% | |
| impulse This indicator reflects the initial momentum of an article directly after its publication, based on the underlying citation network. | Top 10% |
