
doi: 10.1137/0316012
Sequential Monte Carlo methods of the stochastic approximation (SA) type, with and without constraints, are discussed. The rates of convergence are derived, and the quantities upon which the rates depend, are discussed. Let $\{ {X_n } \}$ denote the SA sequence and define $U_n = (n + 1)^\beta X_n $ for a suitable $\beta > 0$. The $\{ {U_n } \}$ are interpolated into a natural continuous time process, and weak convergence theory is applied to develop the properties of the tails of the sequence. The technique has a number of advantages over past approaches—advantages which are discussed in the paper. It gives more insight (and is apparently more readily generalizable) than do other approaches—and suggests ways of improving the convergence. The particular “dynamical” nature of the approach allows one to say more about the “tail” process—and to do more “decision” (or “control”) analysis with it.
Sequential Monte Carlo Optimization Methods, Sequential estimation, Stochastic approximation, Stochastic Approximation, Stochastic programming, Rates of Convergence, Weak Convergence, Linear Diffusion, Diffusion processes
Sequential Monte Carlo Optimization Methods, Sequential estimation, Stochastic approximation, Stochastic Approximation, Stochastic programming, Rates of Convergence, Weak Convergence, Linear Diffusion, Diffusion processes
| selected citations These citations are derived from selected sources. This is an alternative to the "Influence" indicator, which also reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically). | 11 | |
| popularity This indicator reflects the "current" impact/attention (the "hype") of an article in the research community at large, based on the underlying citation network. | Average | |
| influence This indicator reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically). | Top 1% | |
| impulse This indicator reflects the initial momentum of an article directly after its publication, based on the underlying citation network. | Top 10% |
