
doi: 10.1137/0317043
We consider the general form of the stochastic approximation algorithm$X_{n + 1} = X_n + a_n h(X_n ,\xi _n )$, where h is not necessarily additive in $\xi _n $. Such algorithms occur frequently in applications to adaptive control and identification problems, where $\{ \xi _n \} $ is usually obtained from measurements of the input and output, and is almost always complicated enough that the more classical assumptions on the noise fail to hold. Let $a_n = {A / {(n + 1)^\alpha }}$, $0 < \alpha \leqq 1$, and let $X_n \to \theta $ w.p. 1. Define $U_n = (n + 1)^{{\alpha / 2}} (X_n - \theta )$. Then, loosely speaking, it is shown that the sequence of suitable continuous parameter interpolations of the sequence of “tails” of $\{ U _n \} $ converges weakly to a Gaussian diffusion. From this we can get the asymptotic variance of $U _n $ as well as other information. The assumptions on $\{ \xi _n \} $ and $h( \cdot , \cdot )$ are quite reasonable from the point of view of applications.
stochastic approximation algorithm, Computational methods in stochastic control, Identification in stochastic control theory, Adaptive control/observation systems, Stochastic approximation, identification problems, Gaussian diffusion, adaptive control
stochastic approximation algorithm, Computational methods in stochastic control, Identification in stochastic control theory, Adaptive control/observation systems, Stochastic approximation, identification problems, Gaussian diffusion, adaptive control
| selected citations These citations are derived from selected sources. This is an alternative to the "Influence" indicator, which also reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically). | 52 | |
| popularity This indicator reflects the "current" impact/attention (the "hype") of an article in the research community at large, based on the underlying citation network. | Top 10% | |
| influence This indicator reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically). | Top 1% | |
| impulse This indicator reflects the initial momentum of an article directly after its publication, based on the underlying citation network. | Top 10% |
