Powered by OpenAIRE graph
Found an issue? Give us feedback
image/svg+xml Jakob Voss, based on art designer at PLoS, modified by Wikipedia users Nina and Beao Closed Access logo, derived from PLoS Open Access logo. This version with transparent background. http://commons.wikimedia.org/wiki/File:Closed_Access_logo_transparent.svg Jakob Voss, based on art designer at PLoS, modified by Wikipedia users Nina and Beao zbMATH Openarrow_drop_down
image/svg+xml Jakob Voss, based on art designer at PLoS, modified by Wikipedia users Nina and Beao Closed Access logo, derived from PLoS Open Access logo. This version with transparent background. http://commons.wikimedia.org/wiki/File:Closed_Access_logo_transparent.svg Jakob Voss, based on art designer at PLoS, modified by Wikipedia users Nina and Beao
zbMATH Open
Article
Data sources: zbMATH Open
SIAM Journal on Control and Optimization
Article . 1979 . Peer-reviewed
Data sources: Crossref
versions View all 2 versions
addClaim

Rates of Convergence for Stochastic Approximation Type Algorithms

Rates of convergence for stochastic approximation type algorithms
Authors: Kushner, Harold J.; Huang, Hai;

Rates of Convergence for Stochastic Approximation Type Algorithms

Abstract

We consider the general form of the stochastic approximation algorithm$X_{n + 1} = X_n + a_n h(X_n ,\xi _n )$, where h is not necessarily additive in $\xi _n $. Such algorithms occur frequently in applications to adaptive control and identification problems, where $\{ \xi _n \} $ is usually obtained from measurements of the input and output, and is almost always complicated enough that the more classical assumptions on the noise fail to hold. Let $a_n = {A / {(n + 1)^\alpha }}$, $0 < \alpha \leqq 1$, and let $X_n \to \theta $ w.p. 1. Define $U_n = (n + 1)^{{\alpha / 2}} (X_n - \theta )$. Then, loosely speaking, it is shown that the sequence of suitable continuous parameter interpolations of the sequence of “tails” of $\{ U _n \} $ converges weakly to a Gaussian diffusion. From this we can get the asymptotic variance of $U _n $ as well as other information. The assumptions on $\{ \xi _n \} $ and $h( \cdot , \cdot )$ are quite reasonable from the point of view of applications.

Keywords

stochastic approximation algorithm, Computational methods in stochastic control, Identification in stochastic control theory, Adaptive control/observation systems, Stochastic approximation, identification problems, Gaussian diffusion, adaptive control

  • BIP!
    Impact byBIP!
    selected citations
    These citations are derived from selected sources.
    This is an alternative to the "Influence" indicator, which also reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically).
    52
    popularity
    This indicator reflects the "current" impact/attention (the "hype") of an article in the research community at large, based on the underlying citation network.
    Top 10%
    influence
    This indicator reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically).
    Top 1%
    impulse
    This indicator reflects the initial momentum of an article directly after its publication, based on the underlying citation network.
    Top 10%
Powered by OpenAIRE graph
Found an issue? Give us feedback
selected citations
These citations are derived from selected sources.
This is an alternative to the "Influence" indicator, which also reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically).
BIP!Citations provided by BIP!
popularity
This indicator reflects the "current" impact/attention (the "hype") of an article in the research community at large, based on the underlying citation network.
BIP!Popularity provided by BIP!
influence
This indicator reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically).
BIP!Influence provided by BIP!
impulse
This indicator reflects the initial momentum of an article directly after its publication, based on the underlying citation network.
BIP!Impulse provided by BIP!
52
Top 10%
Top 1%
Top 10%
Upload OA version
Are you the author of this publication? Upload your Open Access version to Zenodo!
It’s fast and easy, just two clicks!