
doi: 10.1137/140992588
Summary: We consider a gossip-based distributed stochastic approximation scheme wherein processors situated at the nodes of a connected graph perform stochastic approximation algorithms, modified further by an additive interaction term equal to a weighted average of iterates at neighboring nodes along the lines of ``gossip'' algorithms. We allow these averaging weights to be modulated by the iterates themselves. The main result is a Benaim-type meta-theorem characterizing the possible asymptotic behavior in terms of a limiting o.d.e. In particular, this ensures ``consensus,'' which we further strengthen to a form of ``dynamic consensus'' which implies that they asymptotically track a single common trajectory belonging to an internally chain transitive invariant set of a common o.d.e. that we characterize. We also consider a situation where this averaging is replaced by a fully nonlinear operation and extend the results to this case, which in particular allows us to handle certain projection schemes.
distributed algorithms, Consensus, Benaim Theorem, Stochastic Approximation, Two Time Scales, Theorems, two time scales, Systems, Learning and adaptive systems in artificial intelligence, gossip algorithms, Stochastic-Approximation, Gossip Algorithms, Distributed Algorithms, Approximation algorithms, stochastic approximation, Distributed algorithms, Delays, Benaim theorem, Convergence, Algorithms
distributed algorithms, Consensus, Benaim Theorem, Stochastic Approximation, Two Time Scales, Theorems, two time scales, Systems, Learning and adaptive systems in artificial intelligence, gossip algorithms, Stochastic-Approximation, Gossip Algorithms, Distributed Algorithms, Approximation algorithms, stochastic approximation, Distributed algorithms, Delays, Benaim theorem, Convergence, Algorithms
| selected citations These citations are derived from selected sources. This is an alternative to the "Influence" indicator, which also reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically). | 13 | |
| popularity This indicator reflects the "current" impact/attention (the "hype") of an article in the research community at large, based on the underlying citation network. | Top 10% | |
| influence This indicator reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically). | Top 10% | |
| impulse This indicator reflects the initial momentum of an article directly after its publication, based on the underlying citation network. | Top 10% |
