
doi: 10.1002/wics.1618
AbstractThe expectation–maximization (EM) algorithm is a well‐known iterative algorithm for finding maximum likelihood estimates from incomplete data and is used in several statistical models with latent variables and missing data. The algorithm also exhibits a monotonic increase in a likelihood function and satisfies parameter constraints for its convergence. The popularity of the EM algorithm can be attributed to its stable convergence, simple implementation and flexibility in interpreting data incompleteness. Despite these computational advantages, the algorithm is linear convergent and suffers from very slow convergence when a statistical model has many parameters and a high proportion of missing data. Various algorithms have been proposed to accelerate the convergence of the EM algorithm. We introduce the acceleration of the EM algorithm using root‐finding and vector extrapolation algorithms. The root‐finding algorithms include Aitken's method and the Newton–Raphson, quasi‐Newton and conjugate gradient algorithms. These algorithms with faster convergence rates allow the EM algorithm to be sped up. The vector extrapolation algorithms transform the sequence of estimates from the EM algorithm into a fast convergent sequence and can accelerate the convergence without modifying the EM algorithm. We describe the derivation of these acceleration algorithms and attempt to apply them to two examples.This article is categorized under: Statistical and Graphical Methods of Data Analysis > EM Algorithm
Newton-Raphson algorithm, quasi-Newton algorithm, conjugate gradient algorithm, Computational methods for problems pertaining to statistics, EM algorithm, vector extrapolation, squared extrapolation algorithm, acceleration of convergence, vector \(\varepsilon\) algorithm
Newton-Raphson algorithm, quasi-Newton algorithm, conjugate gradient algorithm, Computational methods for problems pertaining to statistics, EM algorithm, vector extrapolation, squared extrapolation algorithm, acceleration of convergence, vector \(\varepsilon\) algorithm
| selected citations These citations are derived from selected sources. This is an alternative to the "Influence" indicator, which also reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically). | 6 | |
| popularity This indicator reflects the "current" impact/attention (the "hype") of an article in the research community at large, based on the underlying citation network. | Top 10% | |
| influence This indicator reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically). | Average | |
| impulse This indicator reflects the initial momentum of an article directly after its publication, based on the underlying citation network. | Top 10% |
