
arXiv: 1911.11049
Abstract Principal components analysis (PCA) is a fundamental algorithm in data analysis. Its memory-restricted online versions are useful in many modern applications, where the data are too large to fit in memory, or when data arrive as a stream of items. In this paper, we propose ROIPCA and fROIPCA, two online PCA algorithms that are based on rank-one updates. While ROIPCA is typically more accurate, fROIPCA is faster and has comparable accuracy. We show the relation between fROIPCA and an existing popular gradient algorithm for online PCA, and in particular, prove that fROIPCA is in fact a gradient algorithm with an optimal learning rate. We demonstrate numerically the advantages of our algorithms over existing state-of-the-art algorithms in terms of accuracy and runtime.
FOS: Computer and information sciences, Artificial intelligence, PCA, Computer Science - Machine Learning, Machine Learning (stat.ML), Machine Learning (cs.LG), streaming PCA, Statistics - Machine Learning, online PCA, rank-one update, Theory of data, memory-restricted PCA, gradient descent
FOS: Computer and information sciences, Artificial intelligence, PCA, Computer Science - Machine Learning, Machine Learning (stat.ML), Machine Learning (cs.LG), streaming PCA, Statistics - Machine Learning, online PCA, rank-one update, Theory of data, memory-restricted PCA, gradient descent
| selected citations These citations are derived from selected sources. This is an alternative to the "Influence" indicator, which also reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically). | 0 | |
| popularity This indicator reflects the "current" impact/attention (the "hype") of an article in the research community at large, based on the underlying citation network. | Average | |
| influence This indicator reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically). | Average | |
| impulse This indicator reflects the initial momentum of an article directly after its publication, based on the underlying citation network. | Average |
