Communication Theoretic Data Analytics

Preprint English OPEN
Chen, Kwang-Cheng ; Huang, Shao-Lun ; Zheng, Lizhong ; Poor, H. Vincent (2015)

Widespread use of the Internet and social networks invokes the generation of big data, which is proving to be useful in a number of applications. To deal with explosively growing amounts of data, data analytics has emerged as a critical technology related to computing, signal processing, and information networking. In this paper, a formalism is considered in which data is modeled as a generalized social network and communication theory and information theory are thereby extended to data analytics. First, the creation of an equalizer to optimize information transfer between two data variables is considered, and financial data is used to demonstrate the advantages. Then, an information coupling approach based on information geometry is applied for dimensionality reduction, with a pattern recognition example to illustrate the effectiveness. These initial trials suggest the potential of communication theoretic data analytics for a wide range of applications.
  • References (48)
    48 references, page 1 of 5

    [1] X.Wu, X. Zhu, G.Q. Wu, W. Ding, “Data Mining with Big Data,” IEEE Trans. On Knowledge and Data Engineering, vol. 26, no. 1, pp. 97-107, Jan. 2014.

    [2] M.J. Wainwright, M.I. Jordan, “Graphical Models, Exponential Families, and Variational Inference,” Foundations and Trends in Machine Learning, vol. 1, no. 1-2, pp. 1-305, January 2008.

    [3] J. Han, M. Kamber, Data Mining: Concepts and Techniques, 2nd edition, 2006.

    [4] U. Fayyad, G. Piatetsky-Shapiro, R. Smyth, “From Data Mining to Knowledge Discovery in Databases,” AI Magazine, vol. 17, no. 3, pp. 37-54, 1996.

    [5] F. V. Jensen and T. D. Nielsen, Bayesian Networks and Decision Graphs, 2nd ed., Springer, 2007.

    [6] D. Koller and N. Friedman, Probabilistic Graphical Models: Principles and Techniques., The MIT Press, 2009.

    [7] T. Hastie, R. Tibshirani, J. Friedman, The Elements of Statistical Learning, 2nd edition, Springer, 2009.

    [8] R. Silva, R. Scheines, C. Glymour, P. Spirtes, “Learning the Structure of Linear Latent Variable Models,” J. of Machine Learning Research, vol. 7, pp. 191-246, 2006.

    [9] J.B. Tenenbaum, V. de Silva, J.C. Langford, “A Global Geometric Framework for Nonlinear Dimensionality Reduction,” Science, vol. 290, pp. 2319-2323, December 22, 2000.

    [10] S.T. Roweis, L.K. Saul, “Nonlinear Dimensionality Reduction by Locally Linear Embedding,” Science, vol. 290, pp. 2323-2326, December 22, 2000.

  • Metrics
    No metrics available
Share - Bookmark