DeepSpark: A Spark-Based Distributed Deep Learning Framework for Commodity Clusters

Preprint English OPEN
Kim, Hanjoo; Park, Jaehong; Jang, Jaehee; Yoon, Sungroh;
  • Subject: Computer Science - Learning

The increasing complexity of deep neural networks (DNNs) has made it challenging to exploit existing large-scale data processing pipelines for handling massive data and parameters involved in DNN training. Distributed computing platforms and GPGPU-based acceleration pro... View more
  • References (36)
    36 references, page 1 of 4

    [1] K. He, et al. Deep residual learning for image recognition. arXiv preprint arXiv:1512.03385, 2015.

    [2] J. K. Chorowski, et al. Attention-based models for speech recognition. In NIPS, pages 577{585, 2015.

    [3] K. Simonyan et al. Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556, 2014.

    [4] C. Szegedy, et al. Going deeper with convolutions. In CVPR, pages 1{9, 2015.

    [5] A. Krizhevsky, et al. Imagenet classi cation with deep convolutional neural networks. In NIPS, pages 1097{ 1105, 2012.

    [6] S. Chetlur, et al. cudnn: E cient primitives for deep learning. arXiv preprint arXiv:1410.0759, 2014.

    [7] A. Krizhevsky. One weird trick for parallelizing convolutional neural networks. arXiv preprint arXiv:1404.5997, 2014.

    [8] M. Li, et al. Scaling distributed machine learning with the parameter server. In OSDI, pages 583{598, 2014.

    [9] J. Dean, et al. Large scale distributed deep networks. In NIPS, pages 1223{1231, 2012.

    [10] Q. Ho, et al. More e ective distributed ml via a stale synchronous parallel parameter server. In NIPS, pages 1223{1231, 2013.

  • Related Research Results (2)
  • Metrics
Share - Bookmark