Constructing Long Short-Term Memory based Deep Recurrent Neural Networks for Large Vocabulary Speech Recognition

Preprint English OPEN
Li, Xiangang; Wu, Xihong;
(2014)
  • Subject: Computer Science - Computation and Language | Computer Science - Neural and Evolutionary Computing

Long short-term memory (LSTM) based acoustic modeling methods have recently been shown to give state-of-the-art performance on some speech recognition tasks. To achieve a further performance improvement, in this research, deep extensions on LSTM are investigated conside... View more
  • References (25)
    25 references, page 1 of 3

    [12] Y. Fan, Y. Qian, F. Xie, and F.K. Soong, “Tts synthesis with bidirectional lstm based recurrent neural networks,” in Interspeech, 2014, pp. 1964-1948.

    [13] J. Gonzalez-Dominguez, I. Lopez-Moreno, H. Sak, and et al., “Automatic language identification using long short-term memory recurrent neural networks,” in Interspeech, 2014, pp. 2155-2159.

    [14] J. Geiger, X. Zhang, F. Weninger, and et al., “Robust speech recognition using long short-term memory recurrent neural networks for hybrid acoustic modelling,” in Interspeech, 2014, pp. 631-635.

    [15] A. Graves, N. Jaitly, and A. Mohamed, “Hybrid speech recognition with deep bidirectional lstm,” in ASRU, 2013, pp. 273- 278.

    [16] H. Sak, A. Senior, and F. Beaufays, “Long short-term memory recurrent neural network architectures for large scale acoustic modeling,” in Interspeech, 2014, pp. 338-342.

    [17] H. Sak, A. Senior, and F. Beaufays, “Long short-term memory based recurrent neural network architectures for large vocabulary speech recognition,” arXiv:1402.1128, 2014.

    [18] H. Sak, O. Vinyals, G. Heigold, and et al., “Sequence discriminative distributed training of long short-term memory recurrent neural networks,” in Interspeech, 2014, pp. 1209-1213.

    [19] R. Pascanu, C. Gulcehre, K. Cho, and Y. Bengio, “How to construct deep recurrent neural networks,” arXiv:1312.6026, 2013.

    [20] F. Gers, J. Schmidhuber, and F. Cummins, “Learning to forget: Continual prediction with lstm,” Neural Computation, vol. 12, pp. 2451-2471, 2000.

    [21] F. Gers, N. Schraudolph, and J. Schmidhuber, “Learning precise timing with lstm recurrent networks,” Journal of Machine Learning Research, vol. 3, pp. 115-143, 2003.

  • Metrics
Share - Bookmark