Self-Supervised Dialogue Learning

Preprint English OPEN
Wu, Jiawei; Wang, Xin; Wang, William Yang;
(2019)
  • Subject: Computer Science - Computation and Language

The sequential order of utterances is often meaningful in coherent dialogues, and the order changes of utterances could lead to low-quality and incoherent conversations. We consider the order information as a crucial supervised signal for dialogue learning, which, howev... View more
  • References (45)
    45 references, page 1 of 5

    Dzmitry Bahdanau, Kyunghyun Cho, and Yoshua Bengio. 2015. Neural machine translation by jointly learning to align and translate. In Proceedings of the 3rd International Conference on Learning Representations (ICLR).

    Yoshua Bengio, Re´jean Ducharme, Pascal Vincent, and Christian Jauvin. 2003. A neural probabilistic language model. Journal of machine learning research, 3(Feb):1137-1155.

    Antoine Bordes, Y-Lan Boureau, and Jason Weston. 2017. Learning end-to-end goal-oriented dialog. In Proceedings of the 5th International Conference on Learning Representations (ICLR).

    Andrew M Dai and Quoc V Le. 2015. Semi-supervised sequence learning. In Proceedings of the 29th Conference on neural information processing systems (NeurIPS), pages 3079-3087.

    Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2019. Bert: Pre-training of deep bidirectional transformers for language understanding. In Proceedings of the 2019 Annual Conference Carl Doersch, Abhinav Gupta, and Alexei A Efros. 2015. Unsupervised visual representation learning by context prediction. In Proceedings of the IEEE International Conference on Computer Vision (ICCV), pages 1422-1430.

    Jianfeng Gao, Michel Galley, and Lihong Li. 2018. Neural approaches to conversational ai. In Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (ACL), pages 2-7.

    Ian Goodfellow, Jean Pouget-Abadie, Mehdi Mirza, Bing Xu, David Warde-Farley, Sherjil Ozair, Aaron Courville, and Yoshua Bengio. 2014. Generative adversarial nets. In Proceedings of the 28th Conference on Neural Information Processing Systems (NeurIPS), pages 2672-2680.

    Sepp Hochreiter and Ju¨rgen Schmidhuber. 1997. Long short-term memory. Neural computation, 9(8):1735-1780.

    Dan Jurafsky and James H Martin. 2014. Speech and language processing. Pearson Education UK.

    Alex M Lamb, Anirudh Goyal Alias Parth Goyal, Ying Zhang, Saizheng Zhang, Aaron C Courville, and Yoshua Bengio. 2016. Professor forcing: A new algorithm for training recurrent networks. In Proceedings of the 30th conference on Neural Information Processing Systems (NeurIPS), pages 4601-4609.

  • Related Research Results (1)
    Inferred by OpenAIRE
    software
    TC-Bot software on GitHub
    72%
  • Related Organizations (3)
  • Metrics
Share - Bookmark