Modeling documents with Generative Adversarial Networks

Preprint English OPEN
Glover, John;
(2016)
  • Subject: Computer Science - Learning

This paper describes a method for using Generative Adversarial Networks to learn distributed representations of natural language documents. We propose a model that is based on the recently proposed Energy-Based GAN, but instead uses a Denoising Autoencoder as the discri... View more
  • References (22)
    22 references, page 1 of 3

    [1] D. P. Kingma and M. Welling, “Auto-encoding variational bayes,” Proceedings of the International Conference on Learning Representations, 2014.

    [2] D. J. Rezende, S. Mohamed, and D. Wierstra, “Stochastic backpropagation and approximate inference in deep generative models,” Proceedings of The 31st International Conference on Machine Learning, pp. 1278-1286, 2014.

    [3] I. J. Goodfellow, J. Pouget-Abadie, M. Mirza, B. Xu, D. Warde-Farley, S. Ozair, A. Courville, and Y. Bengio, “Generative adversarial networks,” Advances in Neural Information Processing Systems, pp. 2672-2680, 2014.

    [4] A. Radford, L. Metz, and S. Chintala, “Unsupervised representation learning with deep convolutional generative adversarial networks,” Proceedings of the International Conference on Learning Representations, 2016.

    [5] K. Gregor, I. Danihelka, A. Graves, D. J. Rezende, and D. Wierstra, “Draw: A recurrent neural network for image generation,” Proceedings of The 32nd International Conference on Machine Learning, 2015.

    [6] S. R. Bowman, L. Vilnis, O. Vinyals, A. M. Dai, R. Jozefowicz, and S. Bengio, “Generating sentences from a continuous space,” Proceedings of the International Conference on Learning Representations, 2016.

    [7] Y. Miao, L. Yu, and P. Blunsom, “Neural variational inference for text processing,” Proceedings of the International Conference on Learning Representations, 2016.

    [8] D. M. Blei, A. Y. Ng, and M. I. Jordan, “Latent dirichlet allocation,” Journal of Machine Learning Research, vol. 3, no. 4-5, pp. 993-1022, 2012.

    [9] G. E. Hinton, “Training products of experts by minimizing contrastive divergence,” Neural computation, vol. 14, no. 8, pp. 1771-1800, 2002.

    [10] R. Salakhutdinov and G. Hinton, “Replicated softmax: An undirected topic model,” Advances in Neural Information Processing Systems, pp. 1607-1614, 2009.

  • Metrics
Share - Bookmark