Deep Incremental Boosting

Preprint English OPEN
Mosca, Alan; Magoulas, George D;
(2017)
  • Subject: Computer Science - Computer Vision and Pattern Recognition | Statistics - Machine Learning | Computer Science - Learning
    acm: ComputingMethodologies_PATTERNRECOGNITION

This paper introduces Deep Incremental Boosting, a new technique derived from AdaBoost, specifically adapted to work with Deep Learning methods, that reduces the required training time and improves generalisation. We draw inspiration from Transfer of Learning approaches... View more
  • References (12)
    12 references, page 1 of 2

    [1] Lei Jimmy Ba and Rich Caurana. Do deep nets really need to be deep? Advances in neural information processing systems, pages 2654-2662, 2014.

    [2] Yoshua Bengio. Deep learning of representations for unsupervised and transfer learning. Unsupervised and Transfer Learning Challenges in Machine Learning, 7:19, 2012.

    [3] Thomas G Dietterich. An experimental comparison of three methods for constructing ensembles of decision trees: Bagging, boosting, and randomization. Machine learning, 40(2):139-157, 2000.

    [4] Benjamin Graham. Fractional max-pooling. CoRR, abs/1412.6071, 2014.

    [5] Diederik Kingma and Jimmy Ba. Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980, 2014.

    [6] Alex Krizhevsky and Geoffrey Hinton. Learning multiple layers of features from tiny images, 2009.

    [8] Min Lin, Qiang Chen, and Shuicheng Yan. Network in network. arXiv preprint arXiv:1312.4400, 2013.

    [9] R. E. Schapire. The strength of weak learnability. Machine Learning, 5:197-227, 1990.

    [10] R. E. Schapire and Y Freund. Experiments with a new boosting algorithm. Machine Learning: proceedings of the Thirteenth International Conference, pages 148-156, 1996.

    [11] Jost Tobias Springenberg, Alexey Dosovitskiy, Thomas Brox, and Martin Riedmiller. Striving for simplicity: The all convolutional net. arXiv preprint arXiv:1412.6806, 2014.

  • Related Research Results (1)
  • Metrics
Share - Bookmark