FreezeOut: Accelerate Training by Progressively Freezing Layers
Brock, Andrew; Lim, Theodore; Ritchie, J. M.; Weston, Nick;
- Subject: Statistics - Machine Learning | Computer Science - Learning
The early layers of a deep neural net have the fewest parameters, but take up the most computation. In this extended abstract, we propose to only train the hidden layers for a set portion of the training run, freezing them out one-by-one and excluding them from the back... View more
- References (13)
- Related Research Results (3) Inferred by OpenAIRE
- Related Organizations (3)
Heriot-Watt University 90%Renishaw Plc ( RENISHAW ) United KingdomWebsite url: http://www.renishaw.com90%Heriot-Watt University - International Centre for Mathematical Sciences ( ICMS ) United KingdomWebsite url: http://www.icms.org.uk/90% - Metrics
Share - Bookmark
- Download from
- Funded by