
While often used in embedded systems, neural networks can be costly in terms of memory and execution time. Reducing the precision used in neural networks can be beneficial in terms of performance and energy consumption. After having applied a floating-point auto-tuning tool, PROMISE, on various neural networks, we obtained versions using lower precision while keeping a required accuracy on the results. In this article, we present results regarding the memory and computation time gains obtained thanks to reduced precision, using vectorized and non-vectorized code. We also show the impact on the execution time of PROMISE of the parallelization of the Delta Debug algorithm it implements.
Neural Networks, [INFO.INFO-PF] Computer Science [cs]/Performance [cs.PF], [INFO.INFO-NA] Computer Science [cs]/Numerical Analysis [cs.NA], [INFO.INFO-NE] Computer Science [cs]/Neural and Evolutionary Computing [cs.NE], Stochastic Arithmetic, [INFO.INFO-AO] Computer Science [cs]/Computer Arithmetic, Auto-Tuning, Precision, Floating-Point
Neural Networks, [INFO.INFO-PF] Computer Science [cs]/Performance [cs.PF], [INFO.INFO-NA] Computer Science [cs]/Numerical Analysis [cs.NA], [INFO.INFO-NE] Computer Science [cs]/Neural and Evolutionary Computing [cs.NE], Stochastic Arithmetic, [INFO.INFO-AO] Computer Science [cs]/Computer Arithmetic, Auto-Tuning, Precision, Floating-Point
| selected citations These citations are derived from selected sources. This is an alternative to the "Influence" indicator, which also reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically). | 0 | |
| popularity This indicator reflects the "current" impact/attention (the "hype") of an article in the research community at large, based on the underlying citation network. | Average | |
| influence This indicator reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically). | Average | |
| impulse This indicator reflects the initial momentum of an article directly after its publication, based on the underlying citation network. | Average |
