
This paper presents a simple algorithm for the output range estimation problem in Deep Neural Networks (DNNs) by integrating a Simulated Annealing (SA) algorithm tailored to operate within constrained domains and ensure convergence towards global optima. The method effectively addresses the challenges posed by the lack of local geometric information and the high nonlinearity inherent to DNNs, making it applicable to a wide variety of architectures, with a special focus on Residual Networks (ResNets) due to their practical importance. Unlike existing methods, our algorithm imposes minimal assumptions on the internal architecture of neural networks, thereby extending its usability to complex models. Theoretical analysis guarantees convergence, while extensive empirical evaluations—including optimization tests involving functions with multiple local minima—demonstrate the robustness of our algorithm in navigating non-convex response surfaces. The experimental results highlight the algorithm’s efficiency in accurately estimating DNN output ranges, even in scenarios characterized by high non-linearity and complex constraints.
FOS: Computer and information sciences, Computer Science - Machine Learning, Statistics - Machine Learning, Probability (math.PR), FOS: Mathematics, Machine Learning (stat.ML), Mathematics - Probability, Machine Learning (cs.LG)
FOS: Computer and information sciences, Computer Science - Machine Learning, Statistics - Machine Learning, Probability (math.PR), FOS: Mathematics, Machine Learning (stat.ML), Mathematics - Probability, Machine Learning (cs.LG)
| selected citations These citations are derived from selected sources. This is an alternative to the "Influence" indicator, which also reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically). | 0 | |
| popularity This indicator reflects the "current" impact/attention (the "hype") of an article in the research community at large, based on the underlying citation network. | Average | |
| influence This indicator reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically). | Average | |
| impulse This indicator reflects the initial momentum of an article directly after its publication, based on the underlying citation network. | Average |
