
We show in this paper that a one-layer feedforward neural network with exponential activation functions in the inner layer and logarithmic activation in the output neuron is an universal approximator of convex functions. Such a network represents a family of scaled log-sum exponential functions, here named LSET. Under a suitable exponential transformation, the class of LSET functions maps to a family of generalized posynomials GPOST, which we similarly show to be universal approximators for log-log-convex functions. A key feature of an LSET network is that, once it is trained on data, the resulting model is convex in the variables, which makes it readily amenable to efficient design based on convex optimization. Similarly, once a GPOST model is trained on data, it yields a posynomial model that can be efficiently optimized with respect to its variables by using geometric programming (GP). The proposed methodology is illustrated by two numerical examples, in which, first, models are constructed from simulation data of the two physical processes (namely, the level of vibration in a vehicle suspension system, and the peak power generated by the combustion of propane), and then optimization-based design is performed on these models.
Function approximation, data-driven optimization, FOS: Computer and information sciences, Geometric programming (GP), geometric programming (GP), 510, Tropical polynomials, Neural and Evolutionary Computing (cs.NE), Feedforward neural networks, feedforward neural networks (FFNNs), function approximation, Computer Science - Neural and Evolutionary Computing, [MATH.MATH-OC] Mathematics [math]/Optimization and Control [math.OC], Settore ING-INF/04 - AUTOMATICA, Geometric programming, Surrogate model, Feedforward neural networks (FFNNs), Convex optimization, surrogate models, Convex optimization; Data-driven optimization; Feedforward neural networks (FFNNs); Function approximation; Geometric programming (GP); Surrogate models; Tropical polynomials, Data-driven optimization, Surrogate mod- els, [MATH.MATH-OC]Mathematics [math]/Optimization and Control [math.OC], Data models; Biological system modeling; Convex functions; Numerical models; Context modeling; Neural networks; Transforms; Convex optimization; data-driven optimization; feedforward neural networks (FFNNs); function approximation; geometric programming (GP); surrogate models; tropical polynomials, tropical polynomials, Settore IINF-04/A - Automatica
Function approximation, data-driven optimization, FOS: Computer and information sciences, Geometric programming (GP), geometric programming (GP), 510, Tropical polynomials, Neural and Evolutionary Computing (cs.NE), Feedforward neural networks, feedforward neural networks (FFNNs), function approximation, Computer Science - Neural and Evolutionary Computing, [MATH.MATH-OC] Mathematics [math]/Optimization and Control [math.OC], Settore ING-INF/04 - AUTOMATICA, Geometric programming, Surrogate model, Feedforward neural networks (FFNNs), Convex optimization, surrogate models, Convex optimization; Data-driven optimization; Feedforward neural networks (FFNNs); Function approximation; Geometric programming (GP); Surrogate models; Tropical polynomials, Data-driven optimization, Surrogate mod- els, [MATH.MATH-OC]Mathematics [math]/Optimization and Control [math.OC], Data models; Biological system modeling; Convex functions; Numerical models; Context modeling; Neural networks; Transforms; Convex optimization; data-driven optimization; feedforward neural networks (FFNNs); function approximation; geometric programming (GP); surrogate models; tropical polynomials, tropical polynomials, Settore IINF-04/A - Automatica
| selected citations These citations are derived from selected sources. This is an alternative to the "Influence" indicator, which also reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically). | 26 | |
| popularity This indicator reflects the "current" impact/attention (the "hype") of an article in the research community at large, based on the underlying citation network. | Top 10% | |
| influence This indicator reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically). | Top 10% | |
| impulse This indicator reflects the initial momentum of an article directly after its publication, based on the underlying citation network. | Top 10% |
