
arXiv: 1908.06315
Implicit deep learning prediction rules generalize the recursive rules of feedforward neural networks. Such rules are based on the solution of a fixed-point equation involving a single vector of hidden features, which is thus only implicitly defined. The implicit framework greatly simplifies the notation of deep learning, and opens up many new possibilities, in terms of novel architectures and algorithms, robustness analysis and design, interpretability, sparsity, and network architecture optimization.
FOS: Computer and information sciences, Numerical optimization and variational techniques, Computer Science - Machine Learning, deep learning, Machine Learning (stat.ML), robustness, deep equilibrium models, Perron-Frobenius theory, Machine Learning (cs.LG), Neural nets and related approaches to inference from stochastic processes, fixed-point equations, Implicit function theorems, Jacobians, transformations with several variables, adversarial attacks, Statistics - Machine Learning, Optimization and Control (math.OC), FOS: Mathematics, Mathematics - Optimization and Control
FOS: Computer and information sciences, Numerical optimization and variational techniques, Computer Science - Machine Learning, deep learning, Machine Learning (stat.ML), robustness, deep equilibrium models, Perron-Frobenius theory, Machine Learning (cs.LG), Neural nets and related approaches to inference from stochastic processes, fixed-point equations, Implicit function theorems, Jacobians, transformations with several variables, adversarial attacks, Statistics - Machine Learning, Optimization and Control (math.OC), FOS: Mathematics, Mathematics - Optimization and Control
| selected citations These citations are derived from selected sources. This is an alternative to the "Influence" indicator, which also reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically). | 38 | |
| popularity This indicator reflects the "current" impact/attention (the "hype") of an article in the research community at large, based on the underlying citation network. | Top 10% | |
| influence This indicator reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically). | Top 10% | |
| impulse This indicator reflects the initial momentum of an article directly after its publication, based on the underlying citation network. | Top 1% |
