
arXiv: 2304.12127
handle: 11565/4068057
Noiseless compressive sensing is a protocol that enables undersampling and later recovery of a signal without loss of information. This compression is possible because the signal is usually sufficiently sparse in a given basis. Currently, the algorithm offering the best tradeoff between compression rate, robustness, and speed for compressive sensing is the LASSO (l1-norm bias) algorithm. However, many studies have pointed out the possibility that the implementation of lp-norms biases, with p smaller than one, could give better performance while sacrificing convexity. In this work, we focus specifically on the extreme case of the l0-based reconstruction, a task that is complicated by the discontinuity of the loss. In the first part of the paper, we describe via statistical physics methods, and in particular the replica method, how the solutions to this optimization problem are arranged in a clustered structure. We observe two distinct regimes: one at low compression rate where the signal can be recovered exactly, and one at high compression rate where the signal cannot be recovered accurately. In the second part, we present two message-passing algorithms based on our first results for the l0-norm optimization problem. The proposed algorithms are able to recover the signal at compression rates higher than the ones achieved by LASSO while being computationally efficient.
FOS: Computer and information sciences, SURVEYS; PROTOCOLS; HEURISTIC ALGORITHMS; CLUSTERING ALGORITHMS; SWITCHES; APPROXIMATION ALGORITHMS; INFERENCE ALGORITHMS; COMPRESSIVE SENSING; OPTIMIZATION; STATISTICAL PHYSICS; MESSAGE PASSING ALGORITHM, Statistical Mechanics (cond-mat.stat-mech), Computer Science - Information Theory, Information Theory (cs.IT), FOS: Physical sciences, Disordered Systems and Neural Networks (cond-mat.dis-nn), Condensed Matter - Disordered Systems and Neural Networks, Condensed Matter - Statistical Mechanics
FOS: Computer and information sciences, SURVEYS; PROTOCOLS; HEURISTIC ALGORITHMS; CLUSTERING ALGORITHMS; SWITCHES; APPROXIMATION ALGORITHMS; INFERENCE ALGORITHMS; COMPRESSIVE SENSING; OPTIMIZATION; STATISTICAL PHYSICS; MESSAGE PASSING ALGORITHM, Statistical Mechanics (cond-mat.stat-mech), Computer Science - Information Theory, Information Theory (cs.IT), FOS: Physical sciences, Disordered Systems and Neural Networks (cond-mat.dis-nn), Condensed Matter - Disordered Systems and Neural Networks, Condensed Matter - Statistical Mechanics
| selected citations These citations are derived from selected sources. This is an alternative to the "Influence" indicator, which also reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically). | 1 | |
| popularity This indicator reflects the "current" impact/attention (the "hype") of an article in the research community at large, based on the underlying citation network. | Average | |
| influence This indicator reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically). | Average | |
| impulse This indicator reflects the initial momentum of an article directly after its publication, based on the underlying citation network. | Average |
