
arXiv: 2112.01966
We live in the information age. Claude Shannon, as the father of the information age, gave us a theory of communications that quantified an “amount of information,” but, as he pointed out, “no concept of information itself was defined.” Logical entropy provides that definition. Logical entropy is the natural measure of the notion of information based on distinctions, differences, distinguishability, and diversity. It is the (normalized) quantitative measure of the distinctions of a partition on a set-just as the Boole–Laplace logical probability is the normalized quantitative measure of the elements of a subset of a set. And partitions and subsets are mathematically dual concepts – so the logic of partitions is dual in that sense to the usual Boolean logic of subsets, and hence the name “logical entropy.” The logical entropy of a partition has a simple interpretation as the probability that a distinction or dit (elements in different blocks) is obtained in two independent draws from the underlying set. The Shannon entropy is shown toalsobe based on this notion of information-as-distinctions; it is the average minimum number of binary partitions (bits) that need to be joined to make all thesamedistinctions of the given partition. Hence all the concepts of simple, joint, conditional, and mutual logical entropy can be transformed into the corresponding concepts of Shannon entropy by a uniform non-linear dit-bit transform. And finally logical entropy linearizes naturally to the corresponding quantum concept. The quantum logical entropy of an observable applied to a state is the probability that two different eigenvalues are obtained in two independent projective measurements of that observable on that state.
FOS: Computer and information sciences, Quantum Physics, Science, Computer Science - Information Theory, Information Theory (cs.IT), Q, R, maxentropy, FOS: Physical sciences, shannon entropy, partitions, Medicine, von neumann entropy, logical entropy, Quantum Physics (quant-ph), quantum logical entropy, 81P45, 94A17
FOS: Computer and information sciences, Quantum Physics, Science, Computer Science - Information Theory, Information Theory (cs.IT), Q, R, maxentropy, FOS: Physical sciences, shannon entropy, partitions, Medicine, von neumann entropy, logical entropy, Quantum Physics (quant-ph), quantum logical entropy, 81P45, 94A17
| selected citations These citations are derived from selected sources. This is an alternative to the "Influence" indicator, which also reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically). | 15 | |
| popularity This indicator reflects the "current" impact/attention (the "hype") of an article in the research community at large, based on the underlying citation network. | Top 10% | |
| influence This indicator reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically). | Top 10% | |
| impulse This indicator reflects the initial momentum of an article directly after its publication, based on the underlying citation network. | Top 10% |
