Powered by OpenAIRE graph
Found an issue? Give us feedback
addClaim

Capacity achieving input distribution to the generalized inverse Gaussian neuron model

Authors: Mustafa Sungkar; Toby Berger; William B. Levy;

Capacity achieving input distribution to the generalized inverse Gaussian neuron model

Abstract

The buildup of a cortical neuron's excitation, called the postsynaptic potential (PSP), is well modeled by the generalized inverse Gaussian (First) Hitting Time (GIGHT) diffusion. Such a model is called the generalized inverse Gaussian (GIG) neuron model. It is also believed that a neuron's purpose is to send information about the state of its input to the neuron's targets. We use Shannon's mutual information as a measure of this neural information in the GIG neuron model. The remarkable energy efficiency of neurons suggests that the neuron maximizes the transmitted mutual information subject to an energy constraint. Thus, we are interested in the information capacity of the GIG neuron model as a function of energy expended. This paper improves our work with Jie Xing [1], wherein the upper bound of the capacity-cost curve for the GIG neuron model was obtained. Here, we numerically computed the capacity-cost curve for such a model and found that for certain parameters, the upper bound and actual curve almost coincide. More interestingly, we found that the maximizing input distribution is discrete for certain parameters. This has implications on how the neural network should operate in order to optimally transmit information.

Related Organizations
  • BIP!
    Impact byBIP!
    selected citations
    These citations are derived from selected sources.
    This is an alternative to the "Influence" indicator, which also reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically).
    8
    popularity
    This indicator reflects the "current" impact/attention (the "hype") of an article in the research community at large, based on the underlying citation network.
    Top 10%
    influence
    This indicator reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically).
    Average
    impulse
    This indicator reflects the initial momentum of an article directly after its publication, based on the underlying citation network.
    Top 10%
Powered by OpenAIRE graph
Found an issue? Give us feedback
selected citations
These citations are derived from selected sources.
This is an alternative to the "Influence" indicator, which also reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically).
BIP!Citations provided by BIP!
popularity
This indicator reflects the "current" impact/attention (the "hype") of an article in the research community at large, based on the underlying citation network.
BIP!Popularity provided by BIP!
influence
This indicator reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically).
BIP!Influence provided by BIP!
impulse
This indicator reflects the initial momentum of an article directly after its publication, based on the underlying citation network.
BIP!Impulse provided by BIP!
8
Top 10%
Average
Top 10%
Upload OA version
Are you the author of this publication? Upload your Open Access version to Zenodo!
It’s fast and easy, just two clicks!