Biological neuron models, also known as spiking neuron models,[1] are mathematical descriptions of the conduction of electrical signals in neurons. Neurons (or nerve cells) are electrically excitable cells within the nervous system, able to fire electric signals, called action potentials, across a neural network. These mathematical models describe the role of the biophysical and geometrical characteristics of neurons on the conduction of electrical activity.
Central to these models is the description of how the membrane potential (that is, the difference in electric potential between the interior and the exterior of a biological cell) across the cell membrane changes over time. In an experimental setting, stimulating neurons with an electrical current generates an action potential (or spike), that propagates down the neuron's axon. This axon can branch out and connect to a large number of downstream neurons at sites called synapses. At these synapses, the spike can cause the release of neurotransmitters, which in turn can change the voltage potential of downstream neurons. This change can potentially lead to even more spikes in those downstream neurons, thus passing down the signal. As many as 85% of neurons in the neocortex, the outermost layer of the mammalian brain, consist of excitatory pyramidal neurons,[2] [3] and each pyramidal neuron receives tens of thousands of inputs from other neurons. Thus, spiking neurons are a major information processing unit of the nervous system.
One such example of a spiking neuron model may be a highly detailed mathematical model that includes spatial morphology. Another may be a conductance-based neuron model that views neurons as points and describes the membrane voltage dynamics as a function of trans-membrane currents. A mathematically simpler "integrate-and-fire" model significantly simplifies the description of ion channel and membrane potential dynamics (initially studied by Lapique in 1907).[4] [5]
Non-spiking cells, spiking cells, and their measurement
Not all the cells of the nervous system produce the type of spike that defines the scope of the spiking neuron models. For example, cochlear hair cells, retinal receptor cells, and retinal bipolar cells do not spike. Furthermore, many cells in the nervous system are not classified as neurons but instead are classified as glia.
Neuronal activity can be measured with different experimental techniques, such as the "Whole cell" measurement technique, which captures the spiking activity of a single neuron and produces full amplitude action potentials.
With extracellular measurement techniques, one or more electrodes are placed in the extracellular space. Spikes, often from several spiking sources, depending on the size of the electrode and its proximity to the sources, can be identified with signal processing techniques. Extracellular measurement has several advantages:
Overview of neuron models
Neuron models can be divided into two categories according to the physical units of the interface of the model. Each category could be further divided according to the abstraction/detail level:
Although it is not unusual in science and engineering to have several descriptive models for different abstraction/detail levels, the number of different, sometimes contradicting, biological neuron models is exceptionally high. This situation is partly the result of the many different experimental settings, and the difficulty to separate the intrinsic properties of a single neuron from measurement effects and interactions of many cells (network effects).
Aims of neuron models
Ultimately, biological neuron models aim to explain the mechanisms underlying the operation of the nervous system. However, several approaches can be distinguished, from more realistic models (e.g., mechanistic models) to more pragmatic models (e.g., phenomenological models).[6] Modeling helps to analyze experimental data and address questions. Models are also important in the context of restoring lost brain functionality through neuroprosthetic devices.
The models in this category describe the relationship between neuronal membrane currents at the input stage and membrane voltage at the output stage. This category includes (generalized) integrate-and-fire models and biophysical models inspired by the work of Hodgkin–Huxley in the early 1950s using an experimental setup that punctured the cell membrane and allowed to force a specific membrane voltage/current.
Most modern electrical neural interfaces apply extra-cellular electrical stimulation to avoid membrane puncturing, which can lead to cell death and tissue damage. Hence, it is not clear to what extent the electrical neuron models hold for extra-cellular stimulation (see e.g.[7]).
The shape of an individual spike | ||
The identity of the ions involved | ||
Spike speed across the axon |
See main article: Hodgkin–Huxley model. The Hodgkin–Huxley model (H&H model)[8] [9] [10] is a model of the relationship between the flow of ionic currents across the neuronal cell membrane and the membrane voltage of the cell.[8] [9] [10] It consists of a set of nonlinear differential equations describing the behavior of ion channels that permeate the cell membrane of the squid giant axon. Hodgkin and Huxley were awarded the 1963 Nobel Prize in Physiology or Medicine for this work.
It is important to note the voltage-current relationship, with multiple voltage-dependent currents charging the cell membrane of capacity
Cm
dV(t) | |
dt |
=-\sumiIi(t,V).
The above equation is the time derivative of the law of capacitance, where the change of the total charge must be explained as the sum over the currents. Each current is given by
I(t,V)=g(t,V) ⋅ (V-Veq)
where is the conductance, or inverse resistance, which can be expanded in terms of its maximal conductance and the activation and inactivation fractions and, respectively, that determine how many ions can flow through available membrane channels. This expansion is given by
g(t,V)=\bar{g} ⋅ m(t,V)p ⋅ h(t,V)q
and our fractions follow the first-order kinetics
dm(t,V) | |
dt |
=
minfty(V)-m(t,V) | |
\taum(V) |
=\alpham(V) ⋅ (1-m)-\betam(V) ⋅ m
with similar dynamics for, where we can use either and or and to define our gate fractions.
The Hodgkin–Huxley model may be extended to include additional ionic currents. Typically, these include inward Ca2+ and Na+ input currents, as well as several varieties of K+ outward currents, including a "leak" current.
The result can be at the small end of 20 parameters which one must estimate or measure for an accurate model. In a model of a complex system of neurons, numerical integration of the equations are computationally expensive. Careful simplifications of the Hodgkin–Huxley model are therefore needed.
The model can be reduced to two dimensions thanks to the dynamic relations which can be established between the gating variables.[11] it is also possible to extend it to take into account the evolution of the concentrations (considered fixed in the original model).[12] [13]
One of the earliest models of a neuron is the perfect integrate-and-fire model (also called non-leaky integrate-and-fire), first investigated in 1907 by Louis Lapicque.[14] A neuron is represented by its membrane voltage which evolves in time during stimulation with an input current according
I(t)=C
dV(t) | |
dt |
which is just the time derivative of the law of capacitance, . When an input current is applied, the membrane voltage increases with time until it reaches a constant threshold, at which point a delta function spike occurs and the voltage is reset to its resting potential, after which the model continues to run. The firing frequency of the model thus increases linearly without bound as input current increases.
The model can be made more accurate by introducing a refractory period that limits the firing frequency of a neuron by preventing it from firing during that period. For constant input the threshold voltage is reached after an integration time after starting from zero. After a reset, the refractory period introduces a dead time so that the total time until the next firing is . The firing frequency is the inverse of the total inter-spike interval (including dead time). The firing frequency as a function of a constant input current, is therefore
f(I)=
I | |
CVth+trefI |
.
A shortcoming of this model is that it describes neither adaptation nor leakage. If the model receives a below-threshold short current pulse at some time, it will retain that voltage boost forever - until another input later makes it fire. This characteristic is not in line with observed neuronal behavior. The following extensions make the integrate-and-fire model more plausible from a biological point of view.
The leaky integrate-and-fire model, which can be traced back to Louis Lapicque, contains a "leak" term in the membrane potential equation that reflects the diffusion of ions through the membrane, unlike the non-leaky integrate-and-fire model. The model equation looks like
Cm
dVm(t) | |
dt |
=I(t)-
Vm(t) | |
Rm |
For constant input, the minimum input to reach the threshold is . Assuming a reset to zero, the firing frequency thus looks like
f(I)= \begin{cases}0,&I\leIth\\ \left[tref-RmCmlog\left(1-\tfrac{Vth
which converges for large input currents to the previous leak-free model with the refractory period.[15] The model can also be used for inhibitory neurons.[16] [17]
The most significant disadvantage of this model is that it does not contain neuronal adaptation, so that it cannot describe an experimentally measured spike train in response to constant input current.[18] This disadvantage is removed in generalized integrate-and-fire models that also contain one or several adaptation-variables and are able to predict spike times of cortical neurons under current injection to a high degree of accuracy.[19] [20] [21]
Sub-threshold voltage for time-dependent input current | ||
Firing times for time-dependent input current | ||
Firing Patterns in response to step current input |
Neuronal adaptation refers to the fact that even in the presence of a constant current injection into the soma, the intervals between output spikes increase. An adaptive integrate-and-fire neuron model combines the leaky integration of voltage with one or several adaptation variables (see Chapter 6.1. in the textbook Neuronal Dynamics[22])
\taum
dVm(t) | |
dt |
=RI(t)-[Vm(t)-Em]-R\sumkwk
\tauk
dwk(t) | |
dt |
=-ak[Vm(t)-Em]-wk+bk\tauk\sumf\delta(t-tf)
where
\taum
\tauk
Recent advances in computational and theoretical fractional calculus lead to a new form of model called Fractional-order leaky integrate-and-fire.[27] [28] An advantage of this model is that it can capture adaptation effects with a single variable. The model has the following form
I(t)- | Vm(t) |
Rm |
=Cm
d\alphaVm(t) | |
d\alphat |
See main article: Exponential integrate-and-fire.
The sub-threshold current-voltage relation | [29] | |
Firing patterns in response to step current input | ||
Refractoriness and adaptation |
In the exponential integrate-and-fire model,[30] spike generation is exponential, following the equation:
dV | |
dt |
-
R | |
\taum |
I(t)=
1 | |
\taum |
\left[Em-V+\DeltaT\exp\left(
V-VT | |
\DeltaT |
\right)\right].
where
V
VT
\taum
Em
\DeltaT
VT
VT
In the adaptive exponential integrate-and-fire neuron [32] the above exponential nonlinearity of the voltage equation is combined with an adaptation variable w
\taum
dV | |
dt |
=RI(t)+\left[Em-V+\DeltaT\exp\left(
V-VT | |
\DeltaT |
\right)\right]-Rw
\tau
dw(t) | |
dt |
=-a[Vm(t)-Em]-w+b\tau\delta(t-tf)
\tau
VT
\tau
\taum
In this model, a time-dependent function
\theta(t)
vth0
vth
\tau\theta
vth(t)=vth0+
\sum\theta(t-tf) | |
f |
=vth0+
| ||||||
f |
where
\theta(t)
\theta(t)=\theta0\exp\left[-
t | |
\tau\theta |
\right]
When the membrane potential,
u(t)
vrest
u(t)\geqvth(t) ⇒ v(t)=vrest
A simpler version of this with a single time constant in threshold decay with an LIF neuron is realized in [36] to achieve LSTM like recurrent spiking neural networks to achieve accuracy nearer to ANNs on few spatio temporal tasks.
The DEXAT neuron model is a flavor of adaptive neuron model in which the threshold voltage decays with a double exponential having two time constants. Double exponential decay is governed by a fast initial decay and then a slower decay over a longer period of time.[37] [38] This neuron used in SNNs through surrogate gradient creates an adaptive learning rate yielding higher accuracy and faster convergence, and flexible long short-term memory compared to existing counterparts in the literature. The membrane potential dynamics are described through equations and the threshold adaptation rule is:
vth(t)=b0+\beta1b1(t)+\beta2b2(t)
The dynamics of
b1(t)
b2(t)
b1(t+\deltat)=pj1b1(t)+(1-pj1)z(t)\delta(t)
b2(t+\deltat)=pj2b2(t)+(1-pj2)z(t)\delta(t)
where
pj1=\exp\left[-
\deltat | |
\taub1 |
\right]
pj2=\exp\left[-
\deltat | |
\taub2 |
\right]
Further, multi-time scale adaptive threshold neuron model showing more complex dynamics is shown in.[39]
The models in this category are generalized integrate-and-fire models that include a certain level of stochasticity. Cortical neurons in experiments are found to respond reliably to time-dependent input, albeit with a small degree of variations between one trial and the next if the same stimulus is repeated.[40] [41] Stochasticity in neurons has two important sources. First, even in a very controlled experiment where input current is injected directly into the soma, ion channels open and close stochastically[42] and this channel noise leads to a small amount of variability in the exact value of the membrane potential and the exact timing of output spikes. Second, for a neuron embedded in a cortical network, it is hard to control the exact input because most inputs come from unobserved neurons somewhere else in the brain.
Stochasticity has been introduced into spiking neuron models in two fundamentally different forms: either (i) a noisy input current is added to the differential equation of the neuron model;[43] or (ii) the process of spike generation is noisy.[44] In both cases, the mathematical theory can be developed for continuous time, which is then, if desired for the use in computer simulations, transformed into a discrete-time model.
The relation of noise in neuron models to the variability of spike trains and neural codes is discussed in Neural Coding and in Chapter 7 of the textbook Neuronal Dynamics.
A neuron embedded in a network receives spike input from other neurons. Since the spike arrival times are not controlled by an experimentalist they can be considered as stochastic. Thus a (potentially nonlinear) integrate-and-fire model with nonlinearity f(v) receives two inputs: an input
I(t)
I\rm(t)
\taum
dV | |
dt |
=f(V)+RI(t)+RInoise(t)
Stein's model is the special case of a leaky integrate-and-fire neuron and a stationary white noise current
I\rm(t)=\xi(t)
\taum
dV | |
dt |
=[Em-V]+RI(t)+R\xi(t)
However, in contrast to the standard Ornstein–Uhlenbeck process, the membrane voltage is reset whenever V hits the firing threshold . Calculating the interval distribution of the Ornstein–Uhlenbeck model for constant input with threshold leads to a first-passage time problem.[45] Stein's neuron model and variants thereof have been used to fit interspike interval distributions of spike trains from real neurons under constant input current.
In the mathematical literature, the above equation of the Ornstein–Uhlenbeck process is written in the form
dV=[Em-V+RI(t)]
dt | |
\taum |
+\sigmadW
where
\sigma
\DeltaV=[Em-V+RI(t)]
\Deltat | |
\taum |
+\sigma\sqrt{\taum}y
where y is drawn from a Gaussian distribution with zero mean unit variance. The voltage is reset when it hits the firing threshold .
The noisy input model can also be used in generalized integrate-and-fire models. For example, the exponential integrate-and-fire model with noisy input reads
\taum
dV | |
dt |
=Em-V+\DeltaT\exp\left(
V-VT | |
\DeltaT |
\right)+RI(t)+R\xi(t)
For constant deterministic input
I(t)=I0
I0
The leaky integrate-and-fire with noisy input has been widely used in the analysis of networks of spiking neurons.[47] Noisy input is also called 'diffusive noise' because it leads to a diffusion of the subthreshold membrane potential around the noise-free trajectory (Johannesma,[48] The theory of spiking neurons with noisy input is reviewed in Chapter 8.2 of the textbook Neuronal Dynamics.
In deterministic integrate-and-fire models, a spike is generated if the membrane potential hits the threshold
Vth
\rho(t)=f(V(t)-Vth)
that depends on the momentary difference between the membrane voltage and the threshold
Vth
f
f(V-Vth)=
1 | |
\tau0 |
\exp[\beta(V-Vth)]
\tau0
\beta
\beta\toinfty
1/\beta ≈ 4mV
The escape rate process via a soft threshold is reviewed in Chapter 9 of the textbook Neuronal Dynamics.
For models in discrete time, a spike is generated with probability
PF(tn)=F[V(tn)-Vth]
that depends on the momentary difference between the membrane voltage at time
tn
Vth
F(x)=0.5[1+\tanh(\gammax)]
\gamma
f
F(yn) ≈ 1-\exp[yn\Deltat]
yn=V(tn)-Vth
Integrate-and-fire models with output noise can be used to predict the peristimulus time histogram (PSTH) of real neurons under arbitrary time-dependent input. For non-adaptive integrate-and-fire neurons, the interval distribution under constant stimulation can be calculated from stationary renewal theory.
Sub-threshold voltage for time-dependent input current | ||
Firing times for time-dependent input current | ||
Firing Patterns in response to step current input | [50] | |
Interspike interval distribution | ||
Spike-afterpotential | ||
refractoriness and dynamic firing threshold |
main article: Spike response model
The spike response model (SRM) is a generalized linear model for the subthreshold membrane voltage combined with a nonlinear output noise process for spike generation.[51] [52] The membrane voltage at time t is
V(t)=\sumfη(t-tf)+
infty | |
\int\limits | |
0 |
\kappa(s)I(t-s)ds+Vrest
where is the firing time of spike number f of the neuron, is the resting voltage in the absence of input, is the input current at time t-s and
\kappa(s)
tf
η(t-tf)
η(t-tf)
Spike firing is stochastic and happens with a time-dependent stochastic intensity (instantaneous rate)
f(V-\vartheta(t))=
1 | |
\tau0 |
\exp[\beta(V-\vartheta(t))]
with parameters
\tau0
\beta
\vartheta(t)
\vartheta(t)=\vartheta0+\sumf
f) | |
\theta | |
1(t-t |
Here
\vartheta0
f) | |
\theta | |
1(t-t |
tf
f) | |
\theta | |
1(t-t |
=0
\beta\toinfty
The time course of the filters
η,\kappa,\theta1
Vi(t)=\sumfηi(t-t
f) | |
i |
+
N | |
\sum | |
j=1 |
wij\sumf'\varepsilonij
f' | |
(t-t | |
j |
)+Vrest
where
f' | |
t | |
j |
f | |
η | |
i) |
wij
\varepsilonij
f' | |
(t-t | |
j |
)
f' | |
t | |
j |
\varepsilonij(s)
I(t)
\kappa(s)
The SRM0[55] [56] is a stochastic neuron model related to time-dependent nonlinear renewal theory and a simplification of the Spike Response Model (SRM). The main difference to the voltage equation of the SRM introduced above is that in the term containing the refractory kernel
η(s)
\hat{t}
V(t)=η(t-\hat{t})+
infty | |
\int | |
0 |
\kappa(s)I(t-s)ds+Vrest
and the network equations of the SRM0 are
Vi(t\mid\hat{t}i)=ηi(t-\hat{t}i)+\sumjwij\sumf\varepsilonij
f) | |
(t-\hat{t} | |
i,t-t |
+Vrest
where
\hat{t}i
\varepsilonij
f(V-\vartheta)=
1 | |
\tau0 |
\exp[\beta(V-Vth)]
where
Vth
With the SRM0, the interspike-interval distribution for constant input can be mathematically linked to the shape of the refractory kernel
η
η
See main article: Galves–Löcherbach model. The Galves–Löcherbach model[57] is a stochastic neuron model closely related to the spike response model SRM0 and the leaky integrate-and-fire model. It is inherently stochastic and, just like the SRM0, it is linked to time-dependent nonlinear renewal theory. Given the model specifications, the probability that a given neuron
i
t
Prob(Xt(i)=1\midl{F}t-1)=\varphiil(\sumj\inWj
t-1 | |||||||
\sum | |||||||
|
gj(t-s)Xs(j),~~~
i | |
t-L | |
t |
l),
where
Wj
j
i
gj
i | |
L | |
t |
i
t
i | |
L | |
t |
=\sup\{s<t:Xs(i)=1\}.
Importantly, the spike probability of neuron
i
gj
Wj\to
i | |
t-L | |
t |
The models in this category are highly simplified toy models that qualitatively describe the membrane voltage as a function of input. They are mainly used for didactic reasons in teaching but are not considered valid neuron models for large-scale simulations or data fitting.
See main article: FitzHugh–Nagumo model. Sweeping simplifications to Hodgkin–Huxley were introduced by FitzHugh and Nagumo in 1961 and 1962. Seeking to describe "regenerative self-excitation" by a nonlinear positive-feedback membrane voltage and recovery by a linear negative-feedback gate voltage, they developed the model described by[58]
\begin{align}{rcl} \dfrac{dV}{dt}&=V-V3/3-w+Iext\\ \tau\dfrac{dw}{dt}&=V-a-bw \end{align}
where we again have a membrane-like voltage and input current with a slower general gate voltage and experimentally-determined parameters . Although not derivable from biology, the model allows for a simplified, immediately available dynamic, without being a trivial simplification.[59] The experimental support is weak, but the model is useful as a didactic tool to introduce dynamics of spike generation through phase plane analysis. See Chapter 7 in the textbook Methods of Neuronal Modeling.[60]
See main article: Morris–Lecar model. In 1981, Morris and Lecar combined the Hodgkin–Huxley and FitzHugh–Nagumo models into a voltage-gated calcium channel model with a delayed-rectifier potassium channel represented by
\begin{align} C | dV |
dt |
&=-Iion(V,w)+I\\
dw | |
dt |
&=\varphi ⋅
winfty-w | |
\tauw |
\end{align}
where
Iion(V,w)=\bar{g}Caminfty ⋅ (V-VCa)+\bar{g}Kw ⋅ (V-VK)+\bar{g}L ⋅ (V-VL)
A two-dimensional neuron model very similar to the Morris-Lecar model can be derived step-by-step starting from the Hodgkin-Huxley model. See Chapter 4.2 in the textbook Neuronal Dynamics.
See main article: Hindmarsh–Rose model. Building upon the FitzHugh–Nagumo model, Hindmarsh and Rose proposed in 1984[62] a model of neuronal activity described by three coupled first-order differential equations:
\begin{align} | dx |
dt |
&=y+3x2-x3-z+I\\
dy | |
dt |
&=1-5x2-y\\
dz | |
dt |
&=r ⋅ (4(x+\tfrac{8}{5})-z) \end{align}
with, and so that the variable only changes very slowly. This extra mathematical complexity allows a great variety of dynamic behaviors for the membrane potential, described by the variable of the model, which includes chaotic dynamics. This makes the Hindmarsh–Rose neuron model very useful, because it is still simple, allows a good qualitative description of the many different firing patterns of the action potential, in particular bursting, observed in experiments. Nevertheless, it remains a toy model and has not been fitted to experimental data. It is widely used as a reference model for bursting dynamics.
See main article: Theta model. The theta model, or Ermentrout–Kopell canonical Type I model, is mathematically equivalent to the quadratic integrate-and-fire model which in turn is an approximation to the exponential integrate-and-fire model and the Hodgkin-Huxley model. It is called a canonical model because it is one of the generic models for constant input close to the bifurcation point, which means close to the transition from silent to repetitive firing.[63] [64]
The standard formulation of the theta model is
d\theta(t) | |
dt |
=(I-I0)[1+\cos(\theta)]+[1-\cos(\theta)]
The equation for the quadratic integrate-and-fire model is (see Chapter 5.3 in the textbook Neuronal Dynamics)
\taum
dVm(t) | |
dt |
=(I-I0)R+[Vm(t)-Em][Vm(t)-VT]
The equivalence of theta model and quadratic integrate-and-fire is for example reviewed in Chapter 4.1.2.2 of spiking neuron models.
For input
I(t)
The models in this category were derived following experiments involving natural stimulation such as light, sound, touch, or odor. In these experiments, the spike pattern resulting from each stimulus presentation varies from trial to trial, but the averaged response from several trials often converges to a clear pattern. Consequently, the models in this category generate a probabilistic relationship between the input stimulus to spike occurrences. Importantly, the recorded neurons are often located several processing steps after the sensory neurons, so that these models summarize the effects of the sequence of processing steps in a compact form
Siebert[65] [66] modeled the neuron spike firing pattern using a non-homogeneous Poisson process model, following experiments involving the auditory system.[65] [66] According to Siebert, the probability of a spiking event at the time interval
[t,t+\Deltat]
g[s(t)]
s(t)
Pspike(t\in[t',t'+\Deltat])=\Deltat ⋅ g[s(t)]
Siebert considered several functions as
g[s(t)]
g[s(t)]\proptos2(t)
The main advantage of Siebert's model is its simplicity. The shortcomings of the model is its inability to reflect properly the following phenomena:
These shortcomings are addressed by the age-dependent point process model and the two-state Markov Model.
Berry and Meister[67] studied neuronal refractoriness using a stochastic model that predicts spikes as a product of two terms, a function f(s(t)) that depends on the time-dependent stimulus s(t) and one a recovery function
w(t-\hat{t})
\rho(t)=f(s(t))w(t-\hat{t})
The model is also called an inhomogeneous Markov interval (IMI) process.[68] Similar models have been used for many years in auditory neuroscience.[69] [70] [71] Since the model keeps memory of the last spike time it is non-Poisson and falls in the class of time-dependent renewal models. It is closely related to the model SRM0 with exponential escape rate. Importantly, it is possible to fit parameters of the age-dependent point process model so as to describe not just the PSTH response, but also the interspike-interval statistics.[71]
See main article: Linear-nonlinear-Poisson cascade model. The linear-nonlinear-Poisson cascade model is a cascade of a linear filtering process followed by a nonlinear spike generation step.[72] In the case that output spikes feed back, via a linear filtering process, we arrive at a model that is known in the neurosciences as Generalized Linear Model (GLM). The GLM is mathematically equivalent to the spike response model SRM) with escape noise; but whereas in the SRM the internal variables are interpreted as the membrane potential and the firing threshold, in the GLM the internal variables are abstract quantities that summarizes the net effect of input (and recent output spikes) before spikes are generated in the final step.
The spiking neuron model by Nossenson & Messer[73] [74] [75] produces the probability of the neuron firing a spike as a function of either an external or pharmacological stimulus.[73] [74] [75] The model consists of a cascade of a receptor layer model and a spiking neuron model, as shown in Fig 4. The connection between the external stimulus to the spiking probability is made in two steps: First, a receptor cell model translates the raw external stimulus to neurotransmitter concentration, and then, a spiking neuron model connects neurotransmitter concentration to the firing rate (spiking probability). Thus, the spiking neuron model by itself depends on neurotransmitter concentration at the input stage.[73] [74] [75] An important feature of this model is the prediction for neurons firing rate pattern which captures, using a low number of free parameters, the characteristic edge emphasized response of neurons to a stimulus pulse, as shown in Fig. 5. The firing rate is identified both as a normalized probability for neural spike firing and as a quantity proportional to the current of neurotransmitters released by the cell. The expression for the firing rate takes the following form:
R | ||||
|
=[y(t)+R0] ⋅ P0(t)
where,
P |
0=-[y(t)+R0+R1] ⋅ P0(t)+R1
P0 could be generally calculated recursively using the Euler method, but in the case of a pulse of stimulus, it yields a simple closed-form expression.[76]
y(t)\simeqggain ⋅ \langles2(t)\rangle,
with
\langles2(t)\rangle
Other predictions by this model include:
1) The averaged evoked response potential (ERP) due to the population of many neurons in unfiltered measurements resembles the firing rate.[75]
2) The voltage variance of activity due to multiple neuron activity resembles the firing rate (also known as Multi-Unit-Activity power or MUA).[74] [75]
3) The inter-spike-interval probability distribution takes the form a gamma-distribution like function.
The shape of the firing rate in response to an auditory stimulus pulse | [77] [78] [79] [80] [81] | The Firing Rate has the same shape of Fig 5. | |
The shape of the firing rate in response to a visual stimulus pulse | [82] [83] [84] [85] | The Firing Rate has the same shape of Fig 5. | |
The shape of the firing rate in response to an olfactory stimulus pulse | [86] | The Firing Rate has the same shape as Fig 5. | |
The shape of the firing rate in response to a somatosensory stimulus | [87] | The Firing Rate has the same shape as Fig 5. | |
The change in firing rate in response to neurotransmitter application (mostly glutamate) | [88] [89] | Firing Rate change in response to neurotransmitter application (Glutamate) | |
Square dependence between an auditory stimulus pressure and the firing rate | [90] | Square Dependence between Auditory Stimulus pressure and the Firing Rate (- Linear dependence in pressure square (power)). | |
Square dependence between visual stimulus electric field (volts) and the firing rate | Square dependence between visual stimulus electric field (volts) - Linear Dependence between Visual Stimulus Power and the Firing Rate. | ||
The shape of the Inter-Spike-Interval Statistics (ISI) | [91] | ISI shape resembles the gamma-function-like | |
The ERP resembles the firing rate in unfiltered measurements | [92] | The shape of the averaged evoked response potential in response to stimulus resembles the firing rate (Fig. 5). | |
MUA power resembles the firing rate | [93] | The shape of the empirical variance of extra-cellular measurements in response to stimulus pulse resembles the firing rate (Fig. 5). |
The models in this category produce predictions for experiments involving pharmacological stimulation.
See also: Neurotransmission. According to the model by Koch and Segev,[15] the response of a neuron to individual neurotransmitters can be modeled as an extension of the classical Hodgkin–Huxley model with both standard and nonstandard kinetic currents. Four neurotransmitters primarily influence the CNS. AMPA/kainate receptors are fast excitatory mediators while NMDA receptors mediate considerably slower currents. Fast inhibitory currents go through GABAA receptors, while GABAB receptors mediate by secondary G-protein-activated potassium channels. This range of mediation produces the following current dynamics:
IAMPA(t,V)=\bar{g}AMPA ⋅ [O] ⋅ (V(t)-EAMPA)
INMDA(t,V)=\bar{g}NMDA ⋅ B(V) ⋅ [O] ⋅ (V(t)-ENMDA)
I | ||
|
=
\bar{g} | ||
|
⋅ ([O1]+[O2]) ⋅ (V(t)-ECl)
I | ||
|
=
\bar{g} | ||
|
⋅ \tfrac{[G]n}{[G]
n+K | |
d |
where is the maximal[94] conductance (around 1S) and is the equilibrium potential of the given ion or transmitter (AMDA, NMDA, Cl, or K), while describes the fraction of open receptors. For NMDA, there is a significant effect of magnesium block that depends sigmoidally on the concentration of intracellular magnesium by . For GABAB, is the concentration of the G-protein, and describes the dissociation of G in binding to the potassium gates.
The dynamics of this more complicated model have been well-studied experimentally and produce important results in terms of very quick synaptic potentiation and depression, that is fast, short-term learning.
The stochastic model by Nossenson and Messer translates neurotransmitter concentration at the input stage to the probability of releasing neurotransmitter at the output stage.[74] [75] For a more detailed description of this model, see the Two state Markov model section above.
The HTM neuron model was developed by Jeff Hawkins and researchers at Numenta and is based on a theory called Hierarchical Temporal Memory, originally described in the book On Intelligence. It is based on neuroscience and the physiology and interaction of pyramidal neurons in the neocortex of the human brain.
- | - Few synapses - No dendrites - Sum input x weights - Learns by modifying the weights of synapses | - Thousands of synapses on the dendrites - Active dendrites: cell recognizes hundreds of unique patterns - Co-activation of a set of synapses on a dendritic segment causes an NMDA spike and depolarization at the soma - Sources of input to the cell:
- Learns by growing new synapses | - Inspired by the pyramidal cells in neocortex layers 2/3 and 5 - Thousands of synapses - Active dendrites: cell recognizes hundreds of unique patterns - Models dendrites and NMDA spikes with each array of coincident detectors having a set of synapses - Learns by modeling the growth of new synapses |
See main article: Brain–computer interface.
Spiking Neuron Models are used in a variety of applications that need encoding into or decoding from neuronal spike trains in the context of neuroprosthesis and brain-computer interfaces such as retinal prosthesis:[95] [96] [97] or artificial limb control and sensation.[98] [99] [100] Applications are not part of this article; for more information on this topic please refer to the main article.
The most basic model of a neuron consists of an input with some synaptic weight vector and an activation function or transfer function inside the neuron determining output. This is the basic structure used for artificial neurons, which in a neural network often looks like
yi=\varphi\left(\sumjwijxj\right)
where is the output of the th neuron, is the th input neuron signal, is the synaptic weight (or strength of connection) between the neurons and, and is the activation function. While this model has seen success in machine-learning applications, it is a poor model for real (biological) neurons, because it lacks time-dependence in input and output.
When an input is switched on at a time t and kept constant thereafter, biological neurons emit a spike train. Importantly, this spike train is not regular but exhibits a temporal structure characterized by adaptation, bursting, or initial bursting followed by regular spiking. Generalized integrate-and-fire models such as the Adaptive Exponential Integrate-and-Fire model, the spike response model, or the (linear) adaptive integrate-and-fire model can capture these neuronal firing patterns.
Moreover, neuronal input in the brain is time-dependent. Time-dependent input is transformed by complex linear and nonlinear filters into a spike train in the output. Again, the spike response model or the adaptive integrate-and-fire model enables to prediction of the spike train in the output for arbitrary time-dependent input, whereas an artificial neuron or a simple leaky integrate-and-fire does not.
If we take the Hodkgin-Huxley model as a starting point, generalized integrate-and-fire models can be derived systematically in a step-by-step simplification procedure. This has been shown explicitly for the exponential integrate-and-fire model and the spike response model.
In the case of modeling a biological neuron, physical analogs are used in place of abstractions such as "weight" and "transfer function". A neuron is filled and surrounded with water-containing ions, which carry electric charge. The neuron is bound by an insulating cell membrane and can maintain a concentration of charged ions on either side that determines a capacitance . The firing of a neuron involves the movement of ions into the cell, that occurs when neurotransmitters cause ion channels on the cell membrane to open. We describe this by a physical time-dependent current . With this comes a change in voltage, or the electrical potential energy difference between the cell and its surroundings, which is observed to sometimes result in a voltage spike called an action potential which travels the length of the cell and triggers the release of further neurotransmitters. The voltage, then, is the quantity of interest and is given by .
If the input current is constant, most neurons emit after some time of adaptation or initial bursting a regular spike train. The frequency of regular firing in response to a constant current is described by the frequency-current relation, which corresponds to the transfer function
\varphi
\varphi
See also: Cable theory.
All of the above deterministic models are point-neuron models because they do not consider the spatial structure of a neuron. However, the dendrite contributes to transforming input into output.[101] Point neuron models are valid description in three cases. (i) If input current is directly injected into the soma. (ii) If synaptic input arrives predominantly at or close to the soma (closeness is defined by a length scale
λ
The filter properties can be calculated from a cable equation.
Let us consider a cell membrane in the form of a cylindrical cable. The position on the cable is denoted by x and the voltage across the cell membrane by V. The cable is characterized by a longitudinal resistance
rl
rm
λ2={rm}/{rl}
\tau=cmrm
Linear cable theory describes the dendritic arbor of a neuron as a cylindrical structure undergoing a regular pattern of bifurcation, like branches in a tree. For a single cylinder or an entire tree, the static input conductance at the base (where the tree meets the cell body or any such boundary) is defined as
Gin=
Ginfty\tanh(L)+GL | |
1+(GL/Ginfty)\tanh(L) |
where is the electrotonic length of the cylinder, which depends on its length, diameter, and resistance. A simple recursive algorithm scales linearly with the number of branches and can be used to calculate the effective conductance of the tree. This is given by
GD=GmAD\tanh(LD)/LD
where is the total surface area of the tree of total length, and is its total electrotonic length. For an entire neuron in which the cell body conductance is and the membrane conductance per unit area is, we find the total neuron conductance for dendrite trees by adding up all tree and soma conductances, given by
GN=GS+
n | |
\sum | |
j=1 |
A | |
Dj |
F | |
dgaj |
,
where we can find the general correction factor experimentally by noting .
The linear cable model makes several simplifications to give closed analytic results, namely that the dendritic arbor must branch in diminishing pairs in a fixed pattern and that dendrites are linear. A compartmental model allows for any desired tree topology with arbitrary branches and lengths, as well as arbitrary nonlinearities. It is essentially a discretized computational implementation of nonlinear dendrites.
Each piece, or compartment, of a dendrite, is modeled by a straight cylinder of arbitrary length and diameter which connects with fixed resistance to any number of branching cylinders. We define the conductance ratio of the th cylinder as, where
Ginfty=\tfrac{\pid3/2
Bout,i=
| |||||||||||||
\sqrt{Rm,i+1/Rm,i |
}
Bin,i=
Bout,i+\tanhXi | |
1+Bout,i\tanhXi |
Bout,par=
| |||||||||||||
\sqrt{Rm,dau1/Rm,par |
where the last equation deals with parents and daughters at branches, and
Xi=\tfrac{li\sqrt{4Ri}}{\sqrt{diRm}}
GN=
Asoma | |
Rm,soma |
+\sumjBin,stem,jGinfty,j.
Importantly, static input is a very special case. In biology, inputs are time-dependent. Moreover, dendrites are not always linear.
Compartmental models enable to include nonlinearities via ion channels positioned at arbitrary locations along the dendrites.[102] For static inputs, it is sometimes possible to reduce the number of compartments (increase the computational speed) and yet retain the salient electrical characteristics.[103]
See also: Multi-compartment model.
The neurotransmitter-based energy detection scheme suggests that the neural tissue chemically executes a Radar-like detection procedure.
As shown in Fig. 6, the key idea of the conjecture is to account for neurotransmitter concentration, neurotransmitter generation, and neurotransmitter removal rates as the important quantities in executing the detection task, while referring to the measured electrical potentials as a side effect that only in certain conditions coincide with the functional purpose of each step. The detection scheme is similar to a radar-like "energy detection" because it includes signal squaring, temporal summation, and a threshold switch mechanism, just like the energy detector, but it also includes a unit that emphasizes stimulus edges and a variable memory length (variable memory). According to this conjecture, the physiological equivalent of the energy test statistics is neurotransmitter concentration, and the firing rate corresponds to neurotransmitter current. The advantage of this interpretation is that it leads to a unit-consistent explanation which allows for bridge between electrophysiological measurements, biochemical measurements, and psychophysical results.
The evidence reviewed in suggests the following association between functionality to histological classification:
Note that although the electrophysiological signals in Fig.6 are often similar to the functional signal (signal power/neurotransmitter concentration / muscle force), there are some stages in which the electrical observation differs from the functional purpose of the corresponding step. In particular, Nossenson et al. suggested that glia threshold crossing has a completely different functional operation compared to the radiated electrophysiological signal and that the latter might only be a side effect of glia break.