Binding neuron explained

A binding neuron (BN) is an abstract concept of processing of input impulses in a generic neuron based on their temporal coherence and the level of neuronal inhibition. Mathematically, the concept may be implemented by most neuronal models including the well-known leaky integrate-and-fire model. The BN concept originated in 1996 and 1998 papers by A. K. Vidybida,^{[1] [2]}

Description of the concept

For a generic neuron the stimuli are excitatory impulses. Normally, more than single input impulse is necessary for exciting neuron up to the level when it fires and emits an output impulse.Let the neuron receives

n input impulses at consecutive moments of time t _{1,t} _{2,...,t} _{n} . In the BN concept the temporal coherence tc between input impulses is defined as followstc = (1)/(t _{n-t} _{1}) .

The high degree of temporal coherence between input impulses suggests that in external media all

n impulses can be created by a single complex event. Correspondingly, if BN is stimulated by a highly coherent set of input impulses, it fires and emits an output impulse. In the BN terminology, BN binds the elementary events (input impulses) into a single event (output impulse). The binding happens if the input impulses are enough coherent in time, and does not happen if those impulses do not have required degree of coherence.

Inhibition in the BN concept (essentially, the slow somatic potassium inhibition) controls the degree of temporal coherence required for binding: the higher level of inhibition, the higher degree of temporal coherence is necessary for binding to occur.

The emitted output impulse is treated as abstract representation of the compound event (the set of coherent in time input impulses), see Scheme.

Origin

"Although a neuron requires energy, its main function is to receive signals and to send them out that is, to handle information." --- this words by Francis Crick point at the necessity to describe neuronal functioning in terms of processing of abstract signals ^[3] The two abstract concepts, namely, the "coincidence detector" and "temporal integrator" are offered in this course,^{[4] [5]} The first one expects that a neuron fires a spike if a number of input impulses are received at the same time. In the temporal integrator concept a neuron fires a spike after receiving a number of input impulses distributed in time.Each of the two takes into account some features of real neurons since it is known that a realistic neuron can displayboth coincidence detector and temporal integrator modes of activity depending on the stimulation applied,.^[6] At the same time, it is known that a neuron together with excitatory impulses receives also inhibitory stimulation.A natural development of the two above mentioned concepts could be a concept which endows inhibition with its own signal processing role.

In the neuroscience, there is an idea of binding problem. For example, during visual perception, such features as form, color and stereopsis are represented in the brain by different neuronal assemblies. The mechanism ensuring those features to be perceived as belonging to a single real object is called "feature binding",.^[7] The experimentally approved opinion is that precise temporal coordination between neuronal impulses is required for the binding to occur,^{[8] [9] [10] [11] [12] [13]} This coordination mainly means that signals about different features must arrive to certain areas in the brain within a certain time window.

The BN concept reproduces at the level of single generic neuron the requirement, which is necessary for the feature binding to occur, and which was formulated earlier at the level of large-scale neuronal assemblies.Its formulation is made possible by the analysis of response of the Hodgkin–Huxley model to stimuli similar to those the real neurons receivein the natural conditions, see "Mathematical implementations", below.

Mathematical implementations

Hodgkin–Huxley (H-H) model

Hodgkin–Huxley model — physiologically substantiated neuronal model, which operates in terms oftransmembrane ionic currents, and describes mechanism of generation of action potential.

In the paper^[14] the response of the H-H model was studied numerically to stimuli

U(t) composed of manyexcitatory impulses distributed randomly within a time window W :U(t) = \sum ^{NP} _{k =1} V(t - t _{k} ), t _{k} \in [ 0 ;W].

Here

V(t) denotes magnitude of excitatory postsynaptic potential at moment t ; t _{k} — is the moment of arrival of k -th impulse; NP — is the total number of impulses the stimulus is composed of. The numbers t _{k} are random, distributed uniformly within interval[ 0 ;W] . The stimulating current applied in the H-H equations is as followsI(t) =- C _{M} (d U(t))/(dt) ,

where

C _{M} — is the capacity of unit area of excitable membrane.The probability to generate action potential was calculated as a function of the window width W .Different constant potassium conductances were added to the H-H equations in order to create certain levels of inhibitory potential. The dependencies obtained, if recalculated as functions of TC = (1)/(W) , which is analogous to temporal coherence of impulses in the compound stimulus, have step-like form.The location of the step is controlled by the level of inhibition potential, see Fig. 1. Due to this type of dependence, the H-H equations can be treated as mathematical model of the BN concept.

Leaky integrate and fire neuron (LIF)

Leaky integrate and fire neuron is a widely used abstract neuronal model.If to state a similar problem for the LIF neuron with appropriately chosen inhibition mechanism,then it is possible to obtain step-like dependencies similar to the Fig. 1 as well.Therefore, the LIF neuron as well can be considered as mathematical model of the BN concept.

Binding neuron model

The binding neuron model implements the BN concept in the most refined form.^[15] In this model each input impulse is stored in the neuron during fixed time

\tau and then disappears.This kind of memory serves as surrogate of the excitatory postsynaptic potential.The model has a threshold N _{th} : if the number of stored in the BN impulses exceeds N _{th} then the neuron fires a spike and clears it internal memory. The presence of inhibition results in the decreased \tau .In the BN model, it is necessary to control the time to live of any stored impulse during calculation of the neuron'sresponse to input stimulation. This makes the BN model more complicated for numerical simulation than the LIF model.On the other hand, any impulse spends finite time \tau in the BN model neuron. This is in contrast to theLIF model, where traces of any impulse can be present infinitely long. This property of the BN model allows toget precise description of output activity of BN stimulated with random stream of input impulses, see^{[16] [17]} .^[18]

The limiting case of BN with infinite memory, τ→∞, corresponds to the temporal integrator.The limiting case of BN with infinitely short memory, τ→0, corresponds to the coincidence detector.

Integrated circuit implementation

The above-mentioned and other neuronal models and nets made of them can be implemented in microchips. Among different chips it is worth mentioning the field-programmable gate arrays. These chips can be used for implementation of any neuronal model, but the BN model can be programmed most naturally because it can use only integers and do not need solving differential equations. Those features are used, e.g. in^[19] and^[20]

Limitations

As an abstract concept the BN model is subjected to necessary limitations. Among those are such as ignoring neuronal morphology, identical magnitude of input impulses, replacement of a set of transients with different relaxation times, known for a real neuron, with a single time to live,

\tau , of impulse in neuron, the absence of refractoriness and fast (chlorine) inhibition. The BN model has the same limitations, yet some of them can be removed in a complicated model, see, e.g.,^[21] where the BN model is used with refractoriness and fast inhibition.

Notes and References

1. Vidybida . A. K. . 1996 . Neuron as time coherence discriminator . Biological Cybernetics . 74 . 6. 537–542 . 10.1007/BF00209424 . 8672560 . 19862684 .
2. Vidybida . A.K. . 1998 . Inhibition as binding controller at the single neuron level . BioSystems . 48 . 1–3. 263–267 . 10.1016/S0303-2647(98)00073-2 . 9886656 .
3. F. Crick. The Astonishing Hypothesis. Touchstone., 1995.
4. Abeles . M. . 1982 . Role of the cortical neuron: integrator or coincidence detector? . Israel Journal of Medical Sciences . 18 . 1. 83–92 . 6279540 .
5. König . P. . Engel . A. K. . Singer . W. . 1996 . Integrator or coincidence detector? the role of the cortical neuron revisited . Trends in Neurosciences . 19 . 4. 130–137 . 10.1016/S0166-2236(96)80019-1 . 8658595 . 14664183 .
6. Rudolph . M. . Destexhe . A. . 2003 . Tuning neocortical pyramidal neurons between integrators and coincidence detectors . Journal of Computational Neuroscience . 14 . 3. 239–251 . 10.1023/A:1023245625896 . 12766426 . 3695640 .
7. J. P. Sougné. Binding problem. In Encyclopedia of Cognitive Science. John Wiley & Sons, Ltd, 2006.
8. Treisman . A. M. . Gelade . G. . 1980 . A feature-integration theory of attention . Cognitive Psychology . 12 . 1. 97–136 . 10.1016/0010-0285(80)90005-5 . 7351125 . 353246 .
9. 1999 . The what and why of binding: The modeler's perspective . Neuron . 24 . 8. 95–104 . 10.1016/S0896-6273(00)80825-9 . 10677030 . von der Malsburg . C. 7057525 . free .
10. Eckhorn . R. . Bauer . R. . Jordan . W. . Brosch . M. . Kruse . W. . Munk . M. . Reitboeck . H. J. . 1988 . Coherent oscillations: a mechanism for feature linking in the visual cortex? . Biological Cybernetics . 60 . 2. 121–130 . 10.1007/BF00202899 . 3228555 . 206771651 .
11. Damasio . A. R. . 1989 . Concepts in the brain . Mind & Language . 4 . 1–2. 25–28 . 10.1111/j.1468-0017.1989.tb00236.x .
12. A. K. Engel, P. König, A. K. Kreiter, C. M. Gray, and W. Singer. Temporal coding by coherent oscillations as a potential solution to the binding problem: physiological evidence. In H. G. Schuster and W. Singer, editors, Nonlinear Dynamics and Neuronal Networks, pages 325. VCH Weinheim, 1991.
13. 10.1111/j.1749-6632.1993.tb22955.x . 682 . Neural Mechanisms Underlying Temporal Integration, Segmentation, and Input Sequence Representation: Some Implications for the Origin of Learning Disabilities . 1993 . Annals of the New York Academy of Sciences . 1–22 . Merzenich . Michael M.. 1 . 8323106 . 1993NYASA.682....1M . 44698935 .
14. Vidybida . A. K. . 1996 . Neuron as time coherence discriminator . Biological Cybernetics . 74 . 6. 537–542 . 10.1007/BF00209424 . 8672560 . 19862684 .
15. Book: Encyclopedia of information science and technology . Mehdi Khosrow-Pour . Binding neuron . 2014 . IGI Global . Hershey PA . 978-1-4666-5889-9 . 1123–1134 . Third .
16. Vidybida . A. K. . 2007 . Output stream of a binding neuron . Ukrainian Mathematical Journal . 59 . 12. 1819–1839 . 10.1007/s11253-008-0028-5 . 120989952 .
17. Vidybida . A. K. . Kravchuk . K. G. . 2013 . Delayed feedback makes neuronal firing statistics non-markovian . 10.1007/s11253-013-0753-2 . Ukrainian Mathematical Journal . 64 . 12. 1793–1815 . 123193380 .
18. Arunachalam . V. . Akhavan-Tabatabaei . R. . Lopez . C. . 2013 . Results on a Binding Neuron Model and Their Implications for Modified Hourglass Model for Neuronal Network . 10.1155/2013/374878 . Computational and Mathematical Methods in Medicine . 2013 . 374878 . 3876776 . 24396394 . free .
19. Rosselló . J. L. . Canals . V. . Morro . A. . Oliver . A. . 2012 . Hardware implementation of stochastic spiking neural networks . International Journal of Neural Systems . 22 . 4. 1250014 . 10.1142/S0129065712500141 . 22830964 .
20. Wang . R. . Cohen . G. . Stiefel . K. M. . Hamilton . T. J. . Tapson . J. . Schaik . A. van . 2013 . An fpga implementation of a polychronous spiking neural network with delay adaptation . Frontiers in Neuroscience . 7 . 14 . 10.3389/fnins.2013.00014 . 23408739 . 3570898. free .
21. Kravchuk . K. G. . Vidybida . A. K. . 2014 . Non-markovian spiking statistics of a neuron with delayed feedback in presence of refractoriness . 10.3934/mbe.2014.11.81 . Mathematical Biosciences and Engineering . 11 . 1. 81–104 . 24245681 . free .