Complex cell explained

Complex cells can be found in the primary visual cortex (V1),[1] the secondary visual cortex (V2), and Brodmann area 19 (V3).[2]

Like a simple cell, a complex cell will respond primarily to oriented edges and gratings, however it has a degree of spatial invariance. This means that its receptive field cannot be mapped into fixed excitatory and inhibitory zones. Rather, it will respond to patterns of light in a certain orientation within a large receptive field, regardless of the exact location. Some complex cells respond optimally only to movement in a certain direction.

These cells were discovered by Torsten Wiesel and David Hubel in the early 1960s. They refrained from reporting on the complex cells in (Hubel 1959) because they did not feel that they understood them well enough at the time.[3] In Hubel and Wiesel (1962), they reported that complex cells were intermixed with simple cells and when excitatory and inhibitory regions could be established, the summation and mutual antagonism properties didn't hold.

The difference between the receptive fields and the characteristics of simple and complex cells is the hierarchical convergent nature of visual processing. Complex cells receive inputs from a number of simple cells. Their receptive field is therefore a summation and integration of the receptive fields of many input simple cells, although some input is directly received from the LGN.[4] The manner through which simple cells are able to make up complex cells is not fully understood. A simple addition of receptive fields would result in complex cells manifesting observable, separate excitatory/inhibitory regions, which is not the case.

Discovery

The discovery of the complex cells in visual cortex began with experiments on a cat. Kuffler first shone small spots of light on a cat's retina. With this, he was able to conclude that ganglion cells have concentric (active at high light levels) receptive fields. These cells also have either an on-center receptive field (excited when the stimulus is presented directly on the center of the receptive field) or off-center receptive field (excited when the stimulus is presented off the center of the receptive field).[5] Later, Hubel and Wiesel began their own experiments on cats to further solidify the knowledge on the visual receptive fields. One experiment recorded from anesthetized cats; these cats were paralyzed to stabilize their eyes. The cat then faced a screen where various patterns of white light were shone. Each cell's receptive fields were mapped for both eyes on sheets of paper.[6]

Other studies of complex cells have been performed by Movshon et al., Emerson et al.,[7] Touryan et al.[8] [9] and Rust et al.[10]

Simple vs. Complex Cells and Receptive Fields

With simple cells and simple receptive fields, the cells in visual cortex could respond in a way that can be noted from arrangements of excitatory and inhibitory regions in their receptive fields. What this means, essentially, is that the receptive fields are "simple" because there appears to be a relationship between the response of the cell and the receptive field mapped with small spots. Complex cells and complex receptive fields, on the other hand have a more complex response that does not exhibit that relationship. The results from the above experiment determined that simple fields have clear excitatory and inhibitory divisions, where light shone on an excitatory region increases the firing of a cell and light shone on an inhibitory region decreased firing of a cell. There is also evidence of summation properties, such as light shone across a larger region of either division resulted in a greater change in firing rate than light shone across a smaller region. It is also important to note that excitatory regions can inhibit inhibitory regions and vice versa, as well as it is possible to predict responses of the cells from a map of these areas.

On the contrary, complex cells and complex receptive fields are defined to be "not simple." These cell's response to a stimulus cannot be predicted as simple cells can, as they have no inhibitory and excitatory areas. Summation and the inhibition idea also do not often hold. For example, a horizontal slit was presented in the experiment, and it was found that a cell responded highly to this slit. On these complex cells, as long as the slit was horizontal, it did not matter where the slit was positioned on the receptive field. With simple cells, it would be expected that there would be a higher response to a wide slit. However, the opposite effect occurred: the firing of the cell actually decreased. It was also tested for orientation of the slit. For simple cells, it would be expected that as long as the slit covers the excitatory field, the orientation should not matter. Again, the opposite occurred where even slight tilts to the slit resulted in decreased response.

Modeling Complex Cells

From various studies, including Movshon et al. in 1978 and even as early as the 1960s, simple cells have been able to be modeled with a linear model.[11] This would indicate that these simple cells undergo processes that calculate weighted sums of stimulus intensities where the weights are found from the receptive field. This stems from research by Enroth-Cugell & Robson in 1966 which modeled ganglion cells similar to P cells in primates (X cells) and ganglion cells similar to M cells in primates (Y cells).[12] Complex cells, on the other hand, are more complex and fall under a different model. Rather, it was noted that these cells perform nonlinear operations, which suggested that they have linear receptive fields, but instead sum a distorted output of subunits. It was found that complex cells shared similarities to Y cells, making this subunit model a promising candidate to model complex cells.

Movshon et al. in 1978 tested responses from simple cells to determine if the simple model for the X cells was a good fit. They later applied the same testing to complex cells, but used the Y cell (subunit) model instead. This model stated that each subunits could respond differently, but the converted responses would be offset in time, so it would sum to a constant value. It also stated that the response of the cells could not be predicted from the receptive field on its own. Complex cells appeared to match the subunit model, but still lacked the restriction that the receptive fields are linear. This was also tested by measuring the response of a cell when the stimulus contains two bars, which would help show the properties of the receptive field subunit. What they found was that by knowing these properties of the subunits, it was possible to predict spatial frequency selectivity, as was the case for simple cells.[13] Hence, complex cells could be modeled by the subunit model used for Y ganglion cells.

Other computational models of complex cells have been proposed by Adelson and Bergen,[14] Heeger,[15] Serre and Riesenhuber,[16] Einhäuser et al.,[17] Kording et al.,[18] Merolla and Boahen,[19] Berkes and Wiscott,[20] Carandini,[13] Hansard and Horaud[21] and Lindeberg.[22]

Notes and References

  1. Hubel DH, Wiesel TN . Receptive fields, binocular interaction and functional architecture in the cat's visual cortex . The Journal of Physiology . 160 . 106–54 . January 1962 . 1 . 14449617 . 1359523 . 10.1113/jphysiol.1962.sp006837 .
  2. Hubel DH, Wiesel TN . Receptive Fields and Functional Architecture in Two Nonstriate Visual Areas (18 and 19) of the Cat . Journal of Neurophysiology . 28 . 229–89 . March 1965 . 2 . 14283058 . 10.1152/jn.1965.28.2.229 .
  3. Book: Wiesel. David H. . Hubel . Torsten N.. Brain and visual perception : the story of a 25-year collaboration. 2005. Oxford University Press. New York, N.Y.. 978-0-19-517618-6. [Online-Ausg.]..
  4. Book: Palmer . Stephen E. . Vision Science: Photons to Phenomenology . Cambridge . . 153 . 1999 . 978-0-262-16183-1 .
  5. Hubel DH, Wiesel TN . Receptive fields of single neurones in the cat's striate cortex . The Journal of Physiology . 148 . 3 . 574–91 . October 1959 . 14403679 . 1363130 . 10.1113/jphysiol.1959.sp006308.
  6. Hubel DH, Wiesel TN . Receptive fields, binocular interaction and functional architecture in the cat's visual cortex . The Journal of Physiology . 160 . 1 . 106–54 . January 1962 . 14449617 . 1359523 . 10.1113/jphysiol.1962.sp006837.
  7. Emerson RC, Citron MC, Vaughn WJ, Klein SA . Nonlinear directionally selective subunits in complex cells of cat striate cortex . Journal of Neurophysiology . 58 . 33–65 . 1987 . 1 . 10.1152/jn.1987.58.1.33. 3039079 .
  8. Touryan J, Lau B, Dan Y . Isolation of relevant visual features from random stimuli for cortical complex cells . Journal of Neuroscience . 22 . 10811–10818 . 2002 . 24 . 10.1523/jneurosci.22-24-10811.2002. 12486174 . 6758424 . free .
  9. Touryan J, Felsen G, Dan Y . Spatial structure of complex cell receptive fields measured with natural images . Neuron . 45 . 781–791 . 2005 . 5 . 10.1016/j.neuron.2005.01.029. 15748852 . free .
  10. Rust NC, Schwartz O, Movshon JA, Simoncelli EP . Spatiotemporal elements of macaque V1 receptive fields . Neuron . 46 . 945–956 . 2005 . 6 . 10.1016/j.neuron.2005.05.021. 15953422 . free .
  11. Movshon JA, Thompson ID, Tolhurst DJ . Receptive field organization of complex cells in the cat's striate cortex . The Journal of Physiology . 283 . 79–99 . October 1978 . 722592 . 1282766 . 10.1113/jphysiol.1978.sp012489.
  12. Enroth-Cugell C, Robson JG . The contrast sensitivity of retinal ganglion cells of the cat . The Journal of Physiology . 187 . 3 . 517–52 . December 1966 . 16783910 . 1395960 . 10.1113/jphysiol.1966.sp008107.
  13. Carandini M . What simple and complex cells compute . The Journal of Physiology . 577 . Pt 2 . 463–6 . December 2006 . 16973710 . 1890437 . 10.1113/jphysiol.2006.118976 .
  14. Adelson E, Bergen J . Spatiotemporal energy models for the perception of motion . Journal of the Optical Society of America A . 2 . 284–299 . 1985 . 2 . 10.1364/josaa.2.000284. 3973762 . 1985JOSAA...2..284A .
  15. Heeger DJ . Normalization of cell responses in cat striate cortex . Vis. Neurosci. . 9 . 181–197 . 1992 . 2 . 10.1017/s0952523800009640. 1504027 . 22804285 .
  16. Serre T, Riesenhuber M . Realistic modeling of simple and complex cell tuning in the HMAX model, and implications for invariant object recognition in cortex . Technical Report AI Memo 2004-017, MIT Computer Science and Artificial Intelligence Laboratory . 2004.
  17. Einhäuser W, Kayser C, König P, Körding KP . Learning the invariance properties of complex cells from their responses to natural stimuli . European Journal of Neuroscience . 15 . 475–486 . 2004. 3 . 10.1046/j.0953-816x.2001.01885.x . 11876775 . 7235110 . free .
  18. Kording KP, Kayser C, Einhäuser W, Konig P . How are complex cell properties adapted to the statistics of natural stimuli? . Journal of Neurophysiology . 91 . 206–212 . 2004 . 1 . 10.1152/jn.00149.2003 . 12904330 . 11858/00-001M-0000-0013-DA31-6 . free .
  19. Merolla P, Boahn K . A recurrent model of orientation maps with simple and complex cells . Advances in Neural Information Processing Systems (NIPS 2004) . 995–1002 . 2004.
  20. Berkes P, Wiskott L . Slow feature analysis yields a rich repertoire of complex cell properties . Journal of Vision . 5 . 579–602 . 2005. 6 . 10.1167/5.6.9 . 16097870 . free .
  21. Hansard M, Horaud R . A differential model of the complex cell . Neural Computation. 23 . 2324–2357 . 2011 . 9 . 10.1162/neco_a_00163. 21671791 . 2012.09027 . 2075062 .
  22. Lindeberg T . Provably scale-covariant continuous hierarchical networks based on scale-normalized differential expressions coupled in cascade . Journal of Mathematical Imaging and Vision . 62 . 120–128 . 2020 . 10.1007/s10851-019-00915-x . 1905.13555. free .