Skip to main content
Log in

Adaptive pattern classification and universal recoding: I. Parallel development and coding of neural feature detectors

  • Published:
Biological Cybernetics Aims and scope Submit manuscript

Abstract

This paper analyses a model for the parallel development and adult coding of neural feature detectors. The model was introduced in Grossberg (1976). We show how experience can retune feature detectors to respond to a prescribed convex set of spatial patterns. In particular, the detectors automatically respond to average features chosen from the set even if the average features have never been experienced. Using this procedure, any set of arbitrary spatial patterns can be recoded, or transformed, into any other spatial patterns (universal recoding), if there are sufficiently many cells in the network's cortex. The network is built from short term memory (STM) and long term memory (LTM) mechanisms, including mechanisms of adaptation, filtering, contrast enhancement, tuning, and nonspecific arousal. These mechanisms capture some experimental properties of plasticity in the kitten visual cortex. The model also suggests a classification of adult feature detector properties in terms of a small number of functional principles. In particular, experiments on retinal dynamics, including amarcrine cell function, are suggested.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  • Barlow, H.B., Pettigrew, J.D.: Lack of specificity of neurones in the visual cortex of young kittens. J. Physiol. (Lond.) 218, 98–100 (1971)

    Google Scholar 

  • Bennett, M.V.L.: Analysis of parallel excitatory and inhibitory synaptic channels. J. Neurophysiol. 34, 69–75 (1971)

    Google Scholar 

  • Blackenship, J.E., Wachtel, H., Kandel, E.R.: Ionic mechanisms of excitatory, inhibitory, and dual synaptic actions mediated by an identified interneuron in abdominal ganglion of Aplysia. J. Neurophysiol. 34, 76–92 (1971)

    Google Scholar 

  • Blakemore, C., Cooper, G.F.: Development of the brain depends on the visual environment. Nature (Lond.) 228, 477–478 (1970)

    Google Scholar 

  • Blakemore, C., Mitchell, D.E.: Environmental modification of the visual cortex and the neural basis of learning and memory. Nature (Lond.) New Biol. 241, 467–468 (1973)

    Google Scholar 

  • Boycott, B.B., Dowling, J.E.: Organization of the primate retina: light microscopy. Phil. Trans. roy. Soc. B. 255, 109–184 (1969)

    Google Scholar 

  • Ellias, S.A., Grossberg, S.: Pattern formation, contrast control, and oscillations in the short term memory of shunting on-center off-surround networks. Biol. Cybernetics 20, 69–98 (1975)

    Google Scholar 

  • Freeman, W. J.: Neural coding through mass action in the olfactory system. Proceeding IEEE Conference on biologically motivated automata theory 1974

  • Gierer, A., Meinhardt, H.: A theory of biological pattern formation. Kybernetik 12, 30–39 (1972)

    Google Scholar 

  • Greenspan, H.P., Benney, D.J.: Calculus. New York: McGraw-Hill 1973

    Google Scholar 

  • Grossberg, S.: Nonlinear difference-differential equations in prediction and learning theory. Proc. nat. Acad. Sci. (Wash.) 58, 1329–1334 (1967)

    Google Scholar 

  • Grossberg, S.: Some networks that can learn, remember, and reproduce any number of complicated space-time patterns, II. Stud. appl. Math. 49, 135–166 (1970a)

    Google Scholar 

  • Grossberg, S.: Neural pattern discrimination. J. theor. Biol. 27, 291–337 (1970b)

    Google Scholar 

  • Grossberg, S.: Pavlovian pattern learning by nonlinear neural networks. Proc. nat. Acad. Sci. (Wash.) 68, 828–831 (1971)

    Google Scholar 

  • Grossberg, S.: Neural expectation: cerebellar and retinal analogs of cells fired by learnable or unlearned pattern classes. Kybernetik 10, 49–57 (1972)

    Google Scholar 

  • Grossberg, S.: Contour enhancement, short term memory, and constancies in reverberating neural networks. Stud. appl. Math. 52, 213–257 (1973)

    Google Scholar 

  • Grossberg, S.: Classical and instrumental learning by neural networks. In: Rosen, R. and Snell, F. (Eds.): Progress in Theoretical Biology, pp. 51–141. New York: Academic Press 1974

    Google Scholar 

  • Grossberg, S.: A neural model of attention, reinforcement, and discrimination learning. Int. Rev. Neurobiol. 18, 263–327 (1975)

    Google Scholar 

  • Grossberg, S.: On the development of feature detectors in the visual cortex with applications to learning and reaction-diffusion systems. Biol. Cybernetics 21, 145–159 (1976)

    Google Scholar 

  • Grossberg, S., Levine, D.S.: Some developmental and attentional biases in the contrast enhancement and short term memory of recurrent neural networks. J. theor. Biol. 53, 341–380 (1975)

    Google Scholar 

  • Hebb, D.O.: The organization of behavior. New York: Wiley 1949

    Google Scholar 

  • Hirsch, H.V.B., Spinelli, D.N.: Visual experience modifies distribution of horizontally and vertically oriented receptive fields in cats. Science 168, 869–871 (1970)

    Google Scholar 

  • Hirsch, H.V.B., Spinelli, D.N.: Modification of the distribution of receptive field orientation in cats by selective visual exposure during development. Exp. Brain Res. 12, 509–527 (1971)

    Google Scholar 

  • Hubel, D.H., Wiesel, T.N.: The period of susceptibility to the physiological effects of unilateral eye closure in kittens. J. Physiol. (Lond.) 206, 419–436 (1970)

    Google Scholar 

  • Kimble, G.A.: Foundations of conditioning and learning. New York: Appleton-Century-Crofts 1967

    Google Scholar 

  • Levine, D.S., Grossberg, S.: Visual illusions in neural networks: line neutralization, tilt aftereffect, and angle expansion. J. theor. Biol., in press (1976)

  • Meinhardt, H., Gierer, A.: Applications of a theory of biological pattern formation based on lateral inhibition. J. Cell. Sci. 15, 321–346

  • Pérez, R., Glass, L., Shlaer, R.: Development of specificity in the cat visual cortex. J. math. Biol. (1974)

  • Von der Malsburg, C.: Self-organization of orientation sensitive cells in the striate cortex. Kybernetik 14, 85–100 (1973)

    Google Scholar 

  • Wachtel, H., Kandel, E.R.: Conversion of synaptic excitation to inhibition at a dual chemical synapse. J. Neurophysiol. 34, 56 (1971)

    Google Scholar 

  • Wiesel, T.N., Hubel, D.H.: Single-cell responses in striate cortex of kittens deprived of vision in one eye. J. Neurophysiol. 26, 1003–1017 (1963)

    Google Scholar 

  • Wiesel, T.N., Hubel, D.H.: Comparison of the effects of unilateral and bilateral eye closure on cortical unit responses in kittens. J. Neurophysiol. 28, 1029–1040 (1965)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Additional information

Supported in part by the Advanced Research Projects Agency under ONR Contract No. N00014-76-C-0185

Rights and permissions

Reprints and permissions

About this article

Cite this article

Grossberg, S. Adaptive pattern classification and universal recoding: I. Parallel development and coding of neural feature detectors. Biol. Cybernetics 23, 121–134 (1976). https://doi.org/10.1007/BF00344744

Download citation

  • Received:

  • Revised:

  • Issue Date:

  • DOI: https://doi.org/10.1007/BF00344744

Keywords

Navigation