Abstract
This paper analyses a model for the parallel development and adult coding of neural feature detectors. The model was introduced in Grossberg (1976). We show how experience can retune feature detectors to respond to a prescribed convex set of spatial patterns. In particular, the detectors automatically respond to average features chosen from the set even if the average features have never been experienced. Using this procedure, any set of arbitrary spatial patterns can be recoded, or transformed, into any other spatial patterns (universal recoding), if there are sufficiently many cells in the network's cortex. The network is built from short term memory (STM) and long term memory (LTM) mechanisms, including mechanisms of adaptation, filtering, contrast enhancement, tuning, and nonspecific arousal. These mechanisms capture some experimental properties of plasticity in the kitten visual cortex. The model also suggests a classification of adult feature detector properties in terms of a small number of functional principles. In particular, experiments on retinal dynamics, including amarcrine cell function, are suggested.
Similar content being viewed by others
References
Barlow, H.B., Pettigrew, J.D.: Lack of specificity of neurones in the visual cortex of young kittens. J. Physiol. (Lond.) 218, 98–100 (1971)
Bennett, M.V.L.: Analysis of parallel excitatory and inhibitory synaptic channels. J. Neurophysiol. 34, 69–75 (1971)
Blackenship, J.E., Wachtel, H., Kandel, E.R.: Ionic mechanisms of excitatory, inhibitory, and dual synaptic actions mediated by an identified interneuron in abdominal ganglion of Aplysia. J. Neurophysiol. 34, 76–92 (1971)
Blakemore, C., Cooper, G.F.: Development of the brain depends on the visual environment. Nature (Lond.) 228, 477–478 (1970)
Blakemore, C., Mitchell, D.E.: Environmental modification of the visual cortex and the neural basis of learning and memory. Nature (Lond.) New Biol. 241, 467–468 (1973)
Boycott, B.B., Dowling, J.E.: Organization of the primate retina: light microscopy. Phil. Trans. roy. Soc. B. 255, 109–184 (1969)
Ellias, S.A., Grossberg, S.: Pattern formation, contrast control, and oscillations in the short term memory of shunting on-center off-surround networks. Biol. Cybernetics 20, 69–98 (1975)
Freeman, W. J.: Neural coding through mass action in the olfactory system. Proceeding IEEE Conference on biologically motivated automata theory 1974
Gierer, A., Meinhardt, H.: A theory of biological pattern formation. Kybernetik 12, 30–39 (1972)
Greenspan, H.P., Benney, D.J.: Calculus. New York: McGraw-Hill 1973
Grossberg, S.: Nonlinear difference-differential equations in prediction and learning theory. Proc. nat. Acad. Sci. (Wash.) 58, 1329–1334 (1967)
Grossberg, S.: Some networks that can learn, remember, and reproduce any number of complicated space-time patterns, II. Stud. appl. Math. 49, 135–166 (1970a)
Grossberg, S.: Neural pattern discrimination. J. theor. Biol. 27, 291–337 (1970b)
Grossberg, S.: Pavlovian pattern learning by nonlinear neural networks. Proc. nat. Acad. Sci. (Wash.) 68, 828–831 (1971)
Grossberg, S.: Neural expectation: cerebellar and retinal analogs of cells fired by learnable or unlearned pattern classes. Kybernetik 10, 49–57 (1972)
Grossberg, S.: Contour enhancement, short term memory, and constancies in reverberating neural networks. Stud. appl. Math. 52, 213–257 (1973)
Grossberg, S.: Classical and instrumental learning by neural networks. In: Rosen, R. and Snell, F. (Eds.): Progress in Theoretical Biology, pp. 51–141. New York: Academic Press 1974
Grossberg, S.: A neural model of attention, reinforcement, and discrimination learning. Int. Rev. Neurobiol. 18, 263–327 (1975)
Grossberg, S.: On the development of feature detectors in the visual cortex with applications to learning and reaction-diffusion systems. Biol. Cybernetics 21, 145–159 (1976)
Grossberg, S., Levine, D.S.: Some developmental and attentional biases in the contrast enhancement and short term memory of recurrent neural networks. J. theor. Biol. 53, 341–380 (1975)
Hebb, D.O.: The organization of behavior. New York: Wiley 1949
Hirsch, H.V.B., Spinelli, D.N.: Visual experience modifies distribution of horizontally and vertically oriented receptive fields in cats. Science 168, 869–871 (1970)
Hirsch, H.V.B., Spinelli, D.N.: Modification of the distribution of receptive field orientation in cats by selective visual exposure during development. Exp. Brain Res. 12, 509–527 (1971)
Hubel, D.H., Wiesel, T.N.: The period of susceptibility to the physiological effects of unilateral eye closure in kittens. J. Physiol. (Lond.) 206, 419–436 (1970)
Kimble, G.A.: Foundations of conditioning and learning. New York: Appleton-Century-Crofts 1967
Levine, D.S., Grossberg, S.: Visual illusions in neural networks: line neutralization, tilt aftereffect, and angle expansion. J. theor. Biol., in press (1976)
Meinhardt, H., Gierer, A.: Applications of a theory of biological pattern formation based on lateral inhibition. J. Cell. Sci. 15, 321–346
Pérez, R., Glass, L., Shlaer, R.: Development of specificity in the cat visual cortex. J. math. Biol. (1974)
Von der Malsburg, C.: Self-organization of orientation sensitive cells in the striate cortex. Kybernetik 14, 85–100 (1973)
Wachtel, H., Kandel, E.R.: Conversion of synaptic excitation to inhibition at a dual chemical synapse. J. Neurophysiol. 34, 56 (1971)
Wiesel, T.N., Hubel, D.H.: Single-cell responses in striate cortex of kittens deprived of vision in one eye. J. Neurophysiol. 26, 1003–1017 (1963)
Wiesel, T.N., Hubel, D.H.: Comparison of the effects of unilateral and bilateral eye closure on cortical unit responses in kittens. J. Neurophysiol. 28, 1029–1040 (1965)
Author information
Authors and Affiliations
Additional information
Supported in part by the Advanced Research Projects Agency under ONR Contract No. N00014-76-C-0185
Rights and permissions
About this article
Cite this article
Grossberg, S. Adaptive pattern classification and universal recoding: I. Parallel development and coding of neural feature detectors. Biol. Cybernetics 23, 121–134 (1976). https://doi.org/10.1007/BF00344744
Received:
Revised:
Issue Date:
DOI: https://doi.org/10.1007/BF00344744