Skip to main content
SpringerLink
Log in

Ontologies and Worlds in Category Theory: Implications for Neural Systems

  • Published:
Axiomathes Aims and scope Submit manuscript

Abstract

We propose category theory, the mathematical theory of structure, as a vehicle for defining ontologies in an unambiguous language with analytical and constructive features. Specifically, we apply categorical logic and model theory, based upon viewing an ontology as a sub-category of a category of theories expressed in a formal logic. In addition to providing mathematical rigor, this approach has several advantages. It allows the incremental analysis of ontologies by basing them in an interconnected hierarchy of theories, with an operation on the hierarchy that expresses the formation of complex theories from simple theories that express first principles. Another operation forms abstractions expressing the shared concepts in an array of theories. The use of categorical model theory makes possible the incremental analysis of possible worlds, or instances, for the theories, and the mapping of instances of a theory to instances of its more abstract parts. We describe the theoretical approach by applying it to the semantics of neural networks.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  • Adamek, J., H. Herrlich and G. Strecker: 1990, Abstract and Concrete Categories: The Joy of Cats, Cambridge University Press.

  • Andrews, P. B.: 1986, An Introduction to Mathematical Logic and Type Theory: To Truth through Proof, Academic Press, Inc.

  • R. Andrews J. Diederich A. B. Tickle (1995) ArticleTitle‘Survey and Critique of Techniques for Extracting Rules from Trained Artificial Neural Networks’ Knowledge-Based Systems 8 IssueID6 373–389 Occurrence Handle10.1016/0950-7051(96)81920-4

    Article  Google Scholar 

  • M. A. Arbib (1987) Brains, Machines, and Mathematics Springer Berlin

    Google Scholar 

  • Bartfai, G.: 1994, ‘Hierarchical Clustering with ART Neural Networks’, in Proceedings of the International Conference on Neural Networks, Orlando, FL, June 28–July 2, 1994.

  • Bennet, M. K.: 1995, Affine and Projective Geometry, John Wiley and Sons.

  • G. A. Carpenter A.-H. Tan (1995) ArticleTitle‘Rule Extraction: From Neural Architecture to Symbolic Representation’ Connection Science 7 3–27

    Google Scholar 

  • Craven, M. W. and J. W. Shavlik: 1993, ‘Learning Symbolic Rules using Artificial Neural Networks’, in Proceedings of the 10th International Machine Learning Conference, Amherst, MA, Morgan Kaufmann.

  • Crole, R. L.: 1993, Categories for Types, Cambridge University Press.

  • A Damasio (1989) ArticleTitle‘Time-Locked Multiregional Retroactivation: A Systems-Level Proposal for the Neural Substrates of Recall and Recognition’ Cognition 33 25–62 Occurrence Handle10.1016/0010-0277(89)90005-X

    Article  Google Scholar 

  • A. C. Ehresmann J.-P. Vanbremeersch (1997) ArticleTitle‘Information Processing and Symmetry-Breaking in Memory Evolutive Systems’ BioSystems 43 25–40 Occurrence Handle10.1016/S0303-2647(97)01690-0

    Article  Google Scholar 

  • Fu, L. M.: 1992, ‘A Neural Network for Learning Rule-Based Systems’, in Proceedings of the International Joint Conference on Neural Networks, Baltimore, MD.

  • J. A. Goguen R. M. Burstall (1992) ArticleTitle‘Institutions: Abstract Model Theory for Specification and Programming’ Journal of the Association for Computing Machinery 39 IssueID1 95–146

    Google Scholar 

  • Gruber, T. and G. Olsen: 1994, ‘An Ontology for Engineering Mathematics’, in Proceedings of the Fourth International Conference on Principles of Knowledge Representation and Reasoning, Morgan Kauffman.

  • Gust, H. and K.-U. Kühnberger: 2005, ‘Learning Symbolic Inferences with Neural Networks’, in Proceedings of the XXVII Annual Conference of the Cognitive Science Society (CogSci2005), Stresa, Italy, Cognitive Science Society, ed. offices University of Indiana, Bloomington, IN.

  • M. J Healy (1999a) ArticleTitle‘A Topological Semantics for Rule Extraction with Neural Networks’ Connection Science 11 IssueID1 91–113 Occurrence Handle10.1080/095400999116377

    Article  Google Scholar 

  • M. J. Healy (1999b) ‘Colimits in Memory: Category Theory and Neural Systems’ J. S. Boswell (Eds) Proceedings of IJCNN’99: International Joint Conference on Neural Networks IEEE Press Washington, DC

    Google Scholar 

  • M. J. Healy (2000) ‘Category Theory Applied to Neural Modeling and Graphical Representations’ M. Gori S. -I. Amari C. L. Giles V. Piuri (Eds) Proceedings of the IEEE-INNS-ENNS International Joint Conference on Neural Networks: IJCNN2000 IEEE Computer Society Press Como, Italy

    Google Scholar 

  • M. J. Healy T. P. Caudell (1997) ArticleTitle‘Acquiring Rule Sets as a Product of Learning in a Logical Neural Architecture’ IEEE Transactions on Neural Networks 8 IssueID3 461–474 Occurrence Handle10.1109/72.572088

    Article  Google Scholar 

  • Healy, M. J. and T. P. Caudell: 2001, ‘A Categorical Semantic Analysis of ART Architectures’, in IJCNN’01:International Joint Conference on Neural Networks, Washington, DC, IEEE Press.

  • Healy, M. J. and T. P. Caudell: 2002, ‘Aphasic Compressed Representations: A Functorial Semantic Design Principle for Coupled ART Networks’, in The 2002 International Joint Conference on Neural Networks (IJCNN’02), Honolulu, (CD-ROM Proceedings), IEEE Press.

  • Healy, M. J. and T. P. Caudell: 2003, ‘From Categorical Semantics to Neural Network Design’, in The Proceedings of the IJCNN 2003 International Joint Conference on Neural Networks, Portland, OR, 2003 (CD-ROM Proceedings), IEEE Press.

  • Healy, M. J. and T. P. Caudell: 2004, Neural Networks, Knowledge, and Cognition: A Mathematical Semantic Model Based upon Category Theory. Technical Report EECE-TR-04-020, Department of Electrical and Computer Engineering, University of New Mexico.

  • Healy, M. and K. Williamson: 2000, ‘Applying Category Theory to Derive Engineering Software from Encoded Knowledge’, in Proceedings of the Algebraic Methodology and Software Technology 8th International Conference, AMAST 2000, Iowa City, IA. Published in Lecture Notes in Computer Science, Springer-Verlag.

  • D. O. Hebb (1949) The Organization of Behavior John Wiley and Sons New York

    Google Scholar 

  • Heileman, G. L., M. Georgiopoulos, M. J. Healy and S. J. Verzi: 1997, ‘The Generalization Capabilities of ARTMAP’, in Proceedings of the International Joint Conference on Neural Networks (ICNN97), Houston, TX.

  • J. Hirsch D. R. Moreno K. H. S. Kim (2001) ArticleTitle‘Interconnected Large-Scale Systems for Three Fundamental Cognitive Tasks Revealed by Functional mri’ Journal of Cognitive Neuroscience 13 IssueID3 389–405 Occurrence Handle10.1162/08989290151137421

    Article  Google Scholar 

  • Jullig, R. and Y. V. Srinivas: 1993, ‘Diagrams for Software Synthesis’, in Proceedings of KBSE ‘93: The Eighth Knowledge-Based Software Engineering Conference, IEEE Computer Society Press.

  • N. K Kasabov (1996) ArticleTitle‘Adaptable Neuro Production Systems’ Neurocomputing 13 95–117 Occurrence Handle10.1016/0925-2312(95)00098-4

    Article  Google Scholar 

  • W. M. Kelley C. N. Macrae C. L. Wyland S. Caglar S. Inati T. F. Heatherton (2002) ArticleTitle‘Finding the Self ? An Event-Related fmri Study’ Journal of Cognitive Neuroscience 14 IssueID5 785–794 Occurrence Handle10.1162/08989290260138672

    Article  Google Scholar 

  • Lawvere, F. W. and S. H. Schanuel: 1997, Conceptual Mathematics: A First Introduction to Categories, Cambridge University Press.

  • Mac Lane, S.: 1971, Categories for the Working Mathematician, Springer. This is the standard reference for mathematicians, written by one of the two co-discoverors of category theory (S. Eilenberg being the other).

  • McClelland, J. L., D. E. Rumelhart and G. E. Hinton: 1986, ‘The Appeal of Parallel Distributed Processing’, in Parallel Distributed Processing: Explorations in the Microstructure of Cognition, Vol. 1, The MIT Press, pp. 3–44. This volume contains an exposition on bias nodes as a neural mechanism for varying the thresholds of a layer of nodes.

  • W. S. McCullough W. Pitts (1943) ArticleTitle‘A Logical Calculus of the Ideas Immanent in Nervous Activity’ Bulletin of Mathematical Biophysics 5 115–133

    Google Scholar 

  • Meseguer, J.: 1989, ‘General logics’, in Logic Colloquium ’87, Science Publishers B. V. (North-Holland), pp. 275–329.

  • S. Mitra S. K. Pal (1995) ArticleTitle‘Fuzzy Multi-Layer Perceptron, Inferencing and Rule Generation’ IEEE Transactions on Neural Networks 6 51–63 Occurrence Handle10.1109/72.363450

    Article  Google Scholar 

  • I. Otto P. Grandguillaume L. Boutkhil Y. Burnod E. Guigon (1992) ArticleTitle‘Direct and Indirect Cooperation between Temporal and Parietal Networks for Invariant Visual Recognition’ Journal of Cognitive Neuroscience 4 IssueID1 35–57

    Google Scholar 

  • C Perry (1999) ArticleTitle‘Testing a Computational Account of Category-Specific Deficits’ Journal of Cognitive Neuroscience 11 IssueID3 312–320 Occurrence Handle10.1162/089892999563418

    Article  Google Scholar 

  • Pierce, B. C.: 1991, Basic Category Theory for Computer Scientists, MIT Press.

  • G Pinkas (1995) ArticleTitle‘Reasoning, Nonmonotonicity and Learning in Connectionist Networks that Capture Propositional Knowledge’ Artificial Intelligence 77 203–247 Occurrence Handle10.1016/0004-3702(94)00032-V

    Article  Google Scholar 

  • S. C. Rao G. Ranier E. K. Miller (1997) ArticleTitle‘Integration of What and Where in the Primate Prefrontal Cortex’ Science 276 821–824

    Google Scholar 

  • M. Riesenhuber T. Poggio (1999) ArticleTitle‘Are Cortical Models Really Bound by the Binding Problem?’ Neuron 24 87–93 Occurrence Handle10.1016/S0896-6273(00)80824-7

    Article  Google Scholar 

  • R Rosen (1958a) ArticleTitle‘A Relational Theory of Biological Systems’ Bulletin of Mathematical Biophysics 20 245–260

    Google Scholar 

  • R Rosen (1958b) ArticleTitle‘The Representation of Biological Systems from the Standpoint of the Theory of Categories’ Bulletin of Mathematical Biophysics 20 317–341

    Google Scholar 

  • J Sima (1995) ArticleTitle‘Neural Expert Systems’ Neural Networks 8 261–271

    Google Scholar 

  • L. R. Squire S. Zola-Morgan (1991) ArticleTitle‘The Medial Temporal Lobe Memory System’ Science 253 1380–1385

    Google Scholar 

  • Srinivas, Y. V. and R. Jullig: 1995, ‘SpecwareTM: Formal Support for Composing Software’, in Proceedings of the Conference of Mathematics of Program Construction.

  • Stoltenberg-Hansen, V., I. Lindstroem, and E. R. Griffor: 1994, Mathematical Theory of Domains, Cambridge University Press.

  • Tse, T. H.: 1991, A Unifying Framework for Structured Analysis and Design Models: An Approach using Initial Algebra Semantics and Category Theory, Cambridge University Press.

  • Vickers, S.: 1993, Topology via Logic, Cambridge University Press.

  • I Wickelgren (1997) ArticleTitle‘Getting a Grip on Working Memory’ Science 275 1580–1582

    Google Scholar 

  • Williamson, K. and M. Healy: 1997, ‘Formally Specifying Engineering Design Rationale’, in Proceedings of the Automated Software Engineering Conference-1997.

  • K. Williamson M. Healy (2000) ArticleTitle‘Deriving Engineering Software from Requirements’ Journal of Intelligent Manufacturing 11 IssueID1 3–28 Occurrence Handle10.1023/A:1008959706859

    Article  Google Scholar 

  • K. Williamson M. Healy R. Barker (2001) ArticleTitle‘Industrial Applications of Software Synthesis via Category Theory-Case Studies using SpecwareTM’ Automated Software Engineering 8 IssueID1 7–30 Occurrence Handle10.1023/A:1008759623876

    Article  Google Scholar 

Download references

Authors
  1. Michael John Healy
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Thomas Preston Caudell
    View author publications

    You can also search for this author in PubMed Google Scholar

Rights and permissions

Reprints and permissions

About this article

Cite this article

Healy, M.J., Caudell, T.P. Ontologies and Worlds in Category Theory: Implications for Neural Systems. Axiomathes 16, 165–214 (2006). https://doi.org/10.1007/s10516-005-5474-1

Download citation

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10516-005-5474-1

Keywords

Search

Navigation