Electrical & Computer Engineering Technical Reports
Document Type
Technical Report
Publication Date
3-23-2016
Abstract
This report presents a mathematical model of the semantics, or meaning, of the connec-tionist structure and stimulus activity of a neural network, whether artificial or biologi-cal. The mathematical model associates concepts about sensed objects with the neuron-like nodes in a neural network and composable concept relationships with the connec-tion pathways in the network. Category-theoretic constructs, specifically colimits, limits, and functors, organize the concept structure and map it to a formal neural network in a structure-preserving manner. Starting with a simple example of a neural vision system, we show that this mathematical model of neural network structure and activity can be used to derive connectionist architectures that work as intended. We also claim an additional advantage of this approach: A properly-functioning connectionist architecture has an ac-companying concept representation and this representation is both local and distributed. These properties are derived from the category-theoretic formalism described here.
Recommended Citation
Healy, Michael John and Thoms Preston Caudell. "The Neural Representation of Concepts at the Sensor Level." (2016). https://digitalrepository.unm.edu/ece_rpts/1
Comments
Note: This is revision ECE-TR-16-0001R to the technical report ECE-TR-16-0001. Aside from minor corrections, the revision addresses a change to the definition of the adjacency of sensor pixels in Section 6.3. http://hdl.handle.net/1928/31783