The brain is a very powerful information processing engine that surpasses the reasoning ability of computers in domains such as learning, inductive reasoning, prediction, vision, and speech recognition. However, the simplest computing device has the capability to process very large datasets well beyond the ability of the human brain.
In biology, a neural network is composed of groups of neurons interconnected by synapses [10:2], as shown in the following image:
Neuroscientists have been especially interested in understanding how the billions of neurons in the brain can interact to provide human beings with parallel processing capabilities. The 1960s saw a new field of study emerging, known as connectionism. Connectionism marries cognitive psychology, artificial intelligence, and neuroscience. The goal was to create a model for mental phenomena. Although there are many forms of connectionism...