Warren McCulloch
Neurophysiologist who, with Walter Pitts, proposed the first mathematical model of a neuron in 1943 — the ancestor of every neural network built since.
Warren McCulloch (1898–1969) was a neurophysiologist who wanted to know whether the brain could be described in the language of logic. Working with Walter PittsWalter PittsSelf-taught logician who, with Warren McCulloch, co-authored the 1943 paper modeling neurons as logic gates — the mathematical starting point for every neural network., he published "A Logical Calculus of the Ideas Immanent in Nervous Activity" in 1943 — a paper that modeled a neuron as a simple threshold unit: it fires if enough of its inputs are active, otherwise it doesn't. There was no learning rule and no data, just a claim that networks of these units could, in principle, compute anything a Turing machine could.
That claim is the entire premise behind the neural networkNeural NetworkA neural network is layers of simple weighted-sum-plus-nonlinearity units (neurons) chained together, trained by gradient descent and backpropagation., decades before anyone trained one. The McCulloch-Pitts neuron directly inspired Frank RosenblattFrank RosenblattPsychologist who built the perceptron in 1958, the first neural network that learned its own weights from data rather than having them set by hand.'s perceptronPerceptronThe Perceptron (1958) was the first learning system built from an artificial neuron, and the direct ancestor of the neural network training loop. a decade later, and the threshold-then-fire structure is still recognizable in every activation function used today.
McCulloch later organized the Macy Conferences on cybernetics, the interdisciplinary meetings where biologists, mathematicians, and engineers first argued in the same room about minds, machines, and feedback — a direct precursor to the 1956 Dartmouth workshop that gave the field its name.
See also: Walter PittsWalter PittsSelf-taught logician who, with Warren McCulloch, co-authored the 1943 paper modeling neurons as logic gates — the mathematical starting point for every neural network., Frank RosenblattFrank RosenblattPsychologist who built the perceptron in 1958, the first neural network that learned its own weights from data rather than having them set by hand.
Learn more: History & Landscape · Wikipedia: Warren McCulloch
Mentioned in
Lessons where this comes up in context.