p065fig02.12 Three sources of neural network research: [binary, linear, continuous nonlinear]. My own research has contributed primarily to the third.<BR>||  Three sources of neural network research.<TABLE border="1"><TR><TD><B>Binary</b></td><TD><B>Linear</b></td><TD><B>Continuous and non-Linear</b></td></tr><TR><TD>neural network signal processing</td><TD>Systems theory</td><TD>Neurophysiology and Psychology</td></tr><TR><TD>McCullogh-Pitts 1943<BR>... Xi(t+1) = sgn{sum[j: Aij*Xj(t) - Bi}<BR>Von Neumann 1945<BR>Calanielio 1961<BR>Rosenblatt 1962</td><TD>Widrow 1962<BR>Anderson 1968<BR>Kohonen 1971</td><TD>Hodgkin, Huxley 1952<BR>Hartline, Ratliff 1957<BR>Grossberg 1967<BR>Von der Malsburg 1973</td></tr><TR><TD>digital computer</td><TD>Y-A*X<BR>cross-correlate<BR>steepest descent</td><TD></td></tr></table>