Reference List - Neural Networks in 1990
========================================

Back in the late 1980's I did a lot of work with neural networks. I collected a huge
set of references which I think could be especially useful today.

Back in 1990, the processing power we had available was barely adequate to run a
small network with a limited training set; oh how the times have changed!

This list has special relevance I think, as neural techniques enter a second
renaissance. I present it here as a look back at the state of the art thirty
years ago, and at a whole other body of fascinating work going back nearly a hundred years.

Compiled by Nick Porcino, 1990, copyright 2017 all rights reserved.



When somebody's giving out data, take as much as you can.

	- Bernard Widrow in Plenary Talk at IJCNN 87<F46>



General References - Computers
------------------------------

Bernstein, Philip A., Sequoia: A Fault-Tolerant Tightly Coupled Multiprocessor for Transaction Processing, IEEE Computer Magazine, vol. 21, no. vol. 21,

Clarkson, Mark A., The Quest for the Molecular Computer, Byte, May 1989, pp. 269-273

Drexler, K. Eric, Engines of Creation, 1985

Hecht, Jeff, Physical Limits of Computing, Computers in Physics, Jul/Aug. 1989, pp. 34-40

Lang, Gordon R., M. Dharssi, F.M. Longstaff, P.S. Longstaff, P.A.S. Metford, M.T. Rimmer, An Optimum Parallel Architecture for High-Speed Real-Time Digital Signal Processing, IEEE Computer Magazine, vol. 21, no.2, February 1988, pp. 47-57

Shannon & Weaver, Towards a Theory of Information, 1949

Wiener, Norbert, Cybernetics, 1965, MIT Press, Cambridge MA (xuberhths)


General References and Collections of Papers - Neural Networks
--------------------------------------------------------------

Advances in Neural Information Processing Systems, 1987, Morgan Kaufmann Publishers

Advances in Neural Information Processing Systems, Volume 1, 1988, Morgan Kaufmann Publishers

Advances in Neural Information Processing Systems, Volume 2, 1989, Morgan Kaufmann Publishers

Aihara, Kazuyuki, Neural Computers: The Study of Brain and Neuron (in Japanese), Tokyo Electrical Engineering Institute, Tokyo, 1988

Anderson, James A., editor, Foundations of Neuro-computing, MIT Press, Cambridge MA, 1988

The Brain, a Scientific American Book, 1979, W.H. Freeman and co., New York

Caianello, E.R., editor, Neural Networks: Proceedings of the School on Neural Networks, June 1967 in Ravello, 1968, Springer-Verlag Berlin

Churchland, Patricia Smith, Neurophilosophy: Toward a Unified Science of the Mind-Brain, MIT Press, Cambridge MA, 1986

The DARPA Study on Neural Networks

Durbin, Richard, Christopher Miall, Graeme Mitchison (editors), The Computing Neuron, Addison Wesley, 1989

Eckmiller, Rolf, Cristoph von der Marlsburg Eds., NATO ASI Series: #41. Neural Computers, Springer Verlag, Heidelberg, 1988

First IEEE International Conference on Neural Networks, San Diego, 1987

Gaines, Brian R., Sixth Generation Computing: a Conspectus of the Japanese Proposals, SIGART Newsletter, Jan. 1986, no. 95, pp. 39-

Grossberg, Stephen, editor, Neural Networks and Natural Intelligence, MIT Press, Cambridge MA, 1988

International Joint Conference on Neural Networks, 1988

International Joint Conference on Neural Networks, 1989

International Joint Conference on Neural Networks, Washington D.C. 1990

International Joint Conference on Neural Networks, San Diego, 1990

Irwin, Louis N., (ed.), Comparative Neuroscience and Neurobiology: Readings from the Encyclopedia of Neuroscience, 1988, Birkhauser, Boston

Johnson, R. Colin, Neural Networks in Japan, Electronic Engineering Times, April 6 1987, p. 49

Kohonen, Teuvo, Self Organization and Associative Memory, second edition, Springer Verlag, Heidelberg, 1988

Lippmann, Richard P., An Introduction to Computing with Neural Networks, IEEE ASSP Magazine, vol. 3, no. 4, April 1987, pp. 4-22

McClelland, James L., David E. Rumelhart, Parallel Distributed Processing, vol. 1, MIT Press, Cambridge MA, 1986

McClelland, James L., David E. Rumelhart, Explorations in Parallel Distributed Processing: A Handbook of Models, Programs and Exercises, MIT Press, Cambridge MA, 1989

McCulloch, Warren S., Embodiments of Mind, MIT Press, Cambridge MA, 1965, reissued 1988

MacGregor, Ronald, Neural and Brain Modeling, Academic Press Inc., San Diego, 1987

Minsky, Marvin, The Society of Mind, Picador, London, 1987

Rietmann, Ed, Experiments in Artificial Neural Networks, Tab Books, 1988

Rumelhart, David E., James L. McClelland, Parallel Distributed Processing, vol. 1, MIT Press, Cambridge MA, 1986

von Neumann, John, The Computer and the Brain, MIT Press, 1958


Adaptive Control
----------------

Anderson, Charles W., Learning to Control an Inverted Pendulum Using Neural Networks, IEEE Control Systems Magazine, April 1989, pp. 31-36

Barto, Andrew G., Connectionist Learning for Control: An Overview, COINS Technical Report 89-89, September 1989, Department of Computer Science, University of Massachusetts at Amherst

Barto, Andrew G., Richard S. Sutton, & Charles W. Anderson, Neuronlike adaptive elements that can solve difficult learning control problems, IEEE Transactions on Systems, Man, and Cybernetics, 1983, SMC-13, pp. 834-846

Barto, Andrew G., Richard S. Sutton, Chris J.C.H. Watkins, Learning and Sequential Decision Making, COINS Technical Report 89-95, September 1989, Department of Computer Science, University of Massachusetts at Amherst

Fujii, Teruo, Tamaki Ura, Development of Motion Control System for AUV Using Neural Nets, Proceedings of the IEEE Symposium on Autonomous Underwater Vehicle Technology, June 5 and 6, 1990, Washington D.C., pp. 81-86

Josin, Garry, Development of a Neural Network Autopilot Model for a High Performance Aircraft, 1990 International Joint Conference on Neural Networks, pp. II: 547-550

Michie D., & R.A. Chambers, BOXES: An experiment in adaptive control, in Machine Intelligence 2, E. Dale and D. Mitchie (eds.), Oliver and Boyd, Edinburgh, pp. 137-152 (1968)

Nguyen, Widrow, Bernard, The Truck Backer Upper, 1989 International Joint Conference on Neural Networks, pp. II: 357-363

Porcino, Nick, and James S. Collins, An Application of Neural Networks to the Control of a Free Swimming Submersible, Proceedings of the 1990 International Joint Conference on Neural Networks, Washington D.C., pp. II:417-420

Sutton, Richard S., Integrated Architectures for Learning, Planning, and Reacting Based on Approximating Dynamic Programming, in Proceedings of the Seventh International Conference on Machine Learning, June 1990

Watkins, Chris J.C.H., Learning from Delayed Rewards, PhD Thesis, May 1989, Kings College


Adaptive Resonance Theory
-------------------------

See also Vision - General for more related papers by Stephen Grossberg. Note that
many of the papers cited here have been collected in the volume "Neural Networks
and Natural Intelligence," edited by S. Grossberg and published by MIT Press in 1988.

Carpenter, Gail, Stephen Grossberg, The ART of Adaptive Pattern Recognition by a
Self Organizing Neural Network, IEEE Computer Magazine, March 1988, vol. 21, no. 3,
pp. 77-88

Cohen, Michael A., Stephen Grossberg, Masking Fields: A Massively Parallel Neural
Architecture for Learning, Recognizing, and Predicting Multiple Groupings of
Patterned Data, Applied Optics, 1987, vol. 26, no. 10, pp. 1866-1891

Grossberg, Stephen, How does the brain build a cognitive code? Psychological Review,
1980, vol. 87, pp. 1-51

Grossberg, Stephen, Competitive Learning: From Interactive Activation to Adaptive R
esonance, Cognitive Science, 1987, vol. 11, pp. 23-67

Grossberg, Stephen, Gail Carpenter, A Massively Parallel Architecture for a Self
Organizing Neural Pattern Recognition Machine, Computer Vision, Graphics, and
Image Processing, 1987, vol. 37, pp. 54-115

Grossberg, Stephen, Daniel S. Levine, Neural Dynamics of Attentionally Modulated
Pavlovian Conditioning: Blocking, Inter-stimulus Interval, and Secondary
Reinforcement, Applied Optics,1987, vol. 26, pp. 5015-5030


Back Propagation and Gradient Descent
-------------------------------------

Allred, Lloyd G., Gary E. Kelly, Supervised Learning Techniques for Backpropagation Networks, in Proceedings of the International Joint Conference on Neural Networks, San Diego, 1990, pp. I:721-728

Fahlman, Scott E., Christian Lebiere, The Cascade-Correlation Learning Architecture, Feb. 14, 1990, CMU-CS-90-100, School of Computer Science, Carnegie Mellon University, Pittsburg, PA 15213

Fang, Yan, Terrence J. Sejnowski, Faster Learning for Dynamic Recurrent Backpropagation, in Neural Computation, vol. 2, no. 3, pp. 270-273

Fukuda, T., T. Shibata, M. Tokita, T. Mitsuoka, Neural Network Application for Robotic Motion Control, Adaptation and Learning, in Proceedings of the International Joint Conference on Neural Networks, San Diego,1990, pp. III:447-451

Hagiwara, Masafumi, Novel Back Propagation Algorithm for Reduction of Hidden Units and Acceleration of Convergence using Artificial Selection, in Proceedings of the International Joint Conference on Neural Networks, San Diego, 1990, pp. I:625-630

Irie, Bunpei, Sei Miyake, Capabilities of Three-Layered Perceptrons, in Proceedings of the 1988 International Joint Conference on Neural Networks, pp. I: 641-648

Jones, R.D., Y.C. Lee, C.W. Barnes, G.W. Flake, K. Lee, P.S. Lewis, S. Qian, Function Approximation and Time Series Prediction with Neural Networks, in Proceedings of the International Joint Conference on Neural Networks, San Diego, 1990, pp. I:649-665

McClelland, James L., David E. Rumelhart, Parallel Distributed Processing, vol. 1, MIT Press, Cambridge MA, 1986

McClelland, James L., David E. Rumelhart, Explorations in Parallel Distributed Processing: A Handbook of Models, Programs and Exercises, MIT Press, Cambridge MA, 1989

Nguyen, Derrick, Bernard Widrow, Improving the Learning Speed of 2-Layer Neural Networks by Choosing Initial Values of the Adaptive Weights, in Proceedings of the International Joint Conference on Neural Networks, San Diego, 1990, pp. III:21-26

Parker, David B., A Comparison of Algorithms for Neuron-Like Cells, in AIP Conference Proceedings 151: Neural Networks for Computing, Snowbird UT, 1986, John S. Denker ed., pp. 327-332

Rumelhart, David E., Geoffrey E. Hinton, Ronald J. Williams, Learning Representations by Back-Propagating Errors, Nature, 1986, vol. 323, pp. 533-536

Rumelhart, David E., James L. McClelland, Parallel Distributed Processing, vol. 1, MIT Press, Cambridge MA, 1986

Stinchcombe, Maxwell, Halbert White, Approximating and Learning Unknown Mappings using Multilayer Feedforward Networks with Bounded Weights, in Proceedings of the International Joint Conference on Neural Networks, San Diego, 1990, pp. III:7-16

Tollenaere, Tom, SuperSAB: Fast Adaptive Back Propagation with Good Scaling Properties, in Neural Networks, vol. 3, no. 5, pp. 561-574

White, Halbert, Connectionist Nonparametric Regression: Multilayer Feedforward Networks Can Learn Arbitrary Mappings, Neural Networks, vol. 3, no. 5, pp. 535-550, 1990

Widrow, Bernard & Marcian Hoff, Adaptive Switching Circuits, IRE WESCON Convention Record, 1960, NY, IRE, pp96-104

Widrow, Bernard, Introduction (Historical Anecdotes): Proceedings of the First IEEE Conference on Neural Nets, 1987

Widrow, Bernard, Rodney G. Winter, Robert A. Baxter, Learning Phenomena in Layered Neural Networks, in Proceedings of the First IEEE International Conference on Neural Networks, San Diego, 1987, pp. II:411-429

Widrow, Bernard, Rodney G. Winter, Neural Networks for Adaptive Filtering and Adaptive Pattern Recognition, IEEE Computer Magazine, March 1988, vol. 21, no. 3, pp. 25-39

Widrow, Bernard, Lehr, Wan, MRIII A Robust Algorithm for Training Analog Neural Networks, 1990 International Joint Conference on Neural Networks, Washington D.C., pp. I: 533-540


Boltzmann Machines
------------------

Ackley, David H., Geoffrey E. Hinton, & Terrence J. Sejnowski, A Learning Algorithm for Boltzmann machines, Cognitive Science, 1986, vol 9, pp.147-169

Metropolis N., A.W. Rosenbluth, M.N. Rosenbluth, A.H. Teller, E. Teller, Equation of State Calculations for Fast Computing Machines, Journal of Chemical Physics, June 1953, vol. 21, no. 6, p. 1087-1092

Press, W.H., B.P. Flannery, S.A. Teukolsky, W.T. Vetterling, The Travelling Salesman Problem (incl. Boltzmann machine program listing), in Numerical Recipes in C: The Art of Scientific Computing, Cambridge University Press, 1988, pp. 345-352


Chaos in Neural Networks
------------------------

Baird, Bill, Bifurcation Analysis of a Network Model of Rabbit Olfactory Bulb with Periodic Attractors Stored by a Sequencee Learning Algorithm, in Proceedings of the First IEEE International Joint Conference on Neural Networks, San Diego, 1987, pp. II:147-152

Baird, Bill, ... and their Bifurcations in Dynamic Neural Networks, 1988 International Joint Conference on Neural Networks, pp. I: 9-16

Freeman, Walter J., Why Neural Networks Don't Yet Fly: Inquiry Into the Neurodynamics of Biological Intelligence, in Proceedings of the 1988 International Joint Conference on Neural Networks, pp. II:1 -7

Gelperin, Alan, David W. Tank, Odour-modulated Collective Network Oscillations of Olfactory Interneurons in a Terrestrial Mollusc, Nature, May 31. 1990, vol. 345, pp. 437-440

Yao, Freeman, Walter J., Pattern Recognition in Olfactory Systems, 1989 International Joint Conference on Neural Networks, pp. I: 699-704


Emergence
---------

Highly recommended references are asterisked.
  Discussions of the original concept of emergence: Bergson, Morgan, Nagel, Denbigh, Pepper, Klee
  Computational emergence: Langton, Hillis, Forrest
  Functional emergence (emergence of modelling relations): Rosen, Pattee, Cariani (see also Nagel & Klee)
  Critiques of emergence in computer simulations: Rosen (1973, 1985), Pattee (1989), Cariani (1987-90), Carello et al (1984)

Some references on the problem of emergence
-------------------------------------------

Bergson, Henri (1911) Creative Evolution. (New York: Random House), 1946. [one
of the original expositors of the concept of Emergent Evolution]

Cariani, Peter (1988) Why Artificial Life Needs Evolutionary Robotics. unpublished
manuscript, available upon request.

Cariani, Peter (1989) On the Design of Devices with Emergent Semantic Functions.
Ph.D. dissertation, Dept. of Systems Science, State University of New York at
Binghamton. [the problem of emergence as it relates to AI and evolutionary robotics;
limitations of purely simulational approaches; relation between types of adaptivity and emergence]

Cariani, P. (1989) "Adaptivity, emergence and machine-environment dependencies." Proc, 33rd Annual Meeting, Int. Soc. for Systems Sciences (formerly ISGSR), III:31-37.

Cariani, P. (1990) " Implications from structural evolution:semantic adaptation."
Proceedings of the International Joint Conference on Neural Networks, Washington, D.C., January, 1990, I: 47-50.

Cariani, P. (1990) "Emergence and Artificial Life." manuscript submitted to
Proceedings, Second Workshop on Artificial Life, available upon request.

Cariani, P. (1990) "Adaptation and Emergence in Organisms and Devices." in press,
Journal of General Evolution.

Carello, C., M.T. Turvey, P. N. Kugler, and R. E. Shaw (1984), "Inadequacies of
the computer metaphor." Handbook of Cognitive Neuroscience. Ed., M. Gazzaniga
(New York: Plenum Press). [functional limitations of computing devices: good
general discussion]

Denbigh, KG (1975) An Inventive Universe. (New York: George Braziller). [thermodynamics, determinism and emergence, good general discussion]

Forrest, S. (1989) "Emergent Computation: Self-organizing, Collective, and Cooperative Phenomena in Natural and Artificial Computing Networks," Proceedings of the Ninth Annual Center for Nonlinear Studies and Computing Division Conference, April, 1989. [a serious attempt to formulate a definition of emergent computation]

Hillis, Daniel (1988), "Intelligence as an emergent behavior; or the songs of Eden" Daedelus AI issue, Winter, 1988 (reprinted by MIT Press).Eden," Daedalus, Winter, 1988,175-189.

Klee, R. L. (1984), "Micro-determinism and concepts of emergence, "Philosophy of Science 51: 44-63. [excellent paper discussing clashes differing conceptions of hierarchies and emergence]

Langton, C. (1986), "Studying artificial life with cellular automata," Physica D 22:120-149.

Langton, C. (1989), "Artificial life," Artificial Life, SFI Studies in the Sciences of Complexity. Ed. C. Langton (Reading, MA: Addison-Wesley).

Morgan, C.L. (1927), Emergent Evolution. (London: Northgate and Williams). [one of the original expositors of the concept of emergent evolution]

Nagel, E. (1961), The Structure of Science. (New York: Harcourt, Brace & World) (see pp.367-380 and Chapter 12; an excellent discussion of the problem)

Pattee, H. H. (1972), "The nature of hierarchical controls in living matter," Foundations of Mathematical Biology, Vol. I, R. Rosen, ed. (New York: Academic Press).

Pattee, H. H. (1973), "Physical problems in the origin of natural controls," Biogenesis, Evolution, Homeostasis. Ed., A. Locker (New York: Pergamon). [emergence and the formation of hierarchical constraints]

Pattee, H. H. (1973), "The physical basis of the origin of hierarchical control." Hierarchy Theory: The Challenge of Complex Systems. Ed., H. Pattee (New York: George Braziller).

Pattee, H. H. (1989), "Simulations, Realizations, and Theories of Life," Artificial Life, SFI Studies in the Sciences of Complexity (Reading, MA: Addison-Wesley).

Pepper, Stephen (1926), "Emergence," Journal of Philosophy 23-241-245.

Rosen, R. (1973), "On the generation of metabolic novelties in evolution," Biogenesis, Evolution, Homeostasis. Ed., Alfred Locker (New York: Pergamon). [must reading for Alife simulators; a discussion of the concept of organism and emergent functional properties in simulations]

Rosen, R. (1978) Fundamentals of Measurement and Representation of Natural Systems. (New York: North Holland).

Rosen, R. (1985), Anticipatory Systems. Pergamon Press, New York. [A very dense, but very important book; lays out an entire theory of modelling relations in organisms and devices]

Rosen, R. (1987) On the scope of syntactics in Mathematics and Science: The Machine Metaphor. In: J Casti, ed. Real Brains, Artificial Minds. North-Holland, New York.


Fuzzy Systems
-------------

Fuzzy systems were invented by L.A. Zadeh in 1965 and are just now coming into vogue. Influential authors are Lotfi A. Zadeh, Abraham Kandel, Ronald R. Yager, Brian R. Gaines (U of Calgary) and Bart Kosko.

Diamond, J., R. McLeod, W. Pedrycz, A Fuzzy Cognitive System: Examination of a Referential Neural Architecture, in Proceedings of the International Joint Conference on Neural Networks, San Diego,1990, pp. II:617-622

Fujii, Teruo, Tamaki Ura, Development of Motion Control System for AUV Using Neural Nets, Proceedings of the IEEE Symposium on Autonomous Underwater Vehicle Technology, June 5 and 6, 1990, Washington D.C., pp. 81-86

Fukuda, T., T. Shibata, M. Tokita, T. Mitsuoka, Neural Network Application for Robotic Motion Control, Adaptation and Learning, (Fuzzy Turbo for Back Propagation) in Proceedings of the International Joint Conference on Neural Networks, San Diego,1990, pp. III:447-451

Hisdal, Ellen, Developments in the Wake of the Theory of Possibility, in Fuzzy Sets: Theory and Applications to Policy Analysis and Information Systems, Paul P. Wang and S.K. Chang (eds.), Plenum Press, New York, 1980, pp. 87-91

Iwata, Toshiaki, Kazuo Machida, Yoshitsugu Toda, Fuzzy Control Using Neural Network Techniques, in Proceedings of the International Joint Conference on Neural Networks, San Diego, 1990, pp. III: 365-370

Kandel, Abraham, Fuzzy Statistics and Policy Analysis, in Fuzzy Sets: Theory and Applications to Policy Analysis and Information Systems, Paul P. Wang and S.K. Chang (eds.), Plenum Press, New York, 1980, pp. 133-145

Kong, Seong-Gon, Bart Kosko, Comparison of Fuzzy and Neural Truck Backer-Upper Control Systems, in Proceedings of the International Joint Conference on Neural Networks, San Diego, 1990, pp. III:349-358

Kosko, Bart, Neural Systems and Fuzzy Systems, Prentice-Hall, 1990

Kosko, Bart, Adaptive Inference in Fuzzy Knowledge Networks, in Proceedings of the First IEEE International Conference on Neural Networks, San Diego, 1987, pp. II: 261-268

Patrikar, Ajay, John Provence, A Self-Organizing Controller for Dynamic Processes using Neural Networks, in Proceedings of the International Joint Conference on Neural Networks, San Diego, 1990, pp. III:359-364

Scott, Leland L., Necessary and Sufficient Conditions for the Values of a Function of Fuzzy Variables to Lie in a Specified Subinterval of [0,1], in Fuzzy Sets: Theory and Applications to Policy Analysis and Information Systems, Paul P. Wang and S.K. Chang (eds.), Plenum Press, New York, 1980, pp. 35-47

Takemori, Toshikazu, Nobuji Miyasaka, Shozo Hirose, Thermal Comfort Sensor based on Probabilistic Energy Neural Network, in Proceedings of the International Joint Conference on Neural Networks, San Diego, 1990, pp. II:471-476

Wang, Paul P., C.Y. Wang, Experiment on Character Recognition Using Fuzzy Filters, in Fuzzy Sets: Theory and Applications to Policy Analysis and Information Systems, Paul P. Wang and S.K. Chang (eds.), Plenum Press, New York, 1980, pp. 195-221

Zadeh, Lotfi A., Fuzzy Sets, Information and Control, vol. 8, 1965, New York, Academic Press, pp. 338-353



Hopfield and Optimization Networks
----------------------------------

Hopfield, John J., Neural Networks and physical systems with emergent computational abilities, Proceedings of the National Academy of Sciences, 1982, vol 79. pp. 2554-2558

Hopfield, John J., Neurons with graded response have collective computational properties like those of two state neurons, Proceedings of the National Academy of Sciences, 1984, vol. 81, pp. 3088-3092

Shackleford, Barry J., Neural Data Structures: Programming with Neurons, Hewlett-Packard Journal, vol. 40, no.3, June 1989, pp. 69-78

Tank, David, John J. Hopfield, Concentrating Information in Time: Analog Neural Networks with Application to Speech Recognition Problems, 1987 International Joint Conference on Neural Networks, pp. IV: 455-468


Learning
--------

Methods of training neural networks are legion. This list is a guide to some of the more well known and significant research related to learning in neural networks.

See also Self Organizing Feature Nets and Vector Quantization, Back Propagation, Spatio-Temporal Neural Networks, and Time Delay Neural Networks

Albus, James S., Brains, Robotics, and Behavior, BYTE Books (McGraw Hill), 1981

Alkon, Daniel L., Memory Traces in the Brain, Cambridge University Press, 1987

Anderson, James A., A Simple Network generating an Interactive Memory, Mathematical Biosciences, 1972, vol. 14, pp. 197-220

Barto, Andrew G., From Chemotaxis to Cooperativity: Abstract Exercises in Neuronal Learning Strategies, in The Computing Neuron, R. Durbin, C. Miall, G. Mitchison (Eds.), Addison Wesley, 1989, pp. 73-98

Barto, Andrew G., Michael I. Jordan, Gradient Following Without Back Propagation in Layered Networks, in Proceedings of the First IEEE Conference on Neural Networks, San Diego, 1987, pp. II:629-636

Cybenko, Function Approximation by Superposition of Nonlinear Functions, Information and Control, 1990

Dimopoulos, Nikitas J., Don Radvan, W.A. Keddy, Learning in Asymptotically Behaving Neural Networks, in Proceedings of the International Joint Conference on Neural Networks, San Diego, 1990, pp. III:233-238

Gluck, Mark A. & Richard F. Thompson, Modelling the Neural Substrates of Associative Learning and Memory: A Computational Approach, Psychological Review, 1987, vol 94, no. 2, pp. 176-191

Hebb, Donald O., The Organization of Behaviour, Wiley & Sons, New York, 1949

Hecht-Nielsen, Robert, Counter-Propagation Networks, in Proceedings of the First IEEE International Conference on Neural Networks, San Diego, 1987, pp. II:19-32

Hecht-Nielsen, Robert, Kolmogorov's Mapping Neural Network Existence Theorem, in Proceedings of the First IEEE International Conference on Neural Networks, San Diego, 1987, pp. III:11-14

Kanerva, Pentti, Parallel Structures in Human and Computer Memory, in AIP Conference Proceedings 151: Neural Networks for Computing, Snowbird UT, 1986, John S. Denker ed., pp. 247-258

Klopf, A. Harry, The Hedonistic Neuron: A Theory of Memory, Learning, and Intelligence, Hemisphere Press, Washington DC, 1982

Klopf, A. Harry, A Drive-Reinforcement Model of Single Neuron Function: An Alternative to the Hebbian Neuronal Model, in AIP Conference Proceedings 151: Neural Networks for Computing, Snowbird UT, 1986, John S. Denker ed., pp. 265-269

Klopf, A. Harry, Drive-Reinforcement Learning: A Real-Time Learning Mechanism for Unsupervised Learning, in Proceedings of the First IEEE International Joint Conference on Neural Networks, San Diego, 1987, pp. II:441-445

Klopf, A. Harry, A neuronal model of classical conditioning, Psychobiology, 1988, vol. 16, no. 2, pp. 85-125

Kosko, Bart, Differential Hebbian Learning, in AIP Conference Proceedings 151: Neural Networks for Computing, Snowbird UT, 1986, John S. Denker ed., pp. 277-282

Kosko, Bart, Stochastic Competitive Learning, in Proceedings of the International Joint Conference on Neural Networks, San Diego, 1990, pp. II:215-226

Lashley. Karl S., In Search of the Engram, Society of Experimental Biology Symposium, no. 4, Psychological Mechanisms in Animal Behaviour, Cambridge University Press, 1950, pp. 454-480

Minsky, Marvin & Seymour Papert, Perceptrons, expanded edition, MIT Press, Cambridge MA, 1969 re-released 1988

Psaltsis, Demetri, David Brady, Xiang-Guang Gu, Steven Lin, Holography in Artificial Neural Networks, Nature, vol. 343, 25 Jan. 1990, pp. 325-330

Rosenblatt, Frank, The Perceptron: A probabilistic model for information storage and retrieval in the brain, Psychological Review, 1958, vol. 65, pp. 386-408

Yau, Hung- Chun, Michael T. Manry, Iterative Improvement of a Gaussian Classifier, Neural Networks, vol. 3, no. 4, 1990, pp. 437-443


Locomotion - General
--------------------

Gewecke, Michael, Swimming Behaviour of the Water Beetle Dytiscus Marginalis L. (Coleoptera, Dytiscidae), in Insect Locomotion, Michael Gewecke and Gernot Wendler (eds.), Verlag Paul Parey, 1985, pp. 111-120

Hirose, Shigeo, Akio Morishima, Design and Control of a Mobile Robot with an Articulated Body, in The International Journal of Robotics Research, vol. 9, no. 2, April 1990, pp. 99-114

Horsmann, Ulrich, Gernot Wendler, The Role of a Fast Wing Reflex in Locust Flight, in Insect Locomotion, Michael Gewecke and Gernot Wendler (eds.), Verlag Paul Parey, 1985, pp. 157-165

Robertson, Meldrum, Central Neuronal Interactions in the Flight System of the Locust, in Insect Locomotion, Michael Gewecke and Gernot Wendler (eds.), Verlag Paul Parey, 1985, pp. 183-194

Rowell, Hugh F., Heinrich Reichert, Compensatory Steering in Locusts: the Integration of Non-Phase Locked Input with a Rhythmic Motor Output, in Insect Locomotion, Michael Gewecke and Gernot Wendler (eds.), Verlag Paul Parey, 1985, pp. 175-182

Ruppell, Georg, Kinematic and Behavioural Aspects of Flight of the Male Banded Agrion, Calopteryx (Agrion) Splendens L., in Insect Locomotion, Michael Gewecke and Gernot Wendler (eds.), Verlag Paul Parey, 1985, pp. 195-204

Siddiqui, Shahid S., Neural Circuitry Mediating Locomotion in C. Elegans: Molecular Correlates of Inhibitory Motor Neurons, in Proceedings of the International Joint Conference on Neural Networks, San Diego, 1990, pp. I:155-160

Stent, Gunther S., William B. Kristan, W. Otto Friesen, Carol A. Ort, Margaret Poon, Ronald L. Calabrese, Neuronal Generation
of the Leech Swimming Movement, Science, vol. 200, no. 23, June 1978, pp. 1348-1356

Wendler, Gernot, Harry Teuber, Jorg Peter Jander, Walking, Swimming, and Intermediate Locomotion in Nepa Rubra, in Insect Locomotion, Michael Gewecke and Gernot Wendler (eds.), Verlag Paul Parey, 1985, pp. 103-110


Locomotion - Walking Organisms
------------------------------

The study of the neural control of walking teaches us much about the distributed nature of intelligent control. Neural locomotion control architectures are elegant and robust and increasingly well understood.

Alexander, R. McN., Three Uses for Springs in Legged Locomotion, in The International Journal of Robotics Research, vol. 9, no. 2, April 1990, pp. 53-61

Barrington, E.J.W., Invertebrate Structure and Function, Thomas Nelson and Sons, Don Mills, Ont., 1969, (Locomotion in Terrestrial Arthropods, pp. 134-141)

Bassler, Ulrich, Proprioceptive Control of Stick Insect Walking, in Insect Locomotion, Michael Gewecke and Gernot Wendler (eds.), Verlag Paul Parey, 1985, pp. 43-48

Beer, Randall D., Hillel J. Chiel, Leon S. Sterling, Heterogeneous Neural Networks for Adaptive Behaviour in Dynamic Environments, in Advances in Neural Information Processing Systems, Volume 1, Morgan Kaufman Publishers, 1989

Chiel, Hillel J., & Randall D. Beer, A Lesion Study of a Heterogeneous Artificial Neural Network for Hexapod Locomotion, in Proceedings of International Joint Conference on Neural Networks 1989, pp. I: 407-414

Cruse, Holk, The Influence of Load, Position, and Velocity on the Control of Leg Movement of a Walking Stick Insect, in Insect Locomotion, Michael Gewecke and Gernot Wendler (eds.), Verlag Paul Parey, 1985, pp. 19-26

Dean, Jeffrey, A Simulation of Proprioceptive Input from the Coxal Hair Rows of the Stick Insect: Possible Effect of Step Velocity on the Representation of Joint Angle, in Insect Locomotion, Michael Gewecke and Gernot Wendler (eds.), Verlag Paul Parey, 1985, pp. 49-57

Delcomyn, Fred, Sense Organs and the Pattern of Motor Activity During Walking in the American Cockroach, in Insect Locomotion, Michael Gewecke and Gernot Wendler (eds.), Verlag Paul Parey, 1985, pp. 87-96

Franklin, Robert F., The Locomotion of Hexapods on Rough Ground, in Insect Locomotion, Michael Gewecke and Gernot Wendler (eds.), Verlag Paul Parey, 1985, pp. 69-78

Graham, D., Pattern and Control of Walking in Insects, in Berridge, M.J., J.E. Treherne, V.B. Wigglesworth, (Eds.) Advances in Insect Physiology, volume 18, 1985, Academic Press, New York, pp. 31-140

Gray, James, Animal Locomotion, Weidenfeld and Nicolson, London, 1968

Hoyle, Graham, Arthropod Walking, in Neural Control of Locomotion, R.M.Herman, S.Grillner, P.S.G. Stein, & D.G. Stuart (Eds), Plenum Press, New York, 1976, pp. 137-179

Hustert, Reinhold, The Contribution of Proprioceptors to the Control of Motor Patterns of Legs in Orthopterous Insects - The Locust Example, in Insect Locomotion, Michael Gewecke and Gernot Wendler (eds.), Verlag Paul Parey, 1985, pp. 59-67

Jander, Jorg Peter, Mechanical Stability in Stick Insects When Walking Straight and Around Curves, in Insect Locomotion, Michael Gewecke and Gernot Wendler (eds.), Verlag Paul Parey, 1985, pp. 33-42

Laurent, Gilles & Reinhold Hustert, Motor Neuronal Receptive Fields Delimit Patterns of Motor Activity During Locomotion of the Locust, Journal of Neuroscience, vol. 8, no. 11, Nov. 1988, pp. 4349-4366

Pearson, Keir G., The Control of Walking, Scientific American, vol 276, Dec. 1976

Pearson, Keir G., Robert F. Franklin, Characteristics of Leg Movements and Patterns of Coordination in Locusts Walking on Rough Terrain, International Journal of Robotics Research, vol. 3, no. 2, Summer 1984, pp. 101-112

Porcino, Nick, A Neural Network Controller for Hexapod Locomotion, in Proceedings of the International Joint Conference on Neural Networks, San Diego, 1990, pp. I-189-194

Siegler, Melody V.S., Nonspiking Interneurons and Motor Control in Insects, in Berridge, M.J., J.E. Treherne, V.B. Wigglesworth, (Eds.) Advances in Insect Physiology, volume 18, 1985, Academic Press, New York, pp. 249-304


Locomotion - Walking Robots
---------------------------

Brooks, Rodney A., A Robot That Walks: Emergent Behaviors from a Carefully Evolved Network, Proceedings of the 1989 IEEE International Conference on Robotics and Automation, Volume 2, pp. 692-696

Furusho, J., A. Sano, Sensor-Based Control of a Nine-Link Robot, in The International Journal of Robotics Research, vol. 9, no. 2, April 1990, pp. 83-98

Gorinevsky, D.M., A. Yu. Shneider, Force Control in Locomotion of Legged Vehicles over Rigid and Soft Surfaces, in The International Journal of Robotics Research, vol. 9, no. 2, April 1990, pp. 4-23

Hirose, Shigeo, A Study of a Design and Control of a Quadruped Walking Vehicle, International Journal of Robotics Research, vol. 3, no. 2, Summer 1984, pp. 113-133

Kaneko, Makoto, Kazuo Tanie, and Mohamad Nor Bin Mohamad Than, A Control Algorithm for Hexapod Walking Machine Over Soft Ground, IEEE Journal of Robotics and Automation, vol. 4, no. 3, June 1988, pp. 294-302

Miura, Hirofumi, Isao Shimoyama, Dynamic Walk of a Biped, International Journal of Robotics Research, vol. 3, no. 2, Summer 1984, pp. 60-74


Miscellaneous
-------------

Berke, Peter, That Does Not Compute, in Proceedings of the First IEEE International Conference on Neural Networks, San Diego, 1987, pp. IV: 819-826

Feldman, Jerome A., Neural Representations of Conceptual Knowledge, in Neural Connections, Mental Computations, L.Nadel, L.A.Cooper, P.Culicover, & R.M.Harnish (eds.), MIT Press, Cambridge MA, 1989

Gaines, Brian R., Positive Feedback Processes Underlying Functional Differentiation, in Proceedings of the First IEEE International Conference on Neural Networks, San Diego, 1987, pp. II:387-394

McCulloch, Warren S. & Walter Pitts, A Logical Calculus of Ideas Imminent in Nervous Activity, Bulletin of Mathematical Biophysics, 1943, vol. 5, pp. 115-133

Steels, Luc, Self-Organization through Selection, in Proceedings of the First IEEE International Conference on Neural Networks, San Diego, 1987, pp. II:55-62

Treffner, Paul J., Ecological Connectionism and Animal-Environment Mutuality, in Proceedings of the First IEEE International Conference on Neural Networks, San Diego, 1987, pp. II:813-820


Miscellaneous Applications
--------------------------

Belew, Richard K., Designing Appropriate Learning Rules for Connectionist Systems (text retrieval), in Proceedings of the First IEEE International Conference on Neural Networks, San Diego, 1987, pp. II: 479-486

Dahl, Edward Denning, Neural Network for an NP-Complete Problem: Map and Graph Colouring, in Proceedings of the First IEEE International Conference on Neural Networks, San Diego, 1987, pp. III: 113-120

Kimoto, Takashi, Kazuo Asakawa, Morio Yoda, Masakazu Takeoka, Stock Market Prediction System with Modular Neural Networks, in Proceedings of the International Joint Conference on Neural Networks, San Diego, 1990, pp. I:1-6

Konger, Christopher, Jose C. Principe, Murat Taner, Neural Network Classification of Event Related Potentials for the Design of a New Computer Interface, in Proceedings of the International Joint Conference on Neural Networks, San Diego, 1990, pp. I: 367-372

Takefuji, Yoshiyasu, Paul Hollis, Yoon Pin Foo, Yong B. Cho, Error Correcting System Based on Neural Circuits, in Proceedings of the First IEEE International Conference on Neural Networks, San Diego, 1987, pp. III: 293-300

Tesauro, Gerald, Neurogammon: A Neural Network Backgammon Program, in Proceedings of the International Joint Conference on Neural Networks, San Diego, 1990, pp. III: 33-39

Wang, Lixin, J.M. Mendel, Structured Trainable Networks for Matrix Algebra, Proceedings of the International Joint Conference on Neural Networks, San Diego, 1990, pp. II:125-132


Navigation
----------

Arkin, Ronald C., Motor Schema-Based Mobile Robot Navigation, International Journal of Robotics Research, April 1987, pp. 264-271

DeMuth, Gordon, Steve Springsteen, Obstacle Avoidance Using Neural Networks, Proceedings of the IEEE Symposium on Autonomous Underwater Vehicle Technology, June 5 and 6, 1990, Washington D.C., pp. 213-215

Fernandez, On Tropistic Processing and its Applications, Neural Information Processing Systems, pp. 262-269

Hassoun, Mohamad H., Ashvin J. Sanghvi, Fast Computation of Optimal Paths in Two- and Higher-Dimension Maps, in Neural Networks, vol. 3, no. 3, 1990, pp. 355-363

Hassoun, Mohamad H., Ashvin Sanghvi, Locally Interconnected Layered Neural Network for Path Optimization, in Proceedings of the International Joint Conference on Neural Networks, San Diego, 1990, pp. III:811-817

Jorgensen, C.C., Neural Network Representation of Sensor Graphs in Autonomous Robot Path Planning, in Proceedings of the First IEEE International Conference on Neural Networks, San Diego, 1987, pp. IV: 507-515

Moravec, Hans, Sensor Fusion in Uncertainty Grids for Mobile Robots, in Annual Research Review of the Robotics Institute, Carnegie Mellon University, 1987, pp. 33-48

Park, Lee, Neural Computation for Collision Free Path Planning, 1990 International Joint Conference on Neural Networks, pp. II: 229-232


NeoCognitron
------------

Barnard, Etienne, David Casasent, Shift Invariance and the NeoCognitron, Neural Networks, vol. 3, no. 4, 1990, pp. 403-410

Fukushima, Kunihiko, A Neural Network Model for Selective Attention, in Proceedings of the First IEEE International Conference on Neural Networks, San Diego, 1987, pp. II:11-18

Fukushima, Kunihiko, A Neural Network for Visual Pattern Recognition, IEEE Computer Magazine, March 1988, vol. 21, no. 3, pp. 65-75

Fukushima, Kunihiko, Analysis of Visual Pattern Recognition by NeoCognitron, Neural Networks, vol. 2, no. 6, 1989, pp. 413-420

Fukushima, Kunihiko, Spatio Temporal vs. Spatial Pattern Recognition by the NeoCognitron, in Proceedings of the International Joint Conference on Neural Networks, Washington D.C., 1990, pp. II:279-282

Ito, Kunihiko Fukushima, Recognition of Spatio Temporal Patterns with a Hierarchical Neural Network, in Proceedings of the International Joint Conference on Neural Networks, Washington D.C., 1990, pp. I:273-276

Miyake, Sei, Kunihiko Fukushima, A Neural Network Model for the Mechanism of Pattern Information Processing, in AIP Conference Proceedings 151: Neural Networks for Computing, Snowbird UT, 1986, John S. Denker ed., pp. 305-308

Rajapakse, Jagath, Raj Acharya, Medical Image Segmentation with MARA, in Proceedings of the International Joint Conference on Neural Networks, San Diego, 1990, pp. II:965-972


Neuroethology - Invertebrate
----------------------------

Abbott, Larry, Scott Hooper, Tom Kepler, Eve Marder, Oscillating Networks: Modeling the Pyloric Circuit of the Stomatogastric Ganglion, in Proceedings of the International Joint Conference on Neural Networks, San Diego, 1990, pp. I: 175-180

Alkon, Daniel L., Membrane Channels, Conditioning Induced Changes, in Comparative Neuroscience and Neurobiology: Readings from the Encyclopedia of Neuroscience, Louis N. Irwin (ed.), 1988, Birkhauser, Boston, pp. 72-75

Barrington, E.J.W., Invertebrate Structure and Function, Thomas Nelson and Sons, Don Mills, Ont., 1969, (Nervous System and Learning in Cephalopods, pp. 330-336)

Beer, Randall D., Hillel J. Chiel, Neural Implementation of Motivated Behaviour: Feeding in an Artificial Insect, in D.S. Touretzky (ed.), Advances in Neural Information Processing Systems 2, 1990, Morgan Kaufmann Publishers

Davis, William J., Organizational Concepts in the Central Motor Networks of Invertebrates, in Neural Control of Locomotion, R.M. Herman, S. Grillner, P.S.G. Stein, & D.G. Stuart (Eds), Plenum Press, New York, 1976, pp. 265-292

Eckert, Roger, Paramecium, the Ionic Basis of Sensorimotor Behaviour, in Comparative Neuroscience and Neurobiology: Readings from the Encyclopedia of Neuroscience, Louis N. Irwin (ed.), 1988, Birkhauser, Boston, pp. 97-99

Erber, Joachim, Honeybee Learning, in Comparative Neuroscience and Neurobiology: Readings from the Encyclopedia of Neuroscience, Louis N. Irwin (ed.), 1988, Birkhauser, Boston, p. 47

Kandel, Eric R., Small Systems of Neurons, in The Brain, a Scientific American Book, 1979, W.H. Freeman and co., New York, pp. 28-38

Kupfermann, I., K.R. Weiss, The Command Neuron Concept, Behavioural Brain Science, 1978, pp. 1:3-39

Lent, Charles M., Michael H. Dickinson, The Neurobiology of Feeding in Leeches, Scientific American, June 1988, vol. 258, no. 6, pp. 98-103

Lockery, Shawn R., G. Wittenburg, W.B. Kristan Jr., N. Qian, and Terrence Sejnowski, Neural Network Analysis of Distributed Representations of Sensory Information in the Leech, Neural Information Processing Systems 2, David Touretzky ed., Morgan Kaufmann Publishers, 1990

Lockery, Shawn R., Yan Fang, Terrence Sejnowski, A Dynamic Neural Network Model of Sensorimotor Transformations in the Leech, in Neural Computation, vol. 2, no. 3, pp. 274-282

Ruppell, Georg, Kinematic and Behavioural Aspects of Flight of the Male Banded Agrion, Calopteryx (Agrion) Splendens L., in Insect Locomotion, Michael Gewecke and Gernot Wendler (eds.), Verlag Paul Parey, 1985, pp. 195-204

Stabel, Jasmine, Gernot Wendler, Hans Scharstein, The Escape Reaction of Acheta Domesticus Under Open Loop Conditions, in Insect Locomotion, Michael Gewecke and Gernot Wendler (eds.), Verlag Paul Parey, 1985, pp. 79-85

Truman, James W., Metamorphosis (Caterpillars, Moths), in Comparative Neuroscience and Neurobiology: Readings from the Encyclopedia of Neuroscience, Louis N. Irwin (ed.), 1988, Birkhauser, Boston, pp. 76-78


Neuroethology - Miscellaneous
-----------------------------

Neuroethology is the study of the neural control of behaviour. The neuro-architectures employed by biological nervous systems can lead to elegant and robust neural networks for the intelligent control of distributed systems.

Camhi, Jeffrey M., Neuroethology: Nerve Cells and the Natural Behaviour of Animals, Sinauer Associates Inc. Publishers, Sunderland, Massachusetts, 1984

Cliff, D.T., Computational Neuroethology: A Provisional Manifesto, Cognitive Science Research Paper, Serial No. CSRP 11111162, May 1990, The University of Sussex, School of Cognitive and Computing Science, Falmer, Brighton BN1 9QN, England, UK

Coss, Richard G., Albert Globus, Spine Stems on Tectal Interneurons in Jewel Fish are Shortened by Social Stimulation, Science,   vol. 200. 19 May 1978, pp. 787-789

Crick, Francis, Function of the thalamic reticular complex: the searchlight hypothesis, Proceedings of the National Academy of Sciences, 1984, 81: 4586-4590

Crick, Francis, The Brain, Scientific American, 1977

Creutzfeldt O.D. & P. Huggelund, Science, 1975, vol. 188, pp. 1025-1027

Delcomyn, Fred, Neural Basis of Rhythmic Behavior in Animals, Science, vol. 210, 31 Oct. 1980, pp. 492-498

Drawbaugh, Donald W., Toward a Model of the Hippocampus, in Proceedings of the International Joint Conference on Neural Networks, San Diego, 1990, pp. II:717-721

Dumont, James P.C., R. Meldrum Robertson, Neuronal Circuits: An Evolutionary Perspective, Science, vol. 233, 22 Aug. 1986, pp. 849-852

Fair, Charles M., Memory and Central Nervous Organization, Paragon House Publishers, New York, 1988

Guthrie D.M., Neuroethology: An Introduction, Blackwell Scientific Publications, Oxford, 1980

Heron W., et al, In Sensory Deprivation, P. Solomon et al., eds., pp 66666666-33, Harvard University Press, 1961

Hyde, Vickie, Momentum: The Rhythms of Life, Japan Times, Oct. 18, 1988, p. 10

Masino, Tom, Eric I. Knudsen, Horizontal and Vertical components of Head Movement are Controlled by Distinct Neural Circuits in the

Barn Owl, Nature, May 31, 1990, vol. 345, pp. 434-437

Nottebohm, Fernando, Birdsong, in Comparative Neuroscience and Neurobiology: Readings from the Encyclopedia of Neuroscience, Louis N. Irwin (ed.), 1988, Birkhauser, Boston, pp. 9-12

Olmsted, David, The Reticular Formation as a Multi-Valued Logic Neural Network, in Proceedings of the International Joint Conference on Neural Networks, San Diego, 1990, pp. I: 619-624

Pellionisz, Andreas J., R. Llinas, D.H. Perkel, A computer model of the cerebellar cortex of the frog, Neuroscience, 1977, vol. 2, pp. 19-36

Reichert, H., C.H.F. Rowell, C. Griss, Course Correction Circuitry Translates Feature Detection into Behavioural Action in Locusts, Nature, vol. 351, 9 May 1985, pp. 142-144

Shadmehr, Reza, Gary D. Lindquist, A Neural Network for Pattern Generation in the Scratch Reflex, in Proceedings of the 1988 International Joint Conference on Neural Networks, pp. II:25-32

Stein, Barry E., H.P. Clamann, S.J. Goldberg, Superior Collicus: Control of Eye Movements in Neonatal Kittens, Science, vol. 210, 3 Oct. 1980, pp. 78-80

Stein, Paul S.G., Intrinsic Capabilities of Neural Networks in the Turtle Spinal Cord: Selection and Generation of Motor Patterns, in Proceedings of the International   Joint Conference on Neural Networks, San Diego, 1990, pp. II:669-674

Treffner, Ecological Connectionism and Animal-Environment Mutuality, 1987 International Joint Conference on Neural Networks, pp. II: 813-820


Neurophysiology
---------------

Aoki, Chiye, Philip Siekevitz, Plasticity in Brain Development, Scientific American, Dec. 1988, vol. 258, no. 12, pp. 34-42

Braitenberg, Valentino, Brains, Structural Similarities of, in Comparative Neuroscience and Neurobiology: Readings from the Encyclopedia of Neuroscience, Louis N. Irwin (ed.), 1988, Birkhauser, Boston, pp. 18-19

Bras, Helene, Paul Gogan, Suzanne Tyc-Dumont, The Mammalian Central Neurone is a Complex Computing Device, in Proceedings of the IEEE First International Conference on Neural Networks, San Diego, 1987, pp. IV: 123-126

Crick, Francis, Brain Physiology, in Parallel Distributed Processing, vol 2, Rumelhart & McClelland, Eds., MIT Press, Cambridge MA, 1987

Dawes, R.L., Biomasscomp: A Procedure for Mapping the Architecture of a Living Neural Network into a Machine, in Proceedings of the First IEEE International Conference on Neural Networks, San Diego, 1987, pp. III: 215-225

Durbin, Richard, Nematode C. elegans, Nervous System, in Comparative Neuroscience and Neurobiology: Readings from the Encyclopedia of Neuroscience, Louis N. Irwin (ed.), 1988, Birkhauser, Boston, pp. 82-83

Gardner, Daniel, Synaptic Diversity Characterizes Biological Neural Nets, IEEE First International Conference on Neural Networks, San Diego, 1987, pp. IV: 17-22

Gottlieb, David I., GABAergic Neurons, Scientific American, vol. 258, no. 2, Feb. 1988

Jerison, Harry J., Brain Size, in Comparative Neuroscience and Neurobiology: Readings from the Encyclopedia of Neuroscience, Louis N. Irwin (ed.), 1988, Birkhauser, Boston, pp. 15-17

Kimelberg, Harold K., & Michael D. Norenberg, Astrocytes, Scientific American, April 1989, vol. 260, no. 4, pp. 66-76

Koopowitz, Harold, Brain, Primitive, Flatworms, in Comparative Neuroscience and Neurobiology: Readings from the Encyclopedia of Neuroscience, Louis N. Irwin (ed.), 1988, Birkhauser, Boston, pp. 13-14

Nauta, Walle J.H., Michael Feirtag, The Organization of the Brain, in The Brain, a Scientific American Book, 1979, W.H. Freeman and co., New York, pp. 40-53

Ridgway, Sam H., The Cetacean Central Nervous System, in Comparative Neuroscience and Neurobiology: Readings from the Encyclopedia of Neuroscience, Louis N. Irwin (ed.), 1988, Birkhauser, Boston, pp. 20-25

Stevens, John K., Reverse Engineering the Brain, BYTE, April 1985, pp 287-299

Stevens, Charles F., The Neuron, in The Brain, a Scientific American Book, 1979, W.H. Freeman and co., New York, pp. 14-25

Young, J.Z., Octopus Brain, in Comparative Neuroscience and Neurobiology: Readings from the Encyclopedia of Neuroscience, Louis N. Irwin (ed.), 1988, Birkhauser, Boston, pp. 97-99


Robotic Control - General
-------------------------

See also Vehicles

This is an area of research which is slowly emerging as an important field of study in neural networks. Most of the problems associated with robotic task planning and execution have been individually attacked using neural networks, but a central unifying vision is still lacking
(cf. Brooks, Minsky, Ozguner for attempts at decentralized distributed control).

Arbib, M.A., G.F. Franklin, N. Nilsson, Some Ideas on Information Processing in the Cerebellum, in Neural Networks: Proceedings of the School on Neural Networks, June 1967 in Ravello, E.R. Caianello, editor,    1968, Springer-Verlag Berlin, pp. 43-58

Blackburn M.R., and H.G. Nguyen, An Artificial Neural Network for Autonomous Undersea Vehicles, Naval Ocean Systems Center, San Diego CA, July 1988, Technical document 1318

Donnett, Jim, Tim Smithers, Neuronal Group Selection Theory, A Grounding in Robotics, Neural Information Processing Systems 2, David Touretzky ed., Morgan Kaufmann Publishers, 1990, pp. 308-315

Durrant-Whyte, Hugh. F., Integration, Coordination and Control of Multi-Sensor Robot Systems, Kluwer Academic Publishers, Boston, 1988

Fu, K. S., R.C. Gonzalez, C.S.G. Lee, Robotics: Control, Sensing, Vision, and Intelligence, McGraw Hill, 1987

Goldberg, Barak Pearlmutter, Using Back Propagation with Temporal Windows to Learn the Dynamics of the CMU Direct Drive Arm II, Neural Information Processing Systems 1, pp. 356-363

Graf, Lalonde, A Neural Controller for Collision Free Movement of General Robotic Manipulators, 1988 International Joint Conference on Neural Networks, pp. I: 7777777-84

Kung, Sun-Yuan, Jenq-Neng Hwang, Neural Network Architectures for Robotic Applications, IEEE Transactions on Robotics and Automation, vol. 5, no. 5, Oct. 1989, pp. 641-657

Kuperstein, Michael, Jorge Rubinstein, Implementation of an Adaptive Neural Controller for Sensory-Motor Coordination, IEEE Control Systems Magazine, April 1989, pp. 25-30

Lee, Sukhan, Rhee M. Kil, Robot Kinematic Control Based on Bidirectional Mapping Neural Network, in Proceedings of the International Joint Conference on Neural Networks, 1990, pp. III: 327-335

Niznic, Carol A., Wayne Hoss, Charles Watts, Modelling and Mathematical Formalism for Robotic Cerebellar Neural Network Pathway Information Measures, in Proceedings of the First IEEE International Conference on Neural Networks, San Diego, 1987, pp. IV: 583-591

Ritter, Schulten, Using Kohonen's Net for Motor Control and Perception, 1988 International Joint Conference on Neural Networks, pp. I: 109-116


Robotic Control - Layered Control
---------------------------------

Bellingham, James G., Thomas R. Consi, Robert M. Beaton, William Hall, Keeping Layered Control Simple, Proceedings of the IEEE Symposium on Autonomous Underwater Vehicle Technology, June 5 and 6, 1990, Washington D.C., pp. 3-8

Brooks, Rodney A.,      A Robust Layered Control System for a Mobile Robot, IEEE Journal of Robotics and Automation, vol. RA-2, no. 1, March 1986, pp. 14-23

McCulloch, Walter S., Logic and Closed Loops for a Computer Junket to Mars, in Neural Networks: Proceedings of the School on Neural Networks, June 1967 in Ravello, E.R. Caianello, editor,1968, Springer-Verlag Berlin, pp. 65-91

Nagata, Shigemi, Minoru Sekiguchi, Kazuo Asakawa, Mobile Robot Control by a Structured Hierarchical Neural Network, IEEE Control Systems Magazine, April 1990, pp. 69-76

Ozguner, U., Decentralized and Distributed Control Approaches and Algorithms, Proceedings of the 28th Conference on Decision and Control, Tampa Florida, Dec, 1989, pp. 1289-1294


Robotic Control - Manipulators
------------------------------

Gardner, Esther P., What the Robot's Hand Should Tell the Robot's Brain, in Proceedings of the 1988 International Joint Conference on Neural Networks, pp. II: 557-565

Grupen, Roderic A., Thomas C. Henderson & Ian D. McCammon, A Survey of General-Purpose Manipulation, International Journal of Robotics Research, Feb. 1989, vol. 8, no. 1, pp. 38-62

Iberall, Thea, A Ballpark Approach to Modelling Human Prehension, in Proceedings of the First IEEE International Conference on Neural Networks, San Diego, 1987, pp. IV: 535-543

Jacobsen, C., E. Wood, F. Knutti, B. Biggers, The UTAH/MIT Dextrous Hand: Work in Progress, International Journal of Robotics Research, Winter 1984, vol. 3, no. 4, pp. 21-50

Tsutsumi, Kazuyoshi, Haruya Matsumoto, Neural Computation and Learning Strategy for Manipulator Position Control, in Proceedings of the First IEEE International Conference on Neural Networks, San Diego, 1987, pp. IV: 525-534


Robotics - Vehicles
-------------------

See also Robotic Control and Proprioceptive Sensing

The motivated behaviours of the systems inspired by Braitenberg's classic Vehicles are among the most sophisticated and robust ever achieved by artificial intelligence systems (cf. Brooks, 1986). For the most part still overlooked by the mainstream, this notion for intelligent control will probably be the most fruitful of all AI methodologies in the future.

Beer, Randall B., Hillel S. Chiel, and Leon S. Sterling, A Biological Perspective on Autonomous Agent Design, in P. Maes (Ed.) New Architectures for Autonomous Agents, MIT Press and Elsevier North Holland, 1990

Braitenberg, Valentino, Vehicles: Experiments in Synthetic Psychology, MIT Press, Cambridge, 1984

Brooks, Rodney A., A Robust Layered Control System for a Mobile Robot,    IEEE Journal of Robotics and Automation, vol. RA-2, no. 1, March 1986, pp. 14-23

Connell, Jonathon, The Omni Photovore, Omni Magazine, November 1988, pp. 201-212

Nagata, Shigemi, Minoru Sekiguchi, Kazuo Asakawa, Mobile Robot Control by a Structured Hierarchical Neural Network, IEEE Control Systems Magazine, April 1990, pp. 69-76

Reynolds, CraigDistributed Control for Intelligent Systems, in review for Neural Information Processing Systems vol. 3, Morgan Kaufmann, 1991

Reynolds, Craig W., Flocks, Herds, and Schools: A Distributed Behavioural Model, ACM Computer Graphics, vol. 21, no. 4, July 1987, pp. 25-34

Wilhelms, Jane, and Robert Skinner, A "Notion" for Interactive Behavioral Animation Control, IEEE Computer Graphics and Applications, May 1990, pp. 14-22


Self Organizing Feature Nets and Vector Quantization
----------------------------------------------------

Ahalt, Stanley C., Ashok K. Krishnamurthy, Prakoon Chen, Douglas E. Melton, Competitive Learning Algorithms for Vector Quantization, Neural Networks, vol. 3, no. 3, 1990, pp. 277-290

Baras, John S., Anthony La Vigna, Convergence of Kohonen's Learning Vector Quantization, in Proceedings of the International Joint Conference on Neural Networks, 1990, pp. III: 17-20

DeSieno, Duane, Adding a Conscience to Competitive Learning, 1988 International Joint Conference on Neural Networks, pp. I: 117-124

Kangas, Teuvo Kohonen, Laaksonen, Simula, Venta, Variants of Self Organizing Maps Using Minimal Spanning Trees, 1989 International Joint Conference on Neural Networks, pp. II: 517-522

Kohonen, Teuvo, K. Makisara, Representation of Sensory Information in Self-Organizing Feature Maps, in AIP Conference Proceedings 151: Neural Networks for Computing, Snowbird UT, 1986, John S. Denker ed., pp. 271-276

Kohonen, Teuvo, A Neural Phonetic Typewriter, IEEE Computer Magazine, March 1988, vol. 21, no. 3, pp. 11-22

Kohonen, Teuvo, Improved Versions of Learning Vector Quantization, in Proceedings of the International Joint Conference on Neural Networks, San Diego, 1990, pp. I:545-550

Koikkalainen, Pasi, Erkki Oja, Self Organizing Hierarchical Feature Maps, in Proceedings of the International Joint Conference on Neural Networks, San Diego, 1990, pp. II:279-284

Stojanovski, Jordan, Artificial Neural Network for Mapping, in Proceedings of the International Joint Conference on Neural Networks, Washington D.C., 1989

Tanaka, Takehisa, Motohiko Naka, Kunio Yoshida, Improved Back-Propagation Combined with LVQ, in Proceedings of the International Joint Conference on Neural Networks, Washington D.C., 1990, pp. I: 731-734

Xu, Lei, Erkki Oja, Adding Top-Down Expectation into the Learning Procedure of Self-Organizing Maps, in Proceedings of the International Joint Conference on Neural Networks, Washington D......C., 1990, pp. I: 735-738


Sensor Fusion
-------------

Eggers, Mitch, Tim Khuon, Neural Network Data Fusion Concepts and Application, in Proceedings of the International Joint Conference on Neural Networks, San Diego, 1990, pp. II:7-16

Moravec, Hans, Sensor Fusion in Uncertainty Grids for Mobile Robots, in Annual Research Review of the Robotics Institute, Carnegie Mellon University, 1987, pp. 33-48

Rajapakse, Jagath, Raj Acharya, Multi Sensor Data Fusion within Hierarchical Neural Networks, International Joint Conference on Neural Networks, San Diego, 1990, pp. II:17-22


Signal Processing - Biological
------------------------------

de Boer, Egbert, Pattern Recognition of Spectral Information in Hearing, in Organization of Neural Networks: Structures and Models, W.      von Seelen ed., VCH Verlagsgesellschaft mbH, Weinheim, 1988, pp. 17-30, pp. 31-49

Elsner, Popov, Neuroethology of Acoustic Communication, in Advances in Insect Physiology, vol. 13, 1978, Academic Press, NY, pp. 299-355

Evans, E.F., Upper and Lower    Levels of the Auditory System: A Contrast of Structure and Function, in Neural Networks: Proceedings of the School on Neural Networks, June 1967 in Ravello, E.R. Ciaanello, editor, 1968, Springer-Verlag Berlin

Mead, Carver, The Artificial Cochlea, Proceedings of the International Joint Conference on Neural Networks

Schreiner, Christoph E., Merzenich, Michael M., Elements of Signal Coding in the Auditory Nervous System, in Organization of Neural Networks: Structures and Models, W. von Seelen ed., VCH Verlagsgesellschaft mbH, Weinheim, 1988, pp. 17-30

Shamma, Shihab A., Neural Networks for Speech Processing and Recognition, in Proceedings of the First IEEE International Conference on Neural Networks, San Diego, 1987, pp. IV: 397-405

Travis, Bryan, A Layered Neural Network Applied to the Auditory System, in AIP Conference Proceedings 151: Neural Networks for Computing, Snowbird, UT 1986, John S. Denker, ed., pp. 432-438

Travis, Bryan, Computational Model of Auditory Cortex, Proceedings   of the IEEE First International Conference on Neural Networks, San Diego, 1987, pp. IV:67-71


Signal Processing - Multi-Signal Separation
-------------------------------------------

See also Sonar and Radar Signal Processing, and Sound Source Localization and Biological Signal Processing

The separation and processing of multiple signals is uncharted territory. Spatio-temporal signal processing with neural networks remains largely an unsolved problem, and therefore little progress
in the related subordinate fields has been made.

Eggers, Mitch, Tim Khuon, Neural Network Data Fusion Concepts and Application, in Proceedings of the International Joint Conference on Neural Networks, San Diego, 1990, pp. II:7-16

Hassoun, Song, Shen, Spitzer, Self Organizing Auto-Associative Dynamic Multiple Layer Neural Network for the Decomposition of Repetitive Superimposed Signals, in Proceedings of the International Joint Conference on Neural Networks, Washington D.C., 1990, pp. I: 621-626

Jelonek, Thomas M., James P. Reilly, Maximum Likelihood Estimation for Direction of Arrival using a Nonlinear Optimizing Neural Network, in Proceedings of the International Joint Conference on Neural Networks, San Diego, 1990, pp. I: 253-258

Kassebaum, John, Manoel Fernando Tenorio, Christoph Scaefers, The Cocktail Party Problem, Neural Information Processing Systems 2, David Touretzky ed., Morgan Kaufmann Publishers, 1990, pp. 542-549

Kohonen, Teuvo, Kimmo Raivio, Olli Simula, Olli Venta, Jukka Henriksson, Combining Linear Equalization and Self-Organizing Adaptation in Dynamic Discrete-Signal Detection, in Proceedings of the International Joint Conference on Neural Networks, San Diego, 1990, pp. I: 223-228

Murano, Kazuo, Shigeyuki Unagami, Fumio Amano, Echo Cancellation and Applications, IEEE Communications Magazine, January 1990, pp. 49-55

Sung, Sinmo, Fredric M. Ham, Wesley Shelton, A New Robust Neural Network Method for Coherent Interference Rejection in Adaptive Array Systems, in Proceedings of the International Joint   Conference on Neural Networks, San Diego, 1990, pp. II:119-124

Wan, Kovacs, Rosen, Widrow, Development of Neural Net Interfaces for Direct Control of Neuroprosthesis, 1990 International Joint Conference on Neural Networks, pp. II: 3-21


Signal Processing - Sonar and Radar
-----------------------------------

Most of these applications involve analysis of the spectral content of returned sonar or radar signals to characterize or identify targets. Almost all use back propagation or a variant thereof to learn certain exemplar patterns; almost all report good results but long training times. Note that few of these applications involve spatio-temporal signal processing. In most cases, sonar or radar returns are represented as static patterns which are presented to static neural  networks.

Ahalt, Garber, Jouny, Krishnamurtha, Performance of Synthetic Neural Net Classification of Noisy Radar Signals, Neural Information Processing Systems 1, pp. 281-288

Decatur, Application of Neural Networks to Radar Terrain Classification, 1989 International Joint Conference on Neural Networks, pp. I: 283-288

Farhat, Bai, Echo Inversion and Target Shape Estimation by Neuromorphic Processing, Neural Networks, pp. 117-126

Khotanzad, Lu, Srinath, Target Detection Using a Neural Network Based Passive Sonar System, 1989 International Joint Conference on Neural Networks, pp. I: 335-340

Kuczewski, Neural Network Approaches to Multi-Target Tracking, 1987 International Joint Conference on Neural Networks, pp. IV: 619-633

Orlando, Mann, Haykin, Radar Classification of Sea Ice Using Traditional and Neural Classifiers, 1990 International Joint Conference on Neural Networks, pp. II: 263-266

Ramani, Patrick, Hanson, Anderson, Fish Detection and Classification Using a Neural Network   Based Active Sonar System, 1990 International Joint Conference on Neural Networks, pp. II: 527-530

Roitblat, Moore, Nachtigall, Penner, Au, Dolphin Echolocation-Identification of Returning Echoes Using a Counter Propagation Network, 1989 International Joint Conference on Neural Networks, pp. I: 295-300

Roth, Neural Networks for Extraction of Weak Targets in High Clutter Environments, 1989 International Joint Conference on Neural Networks, pp. I: 275-282

Schiling Mastebroek, Zaegman, An Adaptive Heterodyne Filtering Procedure for the Imaging of Moving Objects, Neural Information Processing Systems, pp. 662-673

Vrckovnik, Chung, Carter, An Application of Neural Networks to Impulse Radar Waveforms for Asphalt Covered Bridge Decks, International Joint Conference on Neural Networks, San Diego, 1990, pp. II: 453-456

Wang, Wu, Ziemer, Application of Neural Networks to Pulse Doppler Radar Systems for Moving Target Indication, in Proceedings of the International Joint Conference on Neural Networks, San Diego, 1990, pp. II: 271-274

Winters, Jack H., Super-resolution for Ultrasonic Imaging in Air Using Neural Networks, 1988 International Joint Conference on Neural Networks, pp. I: 609-616


Signal Processing - Sound Source Localization
---------------------------------------------

Much progress has been made in understanding the biological mechanisms for sound source localization. Rigorous studies by Konishi and Suga of the owl and the bat have formed the basis of almost all the data available. With the exception of Mead's silicon cochlea and auditory localization mechanisms, this detailed neurophysiological knowledge stands waiting for application, and is thus an important untapped resource.

Carr, Masakazu Konishi, Proceedings of the National Academy of Sciences, vol. 85, pp. 8311-8315

Knudsen, Eric I., Masakazu Konishi, A Neural Map of Auditory Space in the Owl, Science, vol. 200, May 19, 1978, pp. 795-797

Kuwada, Shigeyuki, Tom C.T. Yin, Robert E. Wickesberg, Response of Cat Inferior Collicus Neurons to Binaural Beat Stimuli: Possible Mechanisms for Sound Localization, Science, vol 206, Nov. 2, 1979, pp. 586-588

Lazzaro, John, Carver Mead, A Silicon Model of Auditory Localization, Neural Computation, David Touretzky ed., Morgan Kaufmann Publishers, 1989, vol. 1, no. 1, pp. 47-57

Manley, Geoffrey A., Christine Koeppl, Masakazu. Konishi, A Map of Interaural Intensity Differences in the Brainstem of the Barn Owl, Journal of Neuroscience, Aug. 1988, vol. 8, no. 8, pp. 2665-2676

Simmons, J.A........, Acoustic Imaging Computations by Bats: Unification of Diversely Represented Stimulus Features into Whole Images, Neural Information Processing Systems 2, D. Touretzky, ed, Morgan Kaufmann Publishers, 1990, pp. 2-9

Simmons, James A., Lynda Chen, The Acoustic Basis for Target Discrimination by FM Echolocating Bats, Journal of the Acoustic Society of America, vol. 86, no. 4, Oct. 1989, pp. 1333-1350

Simmons, James A., Donna Howell, Nobuo Suga, Information Content of Bat Sonar Echoes, American Scientist, vol. 63, no. 2, Mar.-Apr. 1975, pp. 204-215

Simmons, J.A., E.G. Freedman, S.B. Stevenson, L. Chen, T.J. Wohlgenant, Clutter Interference and the Integration Time of Echoes in the Echolocating Bat, Eptesicus Fuscus, Journal of the Acoustic Society of America, vol. 86, no. 4, Oct. 1989, pp. 1318-1332

Spence, C.D., J.C. Pearson, Computation of Sound Source Elevation in the Barn Owl, Neural Information Processing Systems 2, D. Touretzky, ed, Morgan Kaufmann Publishers, 1990, pp. 10-17

Spence, C.D., J.C. Pearson, Gelfland, Peterson, Neuronal Maps for Sensory Motor Control in the Barn Owl, Neural Information Processing Systems 1, David Touretzky ed., Morgan Kaufmann Publishers, 1989, pp. 366-374

Suga, Nobuo, Cortical Computational Maps for Auditory Imaging, Neural Networks, 1990, vol. 3, no. 1, pp. 3-21

Suga, Nobuo, Biosonar and Neural Computation in Bats, Scientific American, June 1990, vol. 262, no. 6, pp. 60-68

Sugie, Noboru, Jie Huang, Noboru Ohnishi, Localizing Sound    Source by Incorporating a Biological Auditory Mechanism, 1988 International Joint Conference on Neural Networks, pp. II: 243-250

Sussman, Harvey M., Neural Coding of Relational Invariance in Speech - Human Language Analogues to the Barn Owl, Psychological Review, 1989, vol. 96, no. 4, pp. 631-642

Wagner, Takahashi, Konishi, Journal of Neuroscience, 1987, vol. 7, p. 3114


Signal Processing - SpatioTemporal
----------------------------------

Despite the large number of references listed for this section, spatio-temporal signal processing by neural networks remains one of the most important unsolved problems. The major players in this arena are the proponents of recurrent back propagation methods (cf. Pearlmutter, 1989), Fukushima's latest versions of the NeoCognitron, Kohonen's Self Organizing Feature Nets, and Waibel's Time Delay Neural Networks (TDNN).

Of these methods, the NeoCognitroarpenter and Grossberg's Adaptive Resonance Theory has yet to prove itself for this application.


Of these methods, the NeoCognitron and TDNN show the most promise for robust performance. Sharing many similarities, the principle feature of these networks is progressive hierarchical feature extraction.

Beroule, Dominique, Guided Propagation Inside a Topographic Memory, in Proceedings of the First IEEE International Conference on Neural Networks, San Diego, 1987, pp. IV: 469-476

Dayhoff, Judith E., Regularity Properties in Pulse Transmission Networks, in Proceedings of the International Joint Conference on Neural Networks,   San Diego, 1990, pp. III: 621-626

Gluck, Parker, Reifsnider, Learning with Temporal Derivatives in Pulse Coded Neural Systems, Neural Information Processing Systems 1, pp. 195-203

Lippmann, Richard P., Beckman, Adaptive Neural Net Preprocessing for Signal Detection in Non-Gaussian Noise, Neural Information Processing Systems 1, pp. 124-132

Luria, A model of speech generation and perception, 1977

Neumann, Wheeler, Burnside, Bernstein, Hall, A Technique for the Classification and Analysis of    Insect Courtship Song, 1990 International Joint Conference on Neural Networks, pp. II: 257-262

Ogmen, Haluk, Simon Gagne, Early Spatio-Temporal Integration by Gated Competitive Networks, in Proceedings of the First IEEE International Conference on Neural Networks, San Diego, 1987, pp. II:805-811

Paris, Orsark, Varanasai, Aazhang, Neural Net Receivers in Multiple Access Communications, Neural Information Processing Systems 1, pp. 272-280

Pearlmutter, Barak, Learning State Space Trajectories in Recurrent Neural Networks, 1989 International Joint Conference on Neural Networks, pp. II: 365-372

Szu, Scheff, Simulated Annealing Feature Extraction from Occluded and Cluttered Objects, 1990 International Joint Conference on Neural Networks, pp. II: 76-79

Szu, Foo, Space Scanning Curves for Spatio Temporal Representations Useful for Large Scale Neural Network Computing, 1990 International Joint Conference on Neural Networks, pp. II: 703-705

Uchiyama, Shimohara, Tokunaga, A Modified Leaky Integrator Network for Temporal Pattern Processing, 1989 International Joint Conference on Neural Networks, pp. I: 469-475

van den Bout, Miller, TinnMann (incl. code), in Proceedings of the 1989 International Joint Conference on Neural Networks,   pp. II: 205-211

Wan, Eric A., Temporal Backpropagation for FIR Neural Networks, in Proceedings of the International Joint Conference on Neural Networks, San Diego, 1990, pp. I: 575-580

Watson, Mark, A Neural Network Model for Phoneme Recognition

Using the Generalized Delta Rule for Connection Strength Modification (incl. code), in Proceedings of the IEEE First International Conference on Neural Networks, San Diego, 1987, pp. IV: 389-396


Tensor Network Theory
---------------------

Georgopoulos, Apostolos P., Ronald E. Kettner, Andrew B. Schwartz, Primate Motor Cortex and Free Arm Movements to Visual Targets in Three-Dimensional Space. II. Coding of the Direction of Movement by a Neuronal Population, Journal of Neuroscience, vol. 8, no. 8, Aug. 1988, pp.  2929-2937

Georgopoulos, Apostolos P., Joseph T. Lurito, Michael Petrides, Andrew B. Schwartz, Joe T. Massey, Mental Rotation of the Neuronal Population Vector, Science, vol. 243, Jan. 13, 1989, pp. 234-236

Kettner, Ronald E., Andrew B. Schwartz, Apostolos P. Georgopoulos, Primate Motor Cortex and Free Arm Movements to Visual Targets in Three-Dimensional Space. III. Positional Gradients and Population Coding of Movement Direction from Various Movement Origins, Journal of Neuroscience, vol. 8, no. 8, Aug. 1988, pp. 2938-2947

Pellionisz, Andras J., Tensor Network Theory and its Application to Computer Modeling of the Meta-organization of Sensorimotor Hierarchies of Gaze, in AIP Conference Proceedings 151: Neural Networks for Computing, Snowbird UT, 1986, John S. Denker ed., pp. 339-345

Pellionisz, Andras J., Sensorimotor Operations: a Ground for the Co-Evolution of Brain Theory with Neurobotics and Neurocomputers, in Proceedings of the First IEEE International Conference on Neural Networks, San Diego, 1987, pp. IV: 593-600

Pellionisz, Andras J., Intelligent Decisions and Dynamic Coordination Properties of Geometrical Representation by Generalized Frames Intrinsic to Neural and Robotic Systems, in Proceedings of the 1988 International Joint Conference on Neural Networks, pp. II: 603-610

Pellionisz, Andras J., Tensorial Aspects of the Multidimensional Massively Parallel Sensorimotor Function of Neuronal Networks, Progress in Brain Research, vol. 76, O. Pompeiano and J.H.J. Allum ((((((eds.), 1988, Elsevier Science Publishers B.V. (Biomedical Division), pp. 341-354

Pellionisz, Andras J., Neural Geometry: Towards a Fractal Model of Neurons, in Models of Brain Function, R.M. Cotterill (ed.), 1989, Cambridge University Press

Pellionisz, Andras J., Neural Geometry: The Need of Researching Association of Covariant and Contravariant Coordinates that Organizes a Cognitive Space by Relating Multisensory-Multimotor Representation, in Proceedings of the International Joint Conference on Neural Networks, Washington D.C., 1989

Pellionisz, Andras J., Tensor Network Model of the Cerebellum and Olivary System Quantitatively Elaborated for the Optokinetic Reflex, in Experimental Brain Research Series 17, 1989, Springer-Verlag Berlin Heidelberg, pp.400-424

Schwartz, Andrew B., Ronald E. Kettner, Apostolos P. Georgopoulos, Primate Motor Cortex and Free Arm Movements to Visual Targets in Three-Dimensional Space. I. Relationships Between Single Cell Discharge and Direction of Movement, Journal of Neuroscience, vol. 8, no. 8, Aug. 1988, pp. 2913-2927


Time Delay Neural Networks
--------------------------

Hampshire, John B., Alex Waibel, Connectionist Architecture for Multi-Speaker Phoneme Recognition, Neural Information Processing Systems 2, David Touretzky ed., Morgan Kaufmann Publishers, 1990, pp. 203-210

Hirai, Akihiro, Alexander Waibel, Phoneme-based Word Recognition by Neural Network: A Step Toward Large Vocabulary Recognition, in Proceedings of the International Joint Conference on Neural Networks, San Diego, 1990, pp. III: 671-676

Lang, Kevin J., Alex Waibel, Geoffrey Hinton, A Time Delay Neural Network for Isolated Word Recognition, Neural Networks, vol. 3, no. 1, pp. 23-44

Sawai, Hidefumi, Alex Waibel, Haffner, Miyatake, Kiyohiro Shikano, Parallelism, Hierarchy, and Scaling in Time Delay Neural Nets for Spotting Japanese Phonemes/CV Syllables, 1989 International Joint Conference on Neural Networks, pp. II: 81-88

Waibel, Alexander, Toshiyuki Hanazawa, Geoffrey Hinton,, Kiyohiro Shikano, Kevin J. Lang, Phoneme Recognition Using Time-Delay Neural Networks, IEEE Transactions on Acoustics, Speech, and Signal Processing, vol.37, no. 3, March 1989, pp. 328-339


Vision - General
----------------

Of all the components of the nervous system, the visual system is perhaps most well studied. Starting with the seminal work of Hubel and Wiesel on orientation sensitive cells in the visual cortex, understanding of the visual system has progressed rapidly. Though not yet widespread,
the most successful computer vision systems to date are those which make use of the data collected by neurophysiologists.

Asogawa, Minoru, Adaptive Input Field Neural Network that can Recognize Rotated and/or Shifted Characters, in Proceedings of the International Joint Conference on Neural Networks, San Diego, 1990, pp. I: 407-421

Dhawan, Atam P., Thomas Dufresne, Low-Level Image Processing and Edge Enhancement Using A Self Organizing Neural Network, in Proceedings of the International Joint Conference on Neural Networks, San Diego, 1990, pp. I: 503-510

Hirai, Yuzo, Yasuyuki Tsukui, Position Independent Neuro Pattern Matching and its Application to Handwritten Numerical Character Recognition, in Proceedings of the International Joint Conference on Neural Networks, San Diego, 1990, pp. I: 407-421

Hutchinson, James A., Christof Koch, Simple Analog and Hybrid Networks for Surface Interpolation, in AIP Conference Proceedings 151: Neural Networks for Computing, Snowbird UT, 1986, John S.   Denker ed., pp. 235-240

Kanizsa, Gaetano, Subjective Contours, in The Mind's Eye: Readings from Scientific American, J.M. Wolfe (ed.), New York, W.H. Freeman & Co., 1986, pp. 82-86

Lehar, Steve M., Andrew J. Worth, David N. Kennedy, Application of the Boundary Contour System/Feature Contour System to Magnetic Resonance Brain Scan Imagery, in Proceedings of the International Joint Conference on Neural Networks, San Diego, 1990, pp. I:435-440

MacKay, David J.C., Analysis of Linsker's Application of Hebbian Rules to Linear Networks, submitted to Network; an abbreviated version appears in Neural Information Processing Systems 2, Morgan Kaufmann Publishers

Mallot, Hanspeter A., Werner von Seelen, Fotios Giannakopoulos, Neural Mapping and Space-Variant Image Processing, Neural Networks, vol. 3, no. 3, 1990, pp. 245-263

Menon, Murali M., William Wells III, Massively Parallel Image Restoration, in Proceedings of the International Joint Conference on Neural Networks, San Diego, 1990, pp. I:::::: 511-516

Meuller, P., P. Spiro, D. Blackman, R.E. Furman, Neural Computation of Visual Images, in Proceedings of the IEEE First International Conference on Neural Networks, San Diego, 1987, pp. IV: 75-88

Silverman, Ronald H., Andrew S. Noetzel, Image Processing and Pattern Recognition in Ultrasonograms by Backpropagation, in Neural Networks, vol. 3, no. 5, 1990, pp. 593-604

Usui, Shiro, Shigeki Nakauchi, Masae Nakano, Reconstruction of Munsell Color-Space by a Five Layered Neural Network, in Proceedings of the International Joint Conference on Neural Networks, San Diego, 1990, pp. II:515-520

Wolfe, Jeremy M. (editor), The Mind's Eye, Readings from Scientific American, New York, W.H. Freeman & Co., 1986

York, Bryant W., Mary K. Atkins,    Some Performance Results for a Connection Machine Implementation of the Boundary Contour System, in Proceedings of the International Joint Conference on Neural Networks, San Diego, 1990, pp. I: 351-358


Vision - Image Compression
--------------------------

Work is progressing quietly on the image compression front. Compression ratios on the order of 60-75% are regularly achieved, although quality varies. As in spatio-temporal signal processing, the biggest progress seems to come from those networks which implement progressive hierarchical
feature extraction.

Daugman, John G., Relaxation Neural Network for Non-Orthogonal Image Transforms, Proceedings of the 1988 International Joint Conference on Neural Networks, pp. I: 547-560

Kanerva, Pentti Contour Map Encoding of Shape for Early Vision, Neural Information Processing Systems 2, David Touretzky, ed., Morgan Kaufmann Publishers, 1990, pp. 282-289

Manikopoulos, C., G. Antoniou, S. Metzelopoulou, LVQ of Image Sequence Source and ANS Classification of      Finite State Machine for High Compression Coding, in Proceedings of the International Joint Conference on Neural Networks, San Diego, 1990, pp. I: 481-486

Naillon, Theeten, Neural Approach to TV Image Compression using a Hopfield Type Network, Neural Information Processing Systems 1, pp. 264-271

Okamoto, Toshiaki, Mitsuo Kawato, Toshio Inui, Sei Miyake, Model Based Image Compression, Neural Information Processing Systems 2, David Touretzky ed., Morgan Kaufmann Publishers, 1990, pp. 298-305


Vision - Invertebrate
---------------------

Arnett, D.W., Receptive Field Organization of Units in the First Optic Ganglion of Diptera, Science, vol. 173, pp. 929-931

Barrington, E.J.W., Invertebrate Structure and Function, Thomas Nelson and Sons, Don Mills, Ont., 1966666669, (Photoreception, pp. 280-290)

Bouzerdoum, Abdesselam, Robert B. Pinter, A Shunting Inhibitory Motion Detector that Can Account for the Functional Characteristics of Fly Motion Sensitive Interneurons, in International Joint Conference on Neural Networks, San Diego, 1990, pp. I: 149-153

Braitenberg, Valentino, On Chiasms, in Neural Networks: Proceedings of the School on Neural Networks, June 1967 in Ravello, E.R. Ciaanello, editor, 1968, Springer-Verlag Berlin, pp. 34-42

Brodie, Scott E., Bruce W. Knight, & Floyd Ratliff, The response of the Limulus retina to moving stimuli: a prediction by Fourier analysis, Journal of General Physiology, 1978, vol. 72, pp. 129-166

Collet, T., A.J. King, Vision During Flight, in G.A. Horridge (ed.), The   Compound Eye and Vision of Insects, 1975, Claredon Press, Oxford, pp. 437-466

Horridge, G. Adrian, The Compound Eye of Insects, in The Mind's Eye: Readings from Scientific American, J.M. Wolfe (ed.), New York, W.H. Freeman & Co., 1986, pp. 24-35

Horridge, G. Adrian, I.A. Meinertzhagen, The Accuracy of the Patterns of Connexions of the First- and Second-Order Neurons of the Visual System of Calliphora, Proceedings of the Royal Society of London, Biological Sciences, vol. 175, 1970, pp. 69-82

Horridge, G. Adrian, B. Walcott, A.C. Ioannides, The Tiered Retina of Dytiscus: a New Type of Compound Eye, Proceedings of the Royal Society of London, Biological Sciences, vol. 175, 1970, pp. 83-94

Kien, J., Motion Detection in Locusts and Grasshoppers, in G.A. Horridge (ed.), The Compound Eye and Vision of Insects, 1975, Claredon Press, Oxford, pp. 410-422

Kirschfeld, Kuno, Fly, Visual System, in Comparative Neuroscience and Neurobiology: Readings from the Encyclopedia of Neuroscience, Louis N. Irwin (ed.), 1988, Birkhauser, Boston, pp. 42-43

Kruppel, Thomas, Michael Gewecke, Visually Induced Flight Manoeuvres in the Tethered Locust (Schistocerca Gregaria), in Insect Locomotion, Michael Gewecke and Gernot Wendler (eds.), Verlag Paul Parey, 1985, pp. 167-174

Macagno, Eduardo R., Ian A. Meinertzhagen, Visual System Development, Invertebrates, in Comparative Neuroscience and Neurobiology: Readings from the Encyclopedia of Neuroscience, Louis N. Irwin (ed.), 1988, Birkhauser, Boston, p. 129-132

Mazokhin-Porshnyakov, Georgii A., Insect Vision, 1969, Plenum Press, New York

Mimura, K., Units of the Optic Lobe, Especially Movement Perceptions Units of Diptera, in G.A. Horridge (ed.), The Compound Eye and Vision of Insects, 19999999999999975, Claredon Press, Oxford, pp. 423-436

Northrop, R.B., Information Processing in the Insect Compound Eye, in G.A. Horridge (ed.), The Compound Eye and Vision of Insects, 1975, Claredon Press, Oxford, pp. 378-409

Ogmen, H., S. Gagne, Neural Network Architectures for Motion Perception and Elementary Motion Detection in the Fly Visual System, in Neural Networks, vol. 3, no. 5, pp. 487-505, 1990

Poggio, Tomaso, Werner Reichardt, Visual Control of Orientation Behaviour in the Fly, Part II: Towards the Underlying Neural Interactions, Quarterly Review of Biophysics, vol. 9, no. 3, 1976, pp. 377-438

Reichardt, Werner, Tomaso Poggio, Visual Control of Orientation Behaviour in the Fly, Part I: A Quantitative Analysis, Quarterly Review of Biophysics, vol. 9, no. 3, 1976, pp. 311-375


Vision - Motion Perception
--------------------------

Courellis, S.H., V.Z. Marmarelis, An Artificial Neural Network for Motion Detection and Speed Estimation, in Proceedings of the International Joint Conference on Neural Networks, San Diego, 1990, pp. I: 407-421

Hutchinson, James A., Christof Koch, Jin Luo, Carver Mead, Computing Motion Using Analog and Binary Resistive Networks, IEEE Computer Magazine, vol. 21, no. 3, pp. 52-63

Tang, D.S., Neurocomputation of Image Motion, in Proceedings of the International Joint Conference on Neural Networks, San Diego, 1990, pp. I: 401-406

Zhou, Y.T., R. Chellappa, A Network for Motion Perception, in Proceedings of the International Joint Conference on Neural Networks, San Diego, 1990, pp. II:875-884


Vision - Toads and Frogs
------------------------

Betts, Bill, The Toad Optic Tectum as a Recurrent On-Center Off-Surround Neural Net with Quenching Threshold, in Proceedings of the 1988 International Joint Conference on Neural Networks, pp. II: 47-54

Gaze, R.M., M.J. Keating, G. Szekely, Lynda Beazley, Binocular Interaction in the Formation of Specific Intertectal Neuronal Connexions, Proceedings of the Royal Society of London, Biological Sciences, vol. 175, 1970, pp. 104-147

Katz, Lawrence C., Martha Constantine-Paton, Relationships Between Segregated Afferents and Postsynaptic Neurons in the Optic Tectum of Three-Eyed Frogs, Journal of Neuroscience, vol. 8, no. 9, September 1988, pp. 3160-3180

Lettvin, J.Y., H.R. Maturana, W.S. McCulloch, & W.H. Pitts, What the Frog's Eye Tells the Frog's Brain, Proceedings of the IRE, vol 47, no. 11, November 1959, pp. 1940-1959

Wang, Deliang, Michael A. Arbib, Mechanisms of Pattern Discrimination in the Toad's Visual System, in Proceedings of the International Joint Conference on Neural Networks, San Diego, 1990, pp. II:477-482


Vision - Vertebrate
-------------------

Ahumada, Albert J. Jr, Simulated Annealing in Networks for Computing Possible Arrangements for Red and Green Cones, in Proceedings ceedings of the IEEE First International Conference on Neural Networks, San Diego, 1987, pp. IV: 107-114

Bienenstock, Elie L., Leon N. Cooper, & Paul W. Munro, Theory for the development of neuron selectivity: orientation specificity and binocular interaction in the visual cortex, Journal of Neuroscience, 1982, vol. 2, pp. 32-48

Bruce, Vicki, Patrick R. Green, Visual Perception: Physiology, Psychology, and Ecology, Lawrence Erlbaum Associates, Hillsdale NJ, 1985

Grossberg, Stephen, Cortical Dynamics of Three-Dimensional Form, Color, and Brightness Perception, I: Monocular Theory, Perception and Psychophysics, 1987, vol. 41, no. 2, pp. 87-116

Grossberg, Stephen, Cortical Dynamics of Three-Dimensional Form, Color, and Brightness Perception, II: Binocular Theory, Perception and Psychophysics, 1987, vol. 41, no. 2, pp. 117-158

Grossberg, Stephen, Ennio Mingolla, Computer Simulation of Neural Networks for Perceptual Psychology, Behavior Research Methods, Instruments, and Computers, 1986, vol. 18, no. 6, pp. 601-607

Grossberg, Stephen, Dejan Todorovic, Neural Dynamics of 1-D and 2-D Brightness Perception: A Unified Model of Classical and Recent Phenomena, in Neural Networks and Natural Intelligence, Stephen Grossberg, editor, MIT Press, Cambridge MA, 1988, pp. 127-194

Hubel David H., Torsten N. Wiesel, Receptive fields, binocular interaction and functional architecture in the cat's visual cortex, Journal of Physiology (London), 1962, vol 160, pp. 106-154

Hubel David H., Torsten N. Wiesel, Brain Mechanisms of Vision, in The Brain, a Scientific American Book, 1979, W.H. Freeman and co., New York, pp. 84-96

Loebner, Egon E., Concurrency Assurance in Vertebrate Retinas, in Proceedings of the First IEEE International Conference on Neural Networks, San Diego, 1987, pp. IV: 147-159

Poggio, Gian F., Francisco Gonzalez, Friedemann Krause, Stereoscopic Mechanisms in Monkey Visual Cortex: Binocular Correlation and Disparity Selectivity, Journal of Neuroscience, Dec. 1988, vol. 8, no. 12, pp. 4531-4550

Schiller, Peter H., Sean D. True, Janet L. Conway, Effects of Frontal Eye Field and Superior Collicus Ablations on Eye Movements, Science, vol 206, Nov. 2 1979, pp. 590-592

Schrodinger, E., On the Trichromatic and Opponent-Process Theories, translated by Keith K. Niall, Spatial Vision, vol. 3, no. 2, 1988, pp. 79-95

Seelen, W. v., H.A. Mallot, F. Giannakopoulos, E. Schulze, Properties of Cortical Systems - A Basis for Computer Vision, in Proceedings of the IEEE First International Conference on Neural Networks, San Diego, 1987, pp. IV: 89-96

von der Marlsburg, Christoph, Self Organization of Orientation Sensitive Cells in the Striate Cortex, Kybernetik, vol 14, pp. 85-100

Wiesel Torsten N., & David H. Hubel, Spatial and Chromatic interactions in the lateral geniculate body of the rhesus monkey, Journal of Neurophysiology, 1966, vol. 29, pp. 1115-1156


Neural VLSI
-----------

Card, H.C., W.R. Moore, Silicon Models of Associative Learning in Aplysia, Neural Networks, vo, vol. 3, no. 3, 1990, pp. 333-346

Culhane, Andrew D., Martin C. Peckerar, A Neural Net Approach to Discrete Hartley and Fourier Transforms, IEEE Transactions on Circuits and Systems, vol. 36, no. 5, May 1989, pp. 695-703

Koch, Christoph, Wyeth Bair, John G. Harris, Timothy Horiuchi, Andrew Hsu, Jin Luo, Real Time Computer Vision and Robotics Using Analog VLSI Circuits, Neural Information Processing Systems 2, David Touretzky ed., Morgan Kaufmann Publishers, 1990, pp. 750-757

Lazzaro, John, Carver Mead, A Silicon Model of Auditory Localization, Neural Computation, David Touretzky ed., Morgan Kaufmann Publishers, 1989, vol. 1, no. 1, pp. 47-57

Maher, Mary Ann C., Stephen P. Deweerth, Mish A. Mahowald, Carver A. Mead, Implementing Neural Architectures Using Analog VLSI Circuits, IEEE Transactions on Circuits and Systems, vol. 36, no. 5, May 1989, pp. 643-652

Mead, Carver, The Artificial Cochlea, Proceedings of the International Joint Conference on Neural Networks...

Mead, Carver A., Silicon Models of Neural Computation, in Proceedings of the IEEE First International Conference on Neural Networks 1987, vol 1

Mead, Carver A., Analog VLSI and Neural Systems, Addison Wesley, 1989

van den Bout, David E., Thomas K. Miller III, A Digital Architecture Employing Stochasticism for the Simulation of Hopfield Neural Nets, IEEE Transactions on Circuits and Systems, vol. 36, no. 5, May 1989, pp. 732-738




<!-- Markdeep: --><style class="fallback">body{visibility:hidden;white-space:pre;font-family:monospace}</style><script src="markdeep.min.js"></script><script src="https://casual-effects.com/markdeep/latest/markdeep.min.js"></script><script>window.alreadyProcessedMarkdeep||(document.body.style.visibility="visible")</script>


<!-- Global Site Tag (gtag.js) - Google Analytics -->
<script async src="https://www.googletagmanager.com/gtag/js?id=GA_TRACKING_ID"></script>
<script>
  window.dataLayer = window.dataLayer || [];
  function gtag(){dataLayer.push(arguments);}
  gtag('js', new Date());

  gtag('config', 'UA-38190740-1');
</script>