Ricoh Company, Ltd.

Ricoh Corporation

Ricaoh Corporation

Ronald C Keesing

David Geoffrey Stork

A method and apparatus is presented for synthesizing a network for use with pulse frequency encoded signals that has a smoothly saturating transfer characteristic for large signals based on the use of delay and an OR-gate. When connected to the output of a pulse frequency type of neuron, it results in a sigmoidal activation function.

Apparatus and method for enhancing transfer function non-linearities in

The present invention relates to the interrelationships between nature (as mediated by evolution and genetic algorithms) and nurture (as mediated by gradient-descent supervised learning) in a population of neural networks for pattern recognition. The Baldwin effect is demonstrated that learning can change the rate of evolution of the population's genome - a 'pseudo-Lamarkian' process, in which information learned is ultimately encoded in the genome by a purely Darwinian process. Selectivity is shown for this effect: too much learning or too little learning in each generation leads to slow evolution of the genome, whereas an intermediate amount leads to most rapid evolution. For a given number of learning trials throughout a population, the most rapid evolution occurs if different individuals each receive a different number of learning trials, rather than the same number. Because all biological networks possess structure due to evolution, it is important that such interactions between learning and evolution be understood. Hybrid systems can take advantage both of gradient descents (learning) and large jumps (genetic algorithms) in very complicated energy landscapes and hence may play an increasingly important role in the design of artificial neural systems.

Evolution and learning in neural networks: the number and distribution

A circuit employing logical gates for calculating activation function derivatives on stochastically encoded signals. In one embodiment a two input nonlinear circuit calculates neuron activation functions suitable for gradient-descent learning.

Growing community of inventors

Menlo Park, CA, United States of America

Ronald C Keesing