Geoffrey Hinton, professor at the University of Toronto and engineering fellow at Google Brain, recently published a paper on the Forward-Forward algorithm (FF), a technique for training neural networ ...

Obtaining the gradient of what's known as the loss function is an essential step to establish the backpropagation algorithm developed by University of Michigan researchers to train a material.

Neural networks using the backpropagation algorithm were biologically “unrealistic in almost every respect” he said. For one thing, neurons mostly send information in one direction.