Recurrent Networks Back Propagation

A recurrent neural network (also called a feedback network) allows self-loops and backward connections between all neurons in the network. The back-propagation algorithm can be altered to a recurrent neural network by adding feedback connections, and the algorithm for training the recurrent network is called recurrent back-propagation (RBP). F.J. Pineda and L. B. Almeida proposed RBP methods in 1987, independently.

The general learning procedure for an RBP includes the following steps:

• Step 1. Initialize the weights to small random values.

• Step 2. Calculate the activations of all neurons for node j:

where a(.) is the activation function, wj is the weight from i to j, xj is input to neuron i, if there is one, otherwise 0, and t is a time constant. The fixed point can be calculated by setting dyj/dt = 0. The output yj (t) is found from the recursive formula:

Was this article helpful?

0 0
10 Ways To Fight Off Cancer

10 Ways To Fight Off Cancer

Learning About 10 Ways Fight Off Cancer Can Have Amazing Benefits For Your Life The Best Tips On How To Keep This Killer At Bay Discovering that you or a loved one has cancer can be utterly terrifying. All the same, once you comprehend the causes of cancer and learn how to reverse those causes, you or your loved one may have more than a fighting chance of beating out cancer.

Get My Free Ebook

Post a comment