3/30/2017

Change the training function and know how to set initial weights and biases

Today, I found how to set initial weights and biases. In addition, I changed my training function from LM (Levenberg-Marquardt) to SCG (scaled conjugate gradient). Now the SCG training function can do iterations faster than LM.

Summary:

Today, I found how to set initial weights and biases in the neural network model. I have tried various initial weights and biases but get similar results.
By the way, I change my training function to get a new one so that my neural network model can do iterations faster than before.

The following are results I obtain today.
The first figure shows the R of training data (90% randomly) and testing data (10%).
The second and third and prediction performance, which are not very good.



Tomorrow, I will try to find more ways to improve the model.


2 comments: