ennsyuu

Posted by smame

Copy the project to Neural Network Console Cloud

Network Architecture : Main

Type Value
Output 0
CostParameter 0
CostAdd 0
CostMultiply 0
CostMultiplyAdd 0
CostDivision 0
CostExp 0
CostIf 0

Training Procedure : Optimizer

Optimize network “Main” using “Training” dataset.

  • Batch size : 64
  • Solver : Adam
    • Learning rate(Alpha) : 0.001
    • Beta1 : 0.9
    • Beta2 : 0.999
    • Epsilon : 1e-08
  • Weight decay is not applied.

References

  • Sony Corporation. Neural Network Console : Not just train and evaluate. You can design neural networks with fast and intuitive GUI. https://dl.sony.com/
  • Sony Corporation. Neural Network Libraries : An open source software to make research, development and implementation of neural network more efficient. https://nnabla.org/
  • ReLU – Vinod Nair, Geoffrey E. Hinton. Rectified Linear Units Improve Restricted Boltzmann Machines. http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.165.6419&rep=rep1&type=pdf
  • Adam – Kingma and Ba, Adam: A Method for Stochastic Optimization. https://arxiv.org/abs/1412.6980