Optimisation and Learning in Neural Network Learning

This paper introduces supervised learning model and surveys related research work. The paper is organised as follows. A supervised learning model is firstly described. The bias-variance trade-off is then discussed for the supervised learning model. Based on the bias-variance trade-off, both the single neural network approaches and the neural network ensemble approaches are overviewed, and the problem in the existing approaches are indicated. Finally, the paper concludes by specifying the potential future research directions.