1997/08/14 by Jun-ichi Inoue, Inoue, Jun-ichi, Hidetoshi Nishimori +3
Physics and Astronomy · #Disordered Systems and Neural Networks (cond-mat.dis-nn) #FOS: Physical sciences #cond-mat.dis-nn
paper · pdf · doi:10.48550/arxiv.cond-mat/9708096
LaTeX 10 pages including 6 ps figures, using llncs.sty, Proc. of Theoretical Aspects of Neural Computation 97, to be published from Springer-Verlag
arxiv created 1997/08/14 · arxiv updated 2009/11/30
We investigate the generalization ability of a simple perceptron trained in the off-line and on-line supervised modes. Examples are extracted from the teacher who is a non-monotonic perceptron. For this system, difficulties of training can be controlled continuously by changing a parameter of the teacher. We train the student by several learning strategies in order to obtain the theoretical lower bounds of generalization errors under various conditions. Asymptotic behavior of the learning curve has been derived, which enables us to determine the most suitable learning algorithm for a given value of the parameter controlling difficulties of training.