| Polynomial Bounds for VC Dimension of Sigmoidal Neural Networks (1995) | |||||||||||||||
Abstract | |||||||||||||||
| We introduce a new method for proving explicit upper bounds on the VC Dimension of general functional basis networks, and prove as an application, for the first time, the VC Dimension of analog neural networks with the sigmoid activation function oe(y) = 1=1 + e \Gammay to be bounded by a quadratic polynomial in the number of programmable parameters. 1 Dept. of Computer Science, University of Bonn, 53117 Bonn, and the International Computer Science Institute, Berkeley, California. Research partially supported by the International Computer Science Institute, Berkeley, by the DFG Grant KA 673/4-1, and by the ESPRIT BR Grants 7097 and ECUS 030. Email: marek@cs.uni-bonn.de 2 Mathematical Institute, University of Oxford, Oxford OX1 3LB. Research supported in part by a Senior Research Fellowship of the SERC. Email: ajm@maths.ox.ac.uk Introduction The most commonly used activation function in various neural networks applications is the sigmoid oe(y) = 1=1+ e \Gammay (cf. [HKP91]). I... | |||||||||||||||
Publication details | |||||||||||||||
| |||||||||||||||