Efficacy of modified backpropagation and optimisation methods on a real world medical problem
(1995) Efficacy of modified backpropagation and optimisation methods on a real world medical problem. Neural Networks 8(6):pp. 945-962.
Full text available as: |
Abstract
A wide range of modifications to the backpropagation (BP) algorithm, motivated by heuristic arguments and optimisation theory, has been examined on a real-world medical signal classification problem. The method of choice depends both upon the nature of the learning task and whether one wants to optimise learning for speed or generalisation. It was found that, comparitively, standard BP was sufficiently fast and provided good generalisation when the task was to learn the training set within a given error tolerance. However, if the task was to find the global minimum, then standard BP failed to do so within 100,000 iterations, but first order methods which adapt the stepsize were as fast as, if not faster than, conjugate gradient and quasi-Newton methods. Second order methods required the same amount of fine tuning of line search and restart parameters as did the first order methods of their parameters in order to achieve optimum performance.
| Item Type: | Journal Article |
|---|---|
| Status: | Published |
| Keywords: | neural networks, multilayer perceptron, backpropagation, optimisation, auditory evoked potential, pattern classification |
| Subjects: | 280000 Information, Computing and Communication Sciences > 280200 Artificial Intelligence and Signal and Image Processing > 280212 Neural Networks, Genetic Alogrithms and Fuzzy Logic |
| ID Code: | 7604 |
| Deposited By: | Towsey, Michael W. |
| Deposited On: | 15 May 2007 |
| Alternative Locations: | http://dx.doi.org/10.1016/0893-6080(95)00034-W |
| Copyright Owner: | Copyright 1995 Elsevier |
| Additional Information: | For more information, please refer to the journal's website (see hypertext link) or contact the author. |