Adaptive Regularization of Neural Classifiers

Lars Nonboe Andersen, Jan Larsen, Lars Kai Hansen, Mads Hintz-Madsen, J Principe (Editor), L. Giles (Editor), N. Morgan (Editor), E Wilson (Editor)

    Research output: Chapter in Book/Report/Conference proceedingArticle in proceedingsResearchpeer-review

    306 Downloads (Pure)

    Abstract

    We present a regularization scheme which iteratively adapts the regularization parameters by minimizing the validation error. It is suggested to use the adaptive regularization scheme in conjunction with optimal brain damage pruning to optimize the architecture and to avoid overfitting. Furthermore, we propose an improved neural classification architecture eliminating an inherent redundancy in the widely used SoftMax classification network. Numerical results demonstrate the viability of the method
    Original languageEnglish
    Title of host publicationProceedings of the IEEE Workshop on Neural Networks for Signal Processing VII
    Place of PublicationPiscataway, New Jersey
    PublisherIEEE
    Publication date1997
    Pages24-33
    ISBN (Print)0-7803-4256-9
    DOIs
    Publication statusPublished - 1997
    Event1997 IEEE Workshop on Neural Networks for Signal Processing VII - Piscataway, NJ, United States
    Duration: 24 Sep 199726 Sep 1997
    http://ieeexplore.ieee.org/xpl/mostRecentIssue.jsp?punumber=4900

    Workshop

    Workshop1997 IEEE Workshop on Neural Networks for Signal Processing VII
    CountryUnited States
    CityPiscataway, NJ
    Period24/09/199726/09/1997
    Internet address

    Bibliographical note

    Copyright: 1997 IEEE. Personal use of this material is permitted. However, permission to reprint/republish this material for advertising or promotional purposes or for creating new collective works for resale or redistribution to servers or lists, or to reuse any copyrighted component of this work in other works must be obtained from the IEEE

    Cite this

    Andersen, L. N., Larsen, J., Hansen, L. K., Hintz-Madsen, M., Principe, J. (Ed.), Giles, L. (Ed.), Morgan, N. (Ed.), & Wilson, E. (Ed.) (1997). Adaptive Regularization of Neural Classifiers. In Proceedings of the IEEE Workshop on Neural Networks for Signal Processing VII (pp. 24-33). IEEE. https://doi.org/10.1109/NNSP.1997.622380