Ensemble methods for handwritten digit recognition

Lars Kai Hansen, Christian Liisberg, P. Salamon

    Research output: Chapter in Book/Report/Conference proceedingArticle in proceedingsResearchpeer-review

    445 Downloads (Pure)

    Abstract

    Neural network ensembles are applied to handwritten digit recognition. The individual networks of the ensemble are combinations of sparse look-up tables (LUTs) with random receptive fields. It is shown that the consensus of a group of networks outperforms the best individual of the ensemble. It is further shown that it is possible to estimate the ensemble performance as well as the learning curve on a medium-size database. In addition the authors present preliminary analysis of experiments on a large database and show that state-of-the-art performance can be obtained using the ensemble approach by optimizing the receptive fields. It is concluded that it is possible to improve performance significantly by introducing moderate-size ensembles; in particular, a 20-25% improvement has been found. The ensemble random LUTs, when trained on a medium-size database, reach a performance (without rejects) of 94% correct classification on digits written by an independent group of people
    Original languageEnglish
    Title of host publicationProceedings of the IEEE-SP Workshop Neural Networks for Signal Processing
    PublisherIEEE
    Publication date1992
    ISBN (Print)0-7803-0557-4
    DOIs
    Publication statusPublished - 1992
    Event1992 IEEE-SP Workshop of Neural Networks for Signal Processing - Helsingør, Denmark
    Duration: 31 Aug 19922 Sep 1992
    http://ieeexplore.ieee.org/xpl/mostRecentIssue.jsp?punumber=631

    Workshop

    Workshop1992 IEEE-SP Workshop of Neural Networks for Signal Processing
    CountryDenmark
    CityHelsingør
    Period31/08/199202/09/1992
    Internet address

    Bibliographical note

    Copyright: 1992 IEEE. Personal use of this material is permitted. However, permission to reprint/republish this material for advertising or promotional purposes or for creating new collective works for resale or redistribution to servers or lists, or to reuse any copyrighted component of this work in other works must be obtained from the IEEE

    Cite this

    Hansen, L. K., Liisberg, C., & Salamon, P. (1992). Ensemble methods for handwritten digit recognition. In Proceedings of the IEEE-SP Workshop Neural Networks for Signal Processing IEEE. https://doi.org/10.1109/NNSP.1992.253679