PASS-GP: Predictive active set selection for Gaussian processes

Ricardo Henao, Ole Winther

    Research output: Chapter in Book/Report/Conference proceedingArticle in proceedingsResearchpeer-review

    Abstract

    We propose a new approximation method for Gaussian process (GP) learning for large data sets that combines inline active set selection with hyperparameter optimization. The predictive probability of the label is used for ranking the data points. We use the leave-one-out predictive probability available in GPs to make a common ranking for both active and inactive points, allowing points to be removed again from the active set. This is important for keeping the complexity down and at the same time focusing on points close to the decision boundary. We lend both theoretical and empirical support to the active set selection strategy and marginal likelihood optimization on the active set. We make extensive tests on the USPS and MNIST digit classification databases with and without incorporating invariances, demonstrating that we can get state-of-the-art results (e.g.0.86% error on MNIST) with reasonable time complexity.
    Original languageEnglish
    Title of host publicationIEEE International Workshop on Machine Learning for Signal Processing 2010 (MLSP 2010)
    PublisherIEEE
    Publication date2010
    Pages148-153
    ISBN (Print)978-1-4244-7875-0
    DOIs
    Publication statusPublished - 2010
    EventIEEE International Workshop on Machine Learning for Signal Processing 2010 (MLSP 2010) -
    Duration: 1 Jan 2010 → …

    Conference

    ConferenceIEEE International Workshop on Machine Learning for Signal Processing 2010 (MLSP 2010)
    Period01/01/2010 → …

    Fingerprint Dive into the research topics of 'PASS-GP: Predictive active set selection for Gaussian processes'. Together they form a unique fingerprint.

    Cite this