Scalable Gaussian Process for Extreme Classification

Akash Kumar Dhaka, Michael Riis Andersen, Pablo Garcia Moreno, Aki Vehtari

Research output: Chapter in Book/Report/Conference proceedingArticle in proceedingsResearchpeer-review

17 Downloads (Pure)

Abstract

We address the limitations of Gaussian processes for multiclass classification in the setting where both the number of classes and the number of observations is very large. We propose a scalable approximate inference framework by combining the inducing points method with variational approximations of the likelihood that have been recently proposed in the literature. This leads to a tractable lower bound on the marginal likelihood that decomposes into a sum over both data points and class labels, and hence, is amenable to doubly stochastic optimization. To overcome memory issues when dealing with large datasets, we resort to amortized inference, which coupled with subsampling over classes reduces the computational and the memory footprint without a significant loss in performance. We demonstrate empirically that the proposed algorithm leads to superior performance in terms of test accuracy, and improved detection of tail labels.
Original languageEnglish
Title of host publication Proceedings of 2020 IEEE 30th International Workshop on Machine Learning for Signal Processing
Number of pages6
PublisherIEEE
Publication date2020
ISBN (Electronic)978-1-7281-6662-9
DOIs
Publication statusPublished - 2020
Event2020 IEEE 30th International Workshop on Machine Learning for Signal Processing - Aalto University, Espoo, Finland
Duration: 21 Sep 202024 Sep 2020
Conference number: 30
https://ieeexplore.ieee.org/xpl/conhome/9217888/proceeding

Conference

Conference2020 IEEE 30th International Workshop on Machine Learning for Signal Processing
Number30
LocationAalto University
Country/TerritoryFinland
CityEspoo
Period21/09/202024/09/2020
Internet address
SeriesMachine Learning for Signal Processing
ISSN1551-2541

Keywords

  • Gaussian process classification
  • Variational inference
  • Augmented model

Fingerprint

Dive into the research topics of 'Scalable Gaussian Process for Extreme Classification'. Together they form a unique fingerprint.

Cite this