Efficient preference learning with pairwise continuous observations and Gaussian Processes

Bjørn Sand Jensen, Jens Brehm Nielsen, Jan Larsen

    Research output: Chapter in Book/Report/Conference proceedingArticle in proceedingsResearchpeer-review

    2 Downloads (Pure)

    Abstract

    Human preferences can effectively be elicited using pairwise comparisons and in this paper current state-of-the-art based on binary decisions is extended by a new paradigm which allows subjects to convey their degree of preference as a continuous but bounded response. For this purpose, a novel Betatype likelihood is proposed and applied in a Bayesian regression framework using Gaussian Process priors. Posterior estimation and inference is performed using a Laplace approximation. The potential of the paradigm is demonstrated and discussed in terms of learning rates and robustness by evaluating the predictive performance under various noise conditions on a synthetic dataset. It is demonstrated that the learning rate of the novel paradigm is not only faster under ideal conditions, where continuous responses are naturally more informative than binary decisions, but also under adverse conditions where it seemingly preserves the robustness of the binary paradigm, suggesting that the new paradigm is robust to human inconsistency.
    Original languageEnglish
    Title of host publication2011 IEEE International Workshop on Machine Learning for Signal Processing (MLSP)
    PublisherIEEE
    Publication date2011
    ISBN (Print)978-1-4577-1621-8
    ISBN (Electronic)978-1-4577-1622-5
    DOIs
    Publication statusPublished - 2011
    Event2011 IEEE International Workshop on Machine Learning for Signal Processing - Beijing, China
    Duration: 1 Jan 2011 → …
    http://mlsp2011.conwiz.dk/

    Conference

    Conference2011 IEEE International Workshop on Machine Learning for Signal Processing
    CountryChina
    CityBeijing
    Period01/01/2011 → …
    Internet address
    SeriesMachine Learning for Signal Processing
    ISSN1551-2541

    Keywords

    • Laplace Approximation
    • Gaussian Processes
    • Continuous Response
    • Pairwise Comparisons

    Cite this

    Jensen, B. S., Nielsen, J. B., & Larsen, J. (2011). Efficient preference learning with pairwise continuous observations and Gaussian Processes. In 2011 IEEE International Workshop on Machine Learning for Signal Processing (MLSP) IEEE. Machine Learning for Signal Processing https://doi.org/10.1109/MLSP.2011.6064616