Archetypal analysis for machine learning and data mining

    Research output: Contribution to journalJournal articleResearchpeer-review

    Abstract

    Archetypal analysis (aa) proposed by Cutler and Breiman (1994) [7] estimates the principal convex hull (pch) of a data set. As such aa favors features that constitute representative ‘corners’ of the data, i.e., distinct aspects or archetypes. We currently show that aa enjoys the interpretability of clustering – without being limited to hard assignment and the uniqueness of svd – without being limited to orthogonal representations. In order to do large scale aa, we derive an efficient algorithm based on projected gradient as well as an initialization procedure we denote FurthestSum that is inspired by the FurthestFirst approach widely used for k-means (Hochbaum and Shmoys, 1985 [14]). We generalize the aa procedure to kernel-aa in order to extract the principal convex hull in potential infinite Hilbert spaces and derive a relaxation of aa when the archetypes cannot be represented as convex combinations of the observed data. We further demonstrate that the aa model is relevant for feature extraction and dimensionality reduction for a large variety of machine learning problems taken from computer vision, neuroimaging, chemistry, text mining and collaborative filtering leading to highly interpretable representations of the dynamics in the data. Matlab code for the derived algorithms is available for download from www.mortenmorup.dk.
    Original languageEnglish
    JournalNeurocomputing
    Volume80
    Pages (from-to)54–63
    ISSN0925-2312
    DOIs
    Publication statusPublished - 2012

    Keywords

    • Non-negative matrixfactorization
    • Principal convexhull
    • FurthestSum
    • FurthestFirst
    • Archetypal analysis
    • Clustering
    • Kernel methods

    Fingerprint

    Dive into the research topics of 'Archetypal analysis for machine learning and data mining'. Together they form a unique fingerprint.

    Cite this