Rigorous optimisation of multilinear discriminant analysis with Tucker and PARAFAC structures

Laura Frølich*, Tobias Soren Andersen, Morten Mørup

*Corresponding author for this work

Research output: Contribution to journalJournal articleResearchpeer-review

226 Downloads (Pure)

Abstract

Background: We propose rigorously optimised supervised feature extraction methods for multilinear data based on Multilinear Discriminant Analysis (MDA) and demonstrate their usage on Electroencephalography (EEG) and simulated data. While existing MDA methods use heuristic optimisation procedures based on an ambiguous Tucker structure, we propose a rigorous approach via optimisation on the cross-product of Stiefel manifolds. We also introduce MDA methods with the PARAFAC structure. We compare the proposed approaches to existing MDA methods and unsupervised multilinear decompositions.Results: We find that manifold optimisation substantially improves MDA objective functions relative to existing methods and on simulated data in general improve classification performance. However, we find similar classification performance when applied to the electroencephalography data. Furthermore, supervised approaches substantially outperform unsupervised mulitilinear methods whereas methods with the PARAFAC structure perform similarly to those with Tucker structures. Notably, despite applying the MDA procedures to raw Brain-Computer Interface data, their performances are on par with results employing ample pre-processing and they extract discriminatory patterns similar to the brain activity known to be elicited in the investigated EEG paradigms.Conclusion: The proposed usage of manifold optimisation constitutes the first rigorous and monotonous optimisation approach for MDA methods and allows for MDA with the PARAFAC structure. Our results show that MDA methods applied to raw EEG data can extract discriminatory patterns when compared to traditional unsupervised multilinear feature extraction approaches, whereas the proposed PARAFAC structured MDA models provide meaningful patterns of activity.
Original languageEnglish
Article number197197
JournalB M C Bioinformatics
Volume19
Issue number1
Number of pages15
ISSN1471-2105
DOIs
Publication statusPublished - 2018

Keywords

  • Multilinear discriminant analysis
  • Electroencephalography
  • EEG
  • Tensor
  • Classification
  • Stiefel manifold

Fingerprint Dive into the research topics of 'Rigorous optimisation of multilinear discriminant analysis with Tucker and PARAFAC structures'. Together they form a unique fingerprint.

Cite this