Testing Multimodal Integration Hypotheses with Application to Schizophrenia Data

Martin Christian Axelsen, Nikolaj Bak, Lars Kai Hansen

Research output: Chapter in Book/Report/Conference proceedingArticle in proceedingsResearchpeer-review

306 Downloads (Pure)


Multimodal data sets are getting more and more common. Integrating these data sets, the information from each modality can be combined to improve performance in classification problems. Fusion/integration of modalities can be done at several levels. The most appropriate fusion level is related to the conditional dependency between modalities. A varying degree of inter-modality dependency can be present across the modalities. A method for assessing the conditional dependency structure of the modalities and their relationship to intra-modality dependencies in each modality is therefore needed. The aim of the present paper is to propose a method for assessing these inter-modality dependencies. The approach is based on two permutations of an analyzed data set, each exploring different dependencies between and within modalities. The method was tested on the Kaggle MLSP 2014 Schizophrenia Classification Challenge data set which is composed of features from functional magnetic resonance imaging (MRI) and structural MRI. The results support the use of a permutation strategy for testing conditional dependencies between modalities in a multimodal classification problem.
Original languageEnglish
Title of host publicationProceedings of the 5th International Workshop on Pattern Recognition in NeuroImaging (PRNI 2015)
Publication date2015
ISBN (Print)978-1-4673-7145-2
Publication statusPublished - 2015
Event5th International Workshop on Pattern Recognition in Neuroimaging - Stanford University, Palo Alto, United States
Duration: 10 Jun 201512 Jun 2015
Conference number: 5


Workshop5th International Workshop on Pattern Recognition in Neuroimaging
LocationStanford University
Country/TerritoryUnited States
CityPalo Alto
Internet address


Dive into the research topics of 'Testing Multimodal Integration Hypotheses with Application to Schizophrenia Data'. Together they form a unique fingerprint.

Cite this