Context based multimedia information retrieval

Publication: ResearchPh.D. thesis – Annual report year: 2009

Standard

Context based multimedia information retrieval. / Mølgaard, Lasse Lohilahti; Hansen, Lars Kai (Supervisor); Larsen, Jan (Supervisor).

Kgs. Lyngby, Denmark : Technical University of Denmark (DTU), 2009. (IMM-PHD-2009-218).

Publication: ResearchPh.D. thesis – Annual report year: 2009

Harvard

Mølgaard, LL, Hansen, LK & Larsen, J 2009, Context based multimedia information retrieval. Ph.D. thesis, Technical University of Denmark (DTU), Kgs. Lyngby, Denmark. IMM-PHD-2009-218

APA

Mølgaard, L. L., Hansen, L. K., & Larsen, J. (2009). Context based multimedia information retrieval. Kgs. Lyngby, Denmark: Technical University of Denmark (DTU). (IMM-PHD-2009-218).

CBE

Mølgaard LL, Hansen LK, Larsen J 2009. Context based multimedia information retrieval. Kgs. Lyngby, Denmark: Technical University of Denmark (DTU). (IMM-PHD-2009-218).

MLA

Mølgaard, Lasse Lohilahti, Lars Kai Hansen, and Jan Larsen Context based multimedia information retrieval Kgs. Lyngby, Denmark: Technical University of Denmark (DTU). 2009. (IMM-PHD-2009-218).

Vancouver

Mølgaard LL, Hansen LK, Larsen J. Context based multimedia information retrieval. Kgs. Lyngby, Denmark: Technical University of Denmark (DTU), 2009. (IMM-PHD-2009-218).

Author

Mølgaard, Lasse Lohilahti; Hansen, Lars Kai (Supervisor); Larsen, Jan (Supervisor) / Context based multimedia information retrieval.

Kgs. Lyngby, Denmark : Technical University of Denmark (DTU), 2009. (IMM-PHD-2009-218).

Publication: ResearchPh.D. thesis – Annual report year: 2009

Bibtex

@book{b31247ba17f641479e3fb6dab7f358cd,
title = "Context based multimedia information retrieval",
publisher = "Technical University of Denmark (DTU)",
author = "Mølgaard, {Lasse Lohilahti} and Hansen, {Lars Kai} and Jan Larsen",
year = "2009",
series = "IMM-PHD-2009-218",

}

RIS

TY - BOOK

T1 - Context based multimedia information retrieval

A1 - Mølgaard,Lasse Lohilahti

AU - Mølgaard,Lasse Lohilahti

A2 - Hansen,Lars Kai

A2 - Larsen,Jan

ED - Hansen,Lars Kai

ED - Larsen,Jan

PB - Technical University of Denmark (DTU)

PY - 2009/12

Y1 - 2009/12

N2 - The large amounts of digital media becoming available require that new approaches are developed for retrieving, navigating and recommending the data to users in a way that refl ects how we semantically perceive the content. The thesis investigates ways to retrieve and present content for users with the help of contextual knowledge. Our approach to model the context of multimedia is based on unsupervised methods to automatically extract meaning. We investigate two paths of context modelling. The first part extracts context from the primary media, in this case broadcast news speech, by extracting topics from a large collection of the transcribed speech to improve retrieval of spoken documents. The context modelling is done using a variant of probabilistic latent semantic analysis (PLSA), to extract properties of the textual sources that refl ect how humans perceive context. We perform PLSA through an approximation based on non-negative matrix factorisation NMF. The second part of the work tries to infer the contextual meaning of music based on extra-musical knowledge, in our case gathered from Wikipedia. The semantic relations between artists are inferred using linking structure of Wikipedia , as well as text-based semantic similarity. The final aspect investigated is how to include some of the structured data available in Wikipedia to include temporal information. We show that a multiway extension of PLSA makes it possible to extract temporally meaningful topics, better than using a stepwise PLSA approach to topic extraction.

AB - The large amounts of digital media becoming available require that new approaches are developed for retrieving, navigating and recommending the data to users in a way that refl ects how we semantically perceive the content. The thesis investigates ways to retrieve and present content for users with the help of contextual knowledge. Our approach to model the context of multimedia is based on unsupervised methods to automatically extract meaning. We investigate two paths of context modelling. The first part extracts context from the primary media, in this case broadcast news speech, by extracting topics from a large collection of the transcribed speech to improve retrieval of spoken documents. The context modelling is done using a variant of probabilistic latent semantic analysis (PLSA), to extract properties of the textual sources that refl ect how humans perceive context. We perform PLSA through an approximation based on non-negative matrix factorisation NMF. The second part of the work tries to infer the contextual meaning of music based on extra-musical knowledge, in our case gathered from Wikipedia. The semantic relations between artists are inferred using linking structure of Wikipedia , as well as text-based semantic similarity. The final aspect investigated is how to include some of the structured data available in Wikipedia to include temporal information. We show that a multiway extension of PLSA makes it possible to extract temporally meaningful topics, better than using a stepwise PLSA approach to topic extraction.

BT - Context based multimedia information retrieval

T3 - IMM-PHD-2009-218

T3 - en_GB

ER -