Temporal and Spectral Cues for Musical Timbre Perception in Electric Hearing

Ying-Yee Kong, Ala Mullangi, Jeremy Marozeau, Michael Epstein

    Research output: Contribution to journalJournal articleResearchpeer-review

    Abstract

    The purpose of this study was to investigate musical timbre perception in cochlear-implant (CI) listeners using a multidimensional scaling technique to derive a timbre space. Methods: Sixteen stimuli that synthesized western musical instruments were used (McAdams, Winsberg, Donnadieu, De Soete, & Krimphoff, 1995). Eight CI listeners and 15 normalhearing (NH) listeners participated. Each listener made judgments of dissimilarity between stimulus pairs. Acoustical analyses that characterized the temporal and spectral characteristics of each stimulus were performed to examine the psychophysical nature of each perceptual dimension. For NH listeners, the timbre space was best represented in three dimensions, one correlated with the temporal envelope (log-attack time) of the stimuli, one correlated with the spectral envelope (spectral centroid), and one correlated with the spectral fine structure (spectral irregularity) of the stimuli. The timbre space from CI listeners, however, was best represented by two dimensions, one correlated with temporal envelope features and the other weakly correlated with spectral envelope features of the stimuli. Temporal envelope was a dominant cue for timbre perception in CI listeners. Compared to NH listeners, CI listeners showed reduced reliance on both spectral envelope and spectral fine structure cues for timbre perception.
    Original languageEnglish
    JournalJournal of Speech, Language, and Hearing Research
    Volume54
    Issue number3
    Pages (from-to)981-995
    ISSN1092-4388
    DOIs
    Publication statusPublished - 2011

    Keywords

    • Cochlear implant
    • Timbre
    • Music

    Fingerprint

    Dive into the research topics of 'Temporal and Spectral Cues for Musical Timbre Perception in Electric Hearing'. Together they form a unique fingerprint.

    Cite this