Spectral and temporal cues for perception of material and action categories in impacted sound sources

Jens Hjortkjær, Stephen McAdams

    Research output: Contribution to journalJournal articleResearchpeer-review

    503 Downloads (Pure)


    In two experiments, similarity ratings and categorization performance with recorded impact sounds
    representing three material categories (wood, metal, glass) being manipulated by three different categories
    of action (drop, strike, rattle) were examined. Previous research focusing on single impact
    sounds suggests that temporal cues related to damping are essential for material discrimination, but
    spectral cues are potentially more efficient for discriminating materials manipulated by different
    actions that include multiple impacts (e.g., dropping, rattling). Perceived similarity between material
    categories across different actions was correlated with the distribution of long-term spectral
    energy (spectral centroid). Similarity between action categories was described by the temporal distribution
    of envelope energy (temporal centroid) or by the density of impacts. Moreover, perceptual
    similarity correlated with the pattern of confusion in categorization judgments. Listeners tended to
    confuse materials with similar spectral centroids, and actions with similar temporal centroids and
    onset densities. To confirm the influence of these different features, spectral cues were removed by
    applying the envelopes of the original sounds to a broadband noise carrier. Without spectral cues,
    listeners retained sensitivity to action categories but not to material categories. Conversely, listeners
    recognized material but not action categories after envelope scrambling that preserved long-term
    spectral content.
    Original languageEnglish
    JournalJournal of the Acoustical Society of America
    Issue number1
    Pages (from-to)409-420
    Publication statusPublished - 2016

    Bibliographical note

    Copyright 2016 Acoustical Society of America. This article may be downloaded for personal use only. Any other use requires prior permission of the author and the Acoustical Society of America.


    Dive into the research topics of 'Spectral and temporal cues for perception of material and action categories in impacted sound sources'. Together they form a unique fingerprint.

    Cite this