Perceptual Evaluation on Audio-visual Dataset of 360 Content

  • Randy Frans Fela (Guest lecturer)
  • Andréas Pastor (Guest lecturer)
  • Patrick Le Callet (Guest lecturer)
  • Nick Zacharov (Guest lecturer)
  • Toinon Vigier (Guest lecturer)
  • Forchhammer, S. (Lecturer)

Activity: Talks and presentationsConference presentations

Description

To open up new possibilities to assess the multimodal perceptual quality of omnidirectional media formats, we proposed a novel open source 360 audiovisual (AV) quality dataset. The dataset consists of high-quality 360 video clips in equirectangular (ERP) format and higher-order ambisonic (4th order) along with the subjective scores. Three subjective quality experiments were conducted for audio, video, and AV with the procedures detailed in this paper. Using the data from subjective tests, we demonstrated that this dataset can be used to quantify perceived audio, video, and audiovisual quality. The diversity and discriminability of subjective scores were also analyzed. Finally, we investigated how our dataset correlates with various objective quality metrics of audio and video. Evidence from the results of this study implies that the proposed dataset can benefit future studies on multimodal quality evaluation of 360 content.
Period18 Jul 202222 Jul 2022
Event title2022 IEEE International Conference on Multimedia and Expo
Event typeConference
SponsorsChinese Academy of Sciences, IEEE, IEEE, IEEE Communications Society, IEEE
LocationTaipei, Taiwan, Province of ChinaShow on map
Degree of RecognitionInternational

Keywords

  • omnidirectional media format
  • audiovisual dataset
  • 360 video
  • ambisonic
  • quality evaluation