Attention modeling for video quality assessment: balancing global quality and local quality

Junyong You, Jari Korhonen, Andrew Perkis

Research output: Chapter in Book/Report/Conference proceedingArticle in proceedingsResearchpeer-review

364 Downloads (Pure)

Abstract

This paper proposes to evaluate video quality by balancing two quality components: global quality and local quality. The global quality is a result from subjects allocating their ttention equally to all regions in a frame and all frames n a video. It is evaluated by image quality metrics (IQM) ith averaged spatiotemporal pooling. The local quality is derived from visual attention modeling and quality variations over frames. Saliency, motion, and contrast information are taken into account in modeling visual attention, which is then integrated into IQMs to calculate the local quality of a video frame. The local quality of a video sequence is calculated by pooling local quality values over all frames with a temporal pooling scheme derived from the known relationship between perceived video quality and the frequency of temporal quality variations. The overall quality of a distorted video is a weighted average between the global quality and the local quality. Experimental results demonstrate that the combination of the global quality and local quality outperforms both sole global quality and local quality, as well as other quality models, in video quality assessment. In addition, the proposed video quality modeling algorithm can improve the performance of image quality metrics on video quality assessment compared to the normal averaged spatiotemporal pooling scheme.
Original languageEnglish
Title of host publicationproceedings ICME
PublisherIEEE
Publication date2010
Pages914-919
ISBN (Print)978-1-4244-7492-9
Publication statusPublished - 2010
EventInternational Conference on Multimedia and EXPO - Singapore
Duration: 1 Jan 2010 → …

Conference

ConferenceInternational Conference on Multimedia and EXPO
CitySingapore
Period01/01/2010 → …

Keywords

  • Visual attention
  • Motion
  • Quality metric
  • Temporal pooling
  • Saliency

Cite this

You, J., Korhonen, J., & Perkis, A. (2010). Attention modeling for video quality assessment: balancing global quality and local quality. In proceedings ICME (pp. 914-919). IEEE. http://www.icme2010.org