Gaze pattern analysis for audio-visual contents under the presence of video transmission errors

Manri Cheon, Jong Seok Lee

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

This paper presents a study investigating the viewing behavior of human subjects for multimedia contents containing both the audio and video channels when the contents are corrupted by video transmission errors. It considers the human perceptual mechanism in realistic multimedia delivery applications over networks. We design an eye-tracking experiment using several high definition audio-visual contents having a wide range of content characteristics. The results are analyzed in terms of the amount of attention that each region among the sound source region, the region corrupted by packet loss artifacts, and the rest receives under two different audio conditions, i.e., with or without the audio channel. The results show that the effect of the audio channel on the gaze pattern toward packet loss artifacts varies with the contents. In addition, interesting observations such as temporal variations, observer dependence, and content dependence are reported.

Original languageEnglish
Title of host publicationElectronic Proceedings of the 2013 IEEE International Conference on Multimedia and Expo Workshops, ICMEW 2013
DOIs
Publication statusPublished - 2013
Event2013 IEEE International Conference on Multimedia and Expo Workshops, ICMEW 2013 - San Jose, CA, United States
Duration: 2013 Jul 152013 Jul 19

Publication series

NameElectronic Proceedings of the 2013 IEEE International Conference on Multimedia and Expo Workshops, ICMEW 2013

Other

Other2013 IEEE International Conference on Multimedia and Expo Workshops, ICMEW 2013
Country/TerritoryUnited States
CitySan Jose, CA
Period13/7/1513/7/19

All Science Journal Classification (ASJC) codes

  • Computer Graphics and Computer-Aided Design
  • Computer Vision and Pattern Recognition

Fingerprint

Dive into the research topics of 'Gaze pattern analysis for audio-visual contents under the presence of video transmission errors'. Together they form a unique fingerprint.

Cite this