Perceptually unequal packet loss protection by weighting saliency and error propagation

Hojin Ha; Jincheol Park; Sanghoon Lee; Alan Conrad Bovik

doi:10.1109/TCSVT.2010.2051368

Perceptually unequal packet loss protection by weighting saliency and error propagation

Hojin Ha, Jincheol Park, Sanghoon Lee, Alan Conrad Bovik

Department of Electrical and Electronic Engineering

Research output: Contribution to journal › Article › peer-review

22 Citations (Scopus)

Abstract

We describe a method for achieving perceptually minimal video distortion over packet-erasure networks using perceptually unequal loss protection (PULP). There are two main ingredients in the algorithm. First, a perceptual weighting scheme is employed wherein the compressed video is weighted as a function of the nonuniform distribution of retinal photoreceptors. Secondly, packets are assigned temporal importance within each group of pictures (GOP), recognizing that the severity of error propagation increases with elapsed time within a GOP. Using both frame-level perceptual importance and GOP-level hierarchical importance, the PULP algorithm seeks efficient forward error correction assignment that balances efficiency and fairness by controlling the size of identified salient region(s) relative to the channel state. PULP demonstrates robust performance and significantly improved subjective and objective visual quality in the face of burst packet losses.

Original language	English
Article number	5473075
Pages (from-to)	1187-1199
Number of pages	13
Journal	IEEE Transactions on Circuits and Systems for Video Technology
Volume	20
Issue number	9
DOIs	https://doi.org/10.1109/TCSVT.2010.2051368
Publication status	Published - 2010 Sept

Bibliographical note

Funding Information:
Manuscript received March 21, 2009; revised September 25, 2009; accepted January 21, 2010. Date of publication May 27, 2010; date of current version September 9, 2010. This work was supported by the Agency for Defense Development under Contract UD1000221D, Korea. This paper was recommended by Associate Editor H. Sun.

All Science Journal Classification (ASJC) codes

Media Technology
Electrical and Electronic Engineering

Access to Document

10.1109/TCSVT.2010.2051368

Cite this

@article{43a0b037bf1c4a2795b986d5c5cf7762,

title = "Perceptually unequal packet loss protection by weighting saliency and error propagation",

abstract = "We describe a method for achieving perceptually minimal video distortion over packet-erasure networks using perceptually unequal loss protection (PULP). There are two main ingredients in the algorithm. First, a perceptual weighting scheme is employed wherein the compressed video is weighted as a function of the nonuniform distribution of retinal photoreceptors. Secondly, packets are assigned temporal importance within each group of pictures (GOP), recognizing that the severity of error propagation increases with elapsed time within a GOP. Using both frame-level perceptual importance and GOP-level hierarchical importance, the PULP algorithm seeks efficient forward error correction assignment that balances efficiency and fairness by controlling the size of identified salient region(s) relative to the channel state. PULP demonstrates robust performance and significantly improved subjective and objective visual quality in the face of burst packet losses.",

author = "Hojin Ha and Jincheol Park and Sanghoon Lee and Bovik, {Alan Conrad}",

note = "Funding Information: Manuscript received March 21, 2009; revised September 25, 2009; accepted January 21, 2010. Date of publication May 27, 2010; date of current version September 9, 2010. This work was supported by the Agency for Defense Development under Contract UD1000221D, Korea. This paper was recommended by Associate Editor H. Sun.",

year = "2010",

month = sep,

doi = "10.1109/TCSVT.2010.2051368",

language = "English",

volume = "20",

pages = "1187--1199",

journal = "IEEE Transactions on Circuits and Systems for Video Technology",

issn = "1051-8215",

publisher = "Institute of Electrical and Electronics Engineers Inc.",

number = "9",

}

TY - JOUR

T1 - Perceptually unequal packet loss protection by weighting saliency and error propagation

AU - Ha, Hojin

AU - Park, Jincheol

AU - Lee, Sanghoon

AU - Bovik, Alan Conrad

N1 - Funding Information: Manuscript received March 21, 2009; revised September 25, 2009; accepted January 21, 2010. Date of publication May 27, 2010; date of current version September 9, 2010. This work was supported by the Agency for Defense Development under Contract UD1000221D, Korea. This paper was recommended by Associate Editor H. Sun.

PY - 2010/9

Y1 - 2010/9

N2 - We describe a method for achieving perceptually minimal video distortion over packet-erasure networks using perceptually unequal loss protection (PULP). There are two main ingredients in the algorithm. First, a perceptual weighting scheme is employed wherein the compressed video is weighted as a function of the nonuniform distribution of retinal photoreceptors. Secondly, packets are assigned temporal importance within each group of pictures (GOP), recognizing that the severity of error propagation increases with elapsed time within a GOP. Using both frame-level perceptual importance and GOP-level hierarchical importance, the PULP algorithm seeks efficient forward error correction assignment that balances efficiency and fairness by controlling the size of identified salient region(s) relative to the channel state. PULP demonstrates robust performance and significantly improved subjective and objective visual quality in the face of burst packet losses.

AB - We describe a method for achieving perceptually minimal video distortion over packet-erasure networks using perceptually unequal loss protection (PULP). There are two main ingredients in the algorithm. First, a perceptual weighting scheme is employed wherein the compressed video is weighted as a function of the nonuniform distribution of retinal photoreceptors. Secondly, packets are assigned temporal importance within each group of pictures (GOP), recognizing that the severity of error propagation increases with elapsed time within a GOP. Using both frame-level perceptual importance and GOP-level hierarchical importance, the PULP algorithm seeks efficient forward error correction assignment that balances efficiency and fairness by controlling the size of identified salient region(s) relative to the channel state. PULP demonstrates robust performance and significantly improved subjective and objective visual quality in the face of burst packet losses.

UR - http://www.scopus.com/inward/record.url?scp=77956820596&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=77956820596&partnerID=8YFLogxK

U2 - 10.1109/TCSVT.2010.2051368

DO - 10.1109/TCSVT.2010.2051368

M3 - Article

AN - SCOPUS:77956820596

SN - 1051-8215

VL - 20

SP - 1187

EP - 1199

JO - IEEE Transactions on Circuits and Systems for Video Technology

JF - IEEE Transactions on Circuits and Systems for Video Technology

IS - 9

M1 - 5473075

ER -

Perceptually unequal packet loss protection by weighting saliency and error propagation

Abstract

Bibliographical note

All Science Journal Classification (ASJC) codes

Access to Document

Other files and links

Fingerprint

Cite this