Multiview coding mode decision with hybrid optimal stopping model

Tiesong ZHAO; Sam KWONG; Hanli WANG; Zhou WANG; Zhaoqing PAN; C.-C. Jay KUO

doi:10.1109/TIP.2012.2235451

Multiview coding mode decision with hybrid optimal stopping model

Tiesong ZHAO
, Sam KWONG
, Hanli WANG
, Zhou WANG
, Zhaoqing PAN
, C.-C. Jay KUO

Research output: Journal Publications › Journal Article (refereed) › peer-review

23 Citations (Scopus)

Abstract

In a generic decision process, optimal stopping theory aims to achieve a good tradeoff between decision performance and time consumed, with the advantages of theoretical decision-making and predictable decision performance. In this paper, optimal stopping theory is employed to develop an effective hybrid model for the mode decision problem, which aims to theoretically achieve a good tradeoff between the two interrelated measurements in mode decision, as computational complexity reduction and rate-distortion degradation. The proposed hybrid model is implemented and examined with a multiview encoder. To support the model and further promote coding performance, the multiview coding mode characteristics, including predicted mode probability and estimated coding time, are jointly investigated with inter-view correlations. Exhaustive experimental results with a wide range of video resolutions reveal the efficiency and robustness of our method, with high decision accuracy, negligible computational overhead, and almost intact rate-distortion performance compared to the original encoder. © 1992-2012 IEEE.

Original language	English
Pages (from-to)	1598-1609
Journal	IEEE Transactions on Image Processing
Volume	22
Issue number	4
Early online date	20 Dec 2012
DOIs	https://doi.org/10.1109/TIP.2012.2235451
Publication status	Published - Apr 2013
Externally published	Yes

Bibliographical note

The associate editor coordinating the review of this manuscript and approving it for publication was Dr. Joan Serra-Sagrista.

Funding

This work was supported in part by the Hong Kong Research Grants Council General Research Fund, under Project 9041495 (CityU 115109) and City University of Hong Kong Grant 9610025, and the Program for Professor of Special Appointment (Eastern Scholar) at Shanghai Institutions of Higher Learning; the Program for New Century Excellent Talents in University of China under Grant NCET-10-0634; the Shanghai Pujiang Program under Grant 11PJ1409400; the National Natural Science Foundation of China under Grant 61102059 and Grant 61272289; the Fundamental Research Funds for the Central Universities under Grant 0800219158; the National Basic Research Program (973 Program) of China under Grant 2010CB328101; the National Sciences and Engineering Research Council of Canada; and the Ontario Ministry of Research and Innovation.

Keywords

Inter-view prediction
mode characteristics
mode decision
multiview video coding
optimal stopping

Access to Document

10.1109/TIP.2012.2235451

Cite this

@article{231d52ea2fb94888bffa062fc1ea3328,

title = "Multiview coding mode decision with hybrid optimal stopping model",

abstract = "In a generic decision process, optimal stopping theory aims to achieve a good tradeoff between decision performance and time consumed, with the advantages of theoretical decision-making and predictable decision performance. In this paper, optimal stopping theory is employed to develop an effective hybrid model for the mode decision problem, which aims to theoretically achieve a good tradeoff between the two interrelated measurements in mode decision, as computational complexity reduction and rate-distortion degradation. The proposed hybrid model is implemented and examined with a multiview encoder. To support the model and further promote coding performance, the multiview coding mode characteristics, including predicted mode probability and estimated coding time, are jointly investigated with inter-view correlations. Exhaustive experimental results with a wide range of video resolutions reveal the efficiency and robustness of our method, with high decision accuracy, negligible computational overhead, and almost intact rate-distortion performance compared to the original encoder. {\textcopyright} 1992-2012 IEEE.",

keywords = "Inter-view prediction, mode characteristics, mode decision, multiview video coding, optimal stopping",

author = "Tiesong ZHAO and Sam KWONG and Hanli WANG and Zhou WANG and Zhaoqing PAN and KUO, \{C.-C. Jay\}",

note = "The associate editor coordinating the review of this manuscript and approving it for publication was Dr. Joan Serra-Sagrista.",

year = "2013",

month = apr,

doi = "10.1109/TIP.2012.2235451",

language = "English",

volume = "22",

pages = "1598--1609",

journal = "IEEE Transactions on Image Processing",

issn = "1057-7149",

publisher = "Institute of Electrical and Electronics Engineers Inc.",

number = "4",

}

TY - JOUR

T1 - Multiview coding mode decision with hybrid optimal stopping model

AU - ZHAO, Tiesong

AU - KWONG, Sam

AU - WANG, Hanli

AU - WANG, Zhou

AU - PAN, Zhaoqing

AU - KUO, C.-C. Jay

N1 - The associate editor coordinating the review of this manuscript and approving it for publication was Dr. Joan Serra-Sagrista.

PY - 2013/4

Y1 - 2013/4

N2 - In a generic decision process, optimal stopping theory aims to achieve a good tradeoff between decision performance and time consumed, with the advantages of theoretical decision-making and predictable decision performance. In this paper, optimal stopping theory is employed to develop an effective hybrid model for the mode decision problem, which aims to theoretically achieve a good tradeoff between the two interrelated measurements in mode decision, as computational complexity reduction and rate-distortion degradation. The proposed hybrid model is implemented and examined with a multiview encoder. To support the model and further promote coding performance, the multiview coding mode characteristics, including predicted mode probability and estimated coding time, are jointly investigated with inter-view correlations. Exhaustive experimental results with a wide range of video resolutions reveal the efficiency and robustness of our method, with high decision accuracy, negligible computational overhead, and almost intact rate-distortion performance compared to the original encoder. © 1992-2012 IEEE.

AB - In a generic decision process, optimal stopping theory aims to achieve a good tradeoff between decision performance and time consumed, with the advantages of theoretical decision-making and predictable decision performance. In this paper, optimal stopping theory is employed to develop an effective hybrid model for the mode decision problem, which aims to theoretically achieve a good tradeoff between the two interrelated measurements in mode decision, as computational complexity reduction and rate-distortion degradation. The proposed hybrid model is implemented and examined with a multiview encoder. To support the model and further promote coding performance, the multiview coding mode characteristics, including predicted mode probability and estimated coding time, are jointly investigated with inter-view correlations. Exhaustive experimental results with a wide range of video resolutions reveal the efficiency and robustness of our method, with high decision accuracy, negligible computational overhead, and almost intact rate-distortion performance compared to the original encoder. © 1992-2012 IEEE.

KW - Inter-view prediction

KW - mode characteristics

KW - mode decision

KW - multiview video coding

KW - optimal stopping

UR - https://www.scopus.com/pages/publications/84873900909

U2 - 10.1109/TIP.2012.2235451

DO - 10.1109/TIP.2012.2235451

M3 - Journal Article (refereed)

SN - 1057-7149

VL - 22

SP - 1598

EP - 1609

JO - IEEE Transactions on Image Processing

JF - IEEE Transactions on Image Processing

IS - 4

ER -

Multiview coding mode decision with hybrid optimal stopping model

Abstract

Bibliographical note

Funding

Keywords

Access to Document

Other files and links

Fingerprint

Cite this