Probability-based coding mode prediction for H.264/AVC

Tiesong ZHAO, Hanli WANG, Sam KWONG, Sudeng HU

Research output: Book Chapters | Papers in Conference ProceedingsConference paper (refereed)Researchpeer-review

5 Citations (Scopus)


Fast mode decision (FMD) algorithm aims to reduce the computational complexity of video encoders, especially for H.264/AVC, and meanwhile keep the coding efficiency. It is necessary for coding high resolution sequences, such as standard definition (SD) or high definition (HD) sequences. In this paper, an efficient algorithm is proposed to speed up inter-mode decision for H.264/AVC. Firstly, for a macroblock (MB) being coded, with modes of neighboring blocks, a probability model is utilized to build up an optimal encoding mode list; after that, rate-distortion (RD) cost-based early termination is employed to skip unnecessary inter-modes. Simulation results demonstrate that, the proposed algorithm could achieve significant encoding time saving for QCIF/CIF and SD/HD sequences, meanwhile with almost the same RD performance as the original encoder. © 2010 IEEE.
Original languageEnglish
Title of host publicationProceedings of the 2010 IEEE International Conference on Image Processing, ICIP 2010
Number of pages4
ISBN (Electronic)9781424479948
ISBN (Print)9781424479924
Publication statusPublished - Sept 2010
Externally publishedYes
Event2010 17th IEEE International Conference on Image Processing
- , Hong Kong
Duration: 26 Sept 201029 Sept 2010


Conference2010 17th IEEE International Conference on Image Processing
Abbreviated titleICIP 2010
Country/TerritoryHong Kong


  • H.264/AVC
  • Mode decision
  • Neighboring prediction
  • Probability model


Dive into the research topics of 'Probability-based coding mode prediction for H.264/AVC'. Together they form a unique fingerprint.

Cite this