` 1 High Efficiency Video Coding (HEVC)
Revised/Updated Chapter from the book
VIDEO CODING STANDARDS K. R. Rao, Do Nyeon Kim
J.J. Hwang
Springer 2014
Table of Contents
5 High efficiency video coding (HEVC) Error: Reference source not found
ABSTRACT Error: Reference source not found
5.1 Introduction: Error: Reference source not found
5.2 Joint Collaborative Team on Video Coding (JCT-VC) Error: Reference source not found
Table of Contents 1
5 High efficiency video coding (HEVC) 13
ABSTRACT 13
5.1Introduction: 13
5.2Joint Collaborative Team on Video Coding (JCT-VC) 13
5.3Analysis of coding tools in HEVC Test Model, HM 1.0 – Intra prediction 24
5.4HEVC Encoder 25
5.4.1Intra prediction 31
5.4.2Transform coefficient scanning 33
5.4.3Luma and chroma fractional pixel interpolation 34
5.4.4Comparison of coding tools of HM1 and HEVC draft 9 35
5.5Extensions to HEVC 36
5.6Profiles and levels 36
5.7Performance and computational complexity of HEVC encoders 37
5.8System layer integration of HEVC 38
5.9HEVC lossless coding and improvements [E86] 38
5.10Summary 40
5.11Projects 45
P.5.250 See [E382] This paper explains clearly the fully pipelined architecture for intra prediction in HEVC and achieves a high throughput of 4 pels per clock cycle. It can decode 3840x2160 videos at 30 fps. In the conclusions the authors state “in the future work, we plan to implement the proposed architecture on ASIC platform to increase the system frequency, aiming at achieving real-time video decoding of higher resolution(higher than 4K videos)”. Explore this. 89
P.5.254 See [E384]. After describing the mosaic videos with arbitrary color filter arrays (Fig. 1), the authors propose a novel chroma subsampling strategy (4:2:0 format) for compressing mosaic videos in H.264/AVC and HEVC. They claim that this strategy has the best quality and bitrate compared with previous schemes. 89
H.264 Advance Video Coding (AVC)/ MPEG-4 Part 10 REFERENCES 92
Books on H.264 : 98
H.264 Standard, JM SOFTWARE 99
HEVC (High Efficiency Video Coding) / NGVC (Next Generation Video Coding) References 102
Software repository; Scalable extensions of HEVC 117
Build System 118
Software Structure 118
TS22 http://www3.americanradiology.com/pls/web1/wwimggal.vmg 148
IEEE Journal on Emerging and Selected Topics in Circuits and Systems (JETCAS) 151
SUBJECTIVE EVALUATON OF COMPRESSION ALGORITHMS AND STANDARDS 154
SE14 ITU-R BT2022 (2012) General viewing conditions for subjective assessment of quality of SDTV and HDTV television pictures on at panel displays. International Telecommunication Union. 156
SE15 ITU-R BT500-13 (2012) Methodology for the subjective assessment of the quality of television pictures. International Telecommunication Union. 156
BOOKS ON HEVC 157
Overview Papers: 158
Tutorials: 159
ON LINE COURSES (OLC) 165
OLC1. Video Lecture on Digital Voice and Picture Communication by Prof. S. Sengupta, Department of Electronics and Electrical Communication Engineering IIT Kharagpur -> https://www.youtube.com/watch?v=Tm4C2ZFd3zE 165
Open Source Software : 165
X265 Source code 167
vTune amplifier by Intel 168
General 168
REFERENCES ON SSIM 170
VP8, VP9, VP10 : 174
JPEG 2000: 178
Digital Cinema 180
JPEG 2000 related work 180
JPSearch 181
JPEG-LS: 186
JPEG: 187
JPEG XT 188
JPEG XT Projects: 191
PNG 194
DIRAC (BBC) 195
DAALA 197
Daala video compression 197
Daala is the code-name for a new video compression technology. The effort is a collaboration between Mozilla Foundation, Xiph.Org Foundation and other contributors. 197
The goal of the project is to provide a free to implement, use and distribute digital media format and reference implementation with technical performance superior to h.265. 197
Technology demos 198
Next generation video: Introducing Daala 198
Introducing Daala part 2: Frequency Domain Intra Prediction 198
Introducing Daala part 3: Time/Frequency Resolution Switching 198
Introducing Daala part 4: Chroma from Luma 198
Daala: Painting Images For Fun (and Profit?) 198
Daala: Perceptual Vector Quantization (PVQ) 198
MD1. I. Irondi, Q. wang and C. Grecos, “Subjective evaluation of H.265/HEVC based dynamic adaptive video streaming over HTTP (HEVC-DASH), SPIE-IS&T Electronic Imaging, vol.9400, p. 94000B (session: real-time image and video processing), 2015. 199
AVS China: 200
References on Screen Content Coding 203
BEYOND HEVC: 208
Projects on BEYOND HEVC: 208
Post – HEVC activity 211
Scope 216
Legacy Codec………………………………………………………..…………………………………………………………………….….196
PSNRAVG........................................................................................................................................ 196 Acknowledgements ........................................................................................................................ 196
ACRONYMS
2D Two dimension
3D Three dimension
AAC Advanced Audio Coding
ACM MoVid Association for Computer Machinery Mobile Video
ACQP Adaptive Chroma Quantization Parameter
AHG Ad Hoc Groups
AI All Intra
AR Augmented Reality
AIF Adaptive Interpolation Filter
ALF Adaptive Loop Filter
AMVP Advanced Motion Vector Prediction
AOM Alliance for Open Media
APIF Adaptive Pre-Interpolation Filter
APSIPA Asia Pacific Signal and Information Processing Association
ARM Advanced RISC Machines
ASIC Application-Specific Integrated Circuit
ASIP Application Specific Instruction Set Processor
ASO Arbitrary Slice Order
ATR Average Time Reduction
ATSC Advanced Television Systems Committee
AVC Advanced Video Coding—the official MPEG name is ISO/IEC 14496-10--MPEG-4 Part 10,
and ITU-T name is ITU-T H.264
AVS Audio Video Standard
AU Access Unit
BBC British Broadcasting Corporation
BCBR Block-composed background reference
BD Bjontegaard Delta
BH Beyond HEVC
BL Base Layer
BLA Broken Link Access
bpp Bits per pixel
BRISQUE Blind/reference less image spatial quality evaluator
BS Boundary Strength
BSTM Butterfly Style Transform Matrices
BV Block vector
BVP Block vector prediction
CABAC Context Adaptive Binary Arithmetic Coding
CAVLC Context-adaptive variable-length coding
CCP Cross Component prediction
CE Consumer Electronics, Core Experiment
CfE Call for Evidence
CfP Call for Proposal
CI Confidence Interval
COFDM Co-orthogonal Frequency Division Multiplexing
CPU Central Processing Unit
CRA Clean Random Access
CRA Clean Random Access
CRI Color Remapping Information
CSVT Circuits and Systems for Video Technology
CTC Common Test Conditions
CU Coding Unit
CU Coding Unit
CUDA Compute Unified Device Architecture
CWWSSIM Complex-Wavelet Structural Similarity Index
DASH Dynamic Adaptive Streaming over HTTP
DATE Design, automation and test in Europe
DCC Data Compression Conference
DCT Discrete Cosine Transform
DCTIF Discrete Cosine Transform Interpolation Filters
DDCT Directional Discrete Cosine Transform
DF Deblocking Filter
DIP Digital Image Processing
DiOR Digital Operating Room
DIQA Document Image Quality Assessment
DMB Digital Multimedia Broadcasting
DMVD Decoder side Motion Vector Derivation
DPCM Differential Pulse Code Modulation
DR DIRAC (BBC)
DSC Display Stream Compression
DSCQS Double Stimulus Continuous Quality Scale
DSIS Double Stimulus Impairment Scale
DSP Digital Signal Processing
DSIS Double Stimulus Impairment Scale
DST Digital Sine Transform
DTM Directional Template Matching
DTT Discrete TChebichef Transform
DTV Digital Television
DVB-H Digital Video Broadcasting - Handheld
EBU European Broadcasting Union
EC Error Concealment
EE Electrical Engineering
EGK Exp. Golomb Kth order
EI Electronic Imaging
EL Enhancement Layer
EPFL Ecole Polytechnique Fédérale de Lausanne
ETRI Electronics and Telecommunications Research Institute
EURASIP European Association for Signal Processing
FCDR False contour detection and removal
FDAM Final Draft Amendment
FDIS Final Draft International Standard
FF File Format
FIR Finite Impulse Response
FMO Flexible Macroblock Ordering
FPGA Field Programmable Gate Array
fps Frames per second
GPU Graphics Processing Unit
HD High Definition
HDR High Dynamic Range
HDTV High Definition Television
HE-AAC High Efficiency Advanced Audio Coder
HEIF High Efficiency Image File Format
HEVC High efficiency video coding—the official MPEG name is ISO/IEC 23008-2 MPEG-H
Part 2 and ITU-T name is ITU-T H.265
HEVStream High Efficiency Video Stream
HHI Heinrich Hertz Institute
HLS High Level Syntax
HM HEVC Test Model
HOR Horizontal
HP High Profile
HTTP Hyper Text Transfer Protocol
IASTED International Association of Science and Technology for Development
IBC Intra Block Copy
ICASSP International Conference on Acoustics, Speech, and Signal Processing
ICCE International Conference on Consumer Electronics
ICIEA IEEE Conference on Industrial Electronics and Applications
ICIP International Conference on Image Processing
ICME International Conference on Multimedia and Expo
ICPC International Conference on Pervasive Computing
ICPR International Conference on Pattern Recognition
IDR Intra Decoding Refresh
IEC International Electrotechnical Commission
IEEE Institute of Electrical and Electronics Engineers
ILR Inter Layer Interference
INTDCT Integer Discrete Cosine Transform
intra HE Intra High Efficiency
IPTV Internet Protocol Television
IQA Quality assessment for images
IS & T Information Systems and Technology
ISCAS International Symposium on Circuits and Systems
ISCCSP International Symposium on Communications, Control and Signal Processing
ISDB-T Integrated Services Digital Broadcasting - Terrestrial
ISO International Organization for Standardization
ISOBMFF ISO Based Media File Format
ITS International Telecommunication Symposium
ITU-T Telecommunication Standardization Sector of the International Telecommunications
Union
IVC Internet Video Coding
IVMSP Image, Video, and Multidimensional Signal Processing
J2K JPEG 2000
JCI JND- based compressed image
JCTVC Joint Collaborative Team on Video Coding
JEM Joint Exploration Model
JLS JPEG-LS
JND Just Noticeable Distortion
JM Joint Model
JMKTA JM Key Technology Areas
JPEG Joint Photographic Experts Group
JPEG-XR JPEG extended range
JSVM Joint Scalable Video Model
JTC Joint Technical Committee
JVCIR Journal of Visual Communication and Image Representation
JVT Joint Video Team
JXR JPEG-XR
JXT JPEG- XT
KTA Key Technology Areas
LAR-LLC Locally-adaptive Resolution Lossless low-complexity
LD Low Delay
LDB Low Delay with B pictures
LDP Low Delay with P pictures
LR Low Resolution
LS Lossless (near lossless)
LSC Layer segmentation based coding
L-SEABI Low complexity back projected interpolation
M.S. Masters
MANE Media – Aware Network Element
Mbit/s Megabit per second
MC Motion Compensation
MCL Media Communication Lab
MDDCT Modified Directional Discrete Cosine Transform
MDDT Mode-Dependent Directional Transform
ME Motion Estimation
MJPEG Motion JPEG
MMSP Multimedia Signal Processing
MOMS Maximal-Order interpolation with Minimal Support
MOS Mean Opinion Score
MPEG Moving Picture Experts Group—the official ISO name is ISO/IEC JTC1/SC29/Working
Group 11.
Mpixel Megapixel
Mpm Most Probable Modes
MRSE Mean Root Square Error
MSP Main Still Profile
MV Motion Vector
MVC Multi View Coding
NAB National Association of Broadcasters
NAL Network Abstraction Layer
NGBT Next Generation Broadcast Television
NGVC Next Generation Video Coding
NIQA Natural image quality assessment
NUH NAL Unit Header
NTT Nippon Telegraph and Telephone Corporation
OP Overview Papers
OR Outlier ratio
OSS Open Source Software
PCM Pulse Code Modulation
PCS Picture Coding Symposium
PCoIP PC over IP
PLCC Pearson linear correlation coefficient
PPS Picture Parameter Set
PSNR Peak-to-peak signal to noise ratio
PU Prediction Unit
PVC Perceptual Video Coding
QOE Quality of Experience
QP Quantizer parameter
RA Random Access
RADL Random Access Decodable
RASL Random Access Skipped
RD Rate Distortion
RDOQ Rate-distortion optimized quantization
RDPCM Residual Differential Pulse Code Modulation
RDH Reversible Data Hiding
RICT Recursive Integer Cosine Transform
RL Reference Layer
RMHD Real Media HD
RMVB Real Media Variable Bitrate
ROI Region of interest
ROT Rotational Transform
RTC Real Time Communications
RTP Real-time Transport Protocol
RQT Residual Quad Tree
SAO Sample adaptive offset
SC Sub Committee
SC Stimulus Comparison
SCADA Supervisory Control and Data Acquisition
SCC Screen Content Coding
SCM Screen content coding test module
SDCT Steerable Discrete Cosine Transform
SDR Standard Dynamic Range
SDSCE Simultaneous Double Stimulus Continuous Evaluation
SE Subjective Evaluation
SEI Supplemental Enhancement Information
SELC Sample based weighted prediction for Enhancement Layer Coding SG Study Group
SHV Super Hi-Vision
SHVC Scalable High Efficiency Video Coding
SI Switching I
SIQA Screen image quality assessment
SIMD Single Instruction Multiple Data
SIP Signal and Image Processing
SMPTE Society of Motion Picture and Television Engineers
SoC System on Chip
SHV Super Hi- Vision
SHVC Scalable HEVC
SP Switching P
SPA Signal Processing: Algorithms, Architectures, Arrangements, and Applications
SPEC Shape primitive extraction and coding
SPL Special
SPS Sequence parameter set
Spl H Special Issues on HEVC
SPIE Society of Photo-Optical and Instrumentation Engineers
SR Super Resolution
SROCC Spearman Rank Order Correlation
SS Single Stimulus
SSCQE Single Stimulus Continuous Quality Evaluation
SSIM Structural Similarity
SSST Southeastern Symposium on System Theory
SSVC Spatially Scalable Video Coding
SVC Scalable Video Coding
SWP Sample-based weighted prediction
TB Transform Block
TE Tool Experiment
TS Test Sequence, Transport Stream
TSM Transform skip mode
TENTM Tandberg, Ericsson and Nokia Test Model
TMuC Test Model under Consideration
TMVP Temporal Motion Vector Prediction
TMO Tone Mapping Operator
TSA Temporal Sub-layer Access
TU Transform Unit
Tut Tutorial
TX Texas
TZSearch Test Zone Search
UHD Ultra High Definition
UHDTV Ultra High Definition Television
UTA University of Texas at Arlington
VC Video Coding
VCB Video Coding for Browsers
VCEG Visual Coding Experts Group-he official ITU name is ITU-T/SG 16/Q.6- t
VCIP Visual Communications and Image Processing
VCIR Visual Communication and Image Representation
VDP Visible difference predictor
VER Vertical
VESA Video Electronics Standards Association
ViMSSIM Video modified Structural Similarity
VLSI Very Large Scale Integrated circuit
VPS Video Parameter Set
VQA Video Quality Assessment
VQE Video Quality Experience
VQEG Video Quality Experts Group
VSB Vestigial Sideband
VUI Video Usability Information
WCG Wide Color Gamut
WD Working Draft
WG Working group
WCG Wide Color Gamut
WQVGA Wide Quarter Video Graphics Array
WSIs Whole slide images
WVC Web Video Coding
WVGA Wide Video Graphics Array
YCbCr Y is the Brightness (luma), Cb is blue minus luma (B-Y) and Cr is red minus luma (R-Y)
# of references and # of projects for each category.
Sl. no
|
Subject
|
# of References
|
# of Projects
|
1
|
High efficiency video coding (HEVC)
|
397
|
272
|
2
|
H.264/AVC
|
77
|
-
|
3
|
Subjective Evaluation (SE)
|
21
|
3
|
4
|
Encryption of HEVC (EH)
|
1
|
1
|
5
|
VP 8,9,10 (Google)
|
16
|
5
|
6
|
JPEG2000
|
25
|
2
|
7
|
JPEG-XR
|
10
|
1
|
8
|
JPEG-LS
|
9
|
1
|
9
|
JPEG
|
9
|
5
|
10
|
JPEG-XT
|
11
|
8
|
11
|
JPEG Pleno
|
2
|
2
|
12
|
Locally-adaptive Resolution Lossless low-complexity (LAR-LLC)
|
-
|
6
|
13
|
DIRAC (BBC)
|
12
|
3
|
14
|
DAALA (Mozilla & other contributors)
|
4
|
3
|
15
|
MPEG-DASH
|
1
|
1
|
16
|
Advanced Video Standard (AVS)
|
15
|
7
|
17
|
Thor Video Codec (Cisco)
|
1
|
4
|
18
|
Beyond HEVC
|
4
|
19
|
19
|
AV1 Codec (Alliance for Open Media - AOM)
|
1
|
6
|
20
|
Real Media High Definition (Real Networks)
|
-
|
1
|
21
|
Video Coding 2 (VC2) (SMPTE)
|
-
|
3
|
22
|
Legacy Codec
|
1
|
1
|
Dostları ilə paylaş: |