5 High efficiency video coding (HEVC) 20
5.1 Introduction: 20
5.2 Joint Collaborative Team on Video Coding (JCT-VC) 20
5.3 Analysis of coding tools in HEVC Test Model, HM 1.0 – Intra prediction 28
5.4 HEVC Encoder 30
5.4.1 Intra prediction 35
5.4.2 Transform coefficient scanning 37
5.4.3 Luma and chroma fractional pixel interpolation 38
5.4.4 Comparison of coding tools of HM1 and HEVC draft 9 40
5.5 Extensions to HEVC 40
5.6 Profiles and levels 41
5.7 Performance and computational complexity of HEVC encoders 42
5.8 System layer integration of HEVC 42
5.9 HEVC lossless coding and improvements [E86] 42
5.10 Summary 44
5.11 Projects 48
P.5.250 See [E382] This paper explains clearly the fully pipelined architecture for intra prediction in HEVC and achieves a high throughput of 4 pels per clock cycle. It can decode 3840x2160 videos at 30 fps. In the conclusions the authors state “in the future work, we plan to implement the proposed architecture on ASIC platform to increase the system frequency, aiming at achieving real-time video decoding of higher resolution(higher than 4K videos)”. Explore this. 84
P.5.254 See [E384]. After describing the mosaic videos with arbitrary color filter arrays (Fig. 1), the authors propose a novel chroma subsampling strategy (4:2:0 format) for compressing mosaic videos in H.264/AVC and HEVC. They claim that this strategy has the best quality and bitrate compared with previous schemes. 85
8 Screen Content Coding for HEVC 89
ABSTRACT 89
Keywords 89
8.1 Introduction to SCC 89
8.2 Screen Content coding tools 91
8.2.1 Intra Block Copy 92
8.2.2 Palette mode 93
8.2.3 Adaptive color transform (ACT) 96
8.2.4 Adaptive motion vector resolution 98
8.3 Lossless and visually lossless coding algorithms 98
8.3.1 Residual DPCM 98
8.3.2 Sample-based weighted prediction with directional template matching 100
8.3.3 Sample-based angular intra-prediction 101
8.3.4 Sample-based angular intra-prediction with edge prediction 101
8.4 Fast coding algorithms 102
8.4.1 Adaptive motion compensation precision 102
8.4.2 Fast intra coding 103
8.5 Visual quality assessment 104
8.5.1 Screen image quality assessment 104
8.5.2 Objective quality assessment 105
8.5.3 Subjective quality assessment 106
8.6 Other SCC algorithms 107
8.6.1 Segmentation 107
8.6.2 Rate control 107
8.7 Summary 109
8.8 Projects 110
References 111
H.264 Advance Video Coding (AVC)/ MPEG-4 Part 10 REFERENCES 115
Books on H.264 : 120
H.264 Standard, JM SOFTWARE 120
HEVC (High Efficiency Video Coding) / NGVC (Next Generation Video Coding) References 126
Software repository; Scalable extensions of HEVC 138
Build System 138
Software Structure 138
TS22 http://www3.americanradiology.com/pls/web1/wwimggal.vmg 166
IEEE Journal on Emerging and Selected Topics in Circuits and Systems (JETCAS) 166
SUBJECTIVE EVALUATON OF COMPRESSION ALGORITHMS AND STANDARDS 169
SE14 ITU-R BT2022 (2012) General viewing conditions for subjective assessment of quality of SDTV and HDTV television pictures on at panel displays. International Telecommunication Union. 170
SE15 ITU-R BT500-13 (2012) Methodology for the subjective assessment of the quality of television pictures. International Telecommunication Union. 170
Overview Papers: 174
ON LINE COURSES (OLC) 180
OLC1. Video Lecture on Digital Voice and Picture Communication by Prof. S. Sengupta, Department of Electronics and Electrical Communication Engineering IIT Kharagpur -> https://www.youtube.com/watch?v=Tm4C2ZFd3zE 180
Open Source Software : 180
X265 Source code 182
vTune amplifier by Intel 182
General 183
REFERENCES ON SSIM 185
VP8, VP9, VP10 : 188
JPEG 2000: 191
Digital Cinema 193
JPEG 2000 related work 193
JPSearch 193
JPEG-LS: 197
JPEG: 198
JPEG-P7 See [JPEG11].In conclusion he authors state “In future work, we will work on speeding up the proposed algorithm to make it more practical”. Explore this. 199
JPEG XT 200
JPEG XT Projects: 202
PNG 205
DIRAC (BBC) 206
DAALA 207
Daala video compression 208
Daala is the code-name for a new video compression technology. The effort is a collaboration between Mozilla Foundation, Xiph.Org Foundation and other contributors. 208
The goal of the project is to provide a free to implement, use and distribute digital media format and reference implementation with technical performance superior to h.265. 208
Technology demos 208
Next generation video: Introducing Daala 208
Introducing Daala part 2: Frequency Domain Intra Prediction 208
Introducing Daala part 3: Time/Frequency Resolution Switching 208
Introducing Daala part 4: Chroma from Luma 208
Daala: Painting Images For Fun (and Profit?) 208
Daala: Perceptual Vector Quantization (PVQ) 208
MD1. I. Irondi, Q. wang and C. Grecos, “Subjective evaluation of H.265/HEVC based dynamic adaptive video streaming over HTTP (HEVC-DASH), SPIE-IS&T Electronic Imaging, vol.9400, p. 94000B (session: real-time image and video processing), 2015. 209
AVS China: 210
References on Screen Content Coding 213
BEYOND HEVC: 217
Projects on BEYOND HEVC: 218
Post – HEVC activity 220
Scope 226
Legacy Codec ..…………………………………………………….……………………………………………………………………..... 221
DSC by VESA .................................................................................................................................... 221
PSNRAVG......................................................................................................................................... 223
ACRONYMS
2D Two dimension
3D Three dimension
AAC Advanced Audio Coding
ACM MoVid Association for Computer Machinery Mobile Video
ACQP Adaptive Chroma Quantization Parameter
ACT Adaptive Color Transform
ADSC Advanced DSC
AI All Intra
AHG Ad Hoc Groups
AR Augmented Reality
AIF Adaptive Interpolation Filter
ALF Adaptive Loop Filter
AMVP Advanced Motion Vector Prediction
AOM Alliance for Open Media
APIF Adaptive Pre-Interpolation Filter
APSIPA Asia Pacific Signal and Information Processing Association
ARM Advanced RISC Machines
ASIC Application-Specific Integrated Circuit
ASIP Application Specific Instruction Set Processor
ASO Arbitrary Slice Order
ATR Average Time Reduction
ATSC Advanced Television Systems Committee
AVC Advanced Video Coding—the official MPEG name is ISO/IEC 14496-10--MPEG-4 Part 10,
and ITU-T name is ITU-T H.264
AVS Audio Video Standard
AU Access Unit
BBC British Broadcasting Corporation
BD Bjontegaard Distortion
BH Beyond HEVC
BL Base Layer
BLA Broken Link Access
BMSB Broadband Multimedia Systems and Broadcasting
bpp Bits per pixel
BRISQUE Blind/reference-less image spatial quality evaluator
BS Boundary Strength
BSTM Butterfly Style Transform Matrices
BTC Block Truncation Coding
BV Block vector
BVP Block vector prediction
CABAC Context Adaptive Binary Arithmetic Coding
CAVLC Context-adaptive variable-length coding
CBF Coded block flag
CCP Cross Component prediction
CE Consumer Electronics, Core Experiment
CfE Call for Evidence
CfP Call for Proposal
CI Confidence Interval
CIC Compound Image Compression
CIF Common Intermediate Format
COFDM Co-orthogonal Frequency Division Multiplexing
CPU Central Processing Unit
CRA Clean Random Access
CRI Color Remapping Information
CSVT Circuits and Systems for Video Technology
CTC Common Test Conditions
CU Coding Unit
CUDA Compute Unified Device Architecture
CWWSSIM Complex-Wavelet Structural Similarity Index
DASH Dynamic Adaptive Streaming over HTTP
DATE Design, automation and test in Europe
DCC Data Compression Conference
DCT Discrete Cosine Transform
DCTIF Discrete Cosine Transform Interpolation Filters
DDCT Directional Discrete Cosine Transform
DF Deblocking Filter
DIP Digital Image Processing
DiOR Digital Operating Room
DIQA Document Image Quality Assessment
DMB Digital Multimedia Broadcasting
DMVD Decoder side Motion Vector Derivation
DMOS Difference Mean Opinion Score
DPCM Differential Pulse Code Modulation
DR DIRAC (BBC)
DSC Display Stream Compression
DSCQS Double Stimulus Continuous Quality Scale
DSIS Double Stimulus Impairment Scale
DSP Digital Signal Processing
DST Digital Sine Transform
DTM Directional Template Matching
DTT Discrete Tchebichef Transform
DTV Digital Television
DVB-H Digital Video Broadcasting - Handheld
EBU European Broadcasting Union
EC Error Concealment
EE Electrical Engineering
EGK Exp. Golomb Kth order
EI Electronic Imaging
EL Enhancement Layer
EPFL Ecole Polytechnique Fédérale de Lausanne
ETRI Electronics and Telecommunications Research Institute
EURASIP European Association for Signal Processing
FCC False Contour Candidate
FDAM Final Draft Amendment
FDIS Final Draft International Standard
FF File Format
FIR Finite Impulse Response
FMO Flexible Macroblock Ordering
FPGA Field Programmable Gate Array
fps Frames per second
FSIM Feature Similarity
GPU Graphics Processing Unit
HD High Definition
HDR High Dynamic Range
HDTV High Definition Television
HE-AAC High Efficiency Advanced Audio Coder
HEIF High Efficiency Image File Format
HEVC High efficiency video coding—the official MPEG name is ISO/IEC 23008-2 MPEG-H
Part 2 and ITU-T name is ITU-T H.265
HEVStream High Efficiency Video Stream
HHI Heinrich Hertz Institute
HLS High Level Syntax
HM HEVC Test Model
HOR Horizontal
HP High Profile
HTTP Hyper Text Transfer Protocol
IASTED International Association of Science and Technology for Development
IBC Intra Block Copy
ICASSP International Conference on Acoustics, Speech, and Signal Processing
ICCE International Conference on Consumer Electronics
ICIEA IEEE Conference on Industrial Electronics and Applications
ICIP International Conference on Image Processing
ICME International Conference on Multimedia and Expo
ICPC International Conference on Pervasive Computing
ICPR International Conference on Pattern Recognition
ICT Integer Cosine Transform
IDR Intra Decoding Refresh
IEC International Electrotechnical Commission
IEEE Institute of Electrical and Electronics Engineers
ILR Inter Layer Interference
INTDCT Integer Discrete Cosine Transform
intra HE Intra High Efficiency
IPTV Internet Protocol Television
IQA Image Quality Assessment
IS & T Information Systems and Technology
ISCAS International Symposium on Circuits and Systems
ISCCSP International Symposium on Communications, Control and Signal Processing
ISDB-T Integrated Services Digital Broadcasting - Terrestrial
ISO International Organization for Standardization
ISOBMFF ISO Based Media File Format
ITS International Telecommunication Symposium
ITU-T Telecommunication Standardization Sector of the International Telecommunications
Union
IVC Internet Video Coding
ITM Internet Video Coding Test Model
IVMSP Image, Video, and Multidimensional Signal Processing
J2K JPEG 2000
JCI JND- based compressed image
JCTVC Joint Collaborative Team on Video Coding
JEM Joint Exploration Test Model
JETCAS Journal on Emerging and Selected Topics in Circuits and Systems
JLS JPEG-LS
JM Joint Model
JMKTA JM Key Technology Areas
JND Just Noticeable Distortion
JPEG Joint Photographic Experts Group
JPEG-XR JPEG extended range
JSVM Joint Scalable Video Model
JTC Joint Technical Committee
JVCIR Journal of Visual Communication and Image Representation
JVET Joint Video Exploration Team
JVT Joint Video Team
JXR JPEG-XR
JXT JPEG- XT
KTA Key Technology Areas
LAR-LLC Locally-adaptive Resolution Lossless low-complexity
LCICT Low Complexity Integer Cosine Transform
LD Low Delay
LDB Low Delay with B pictures
LDP Low Delay with P pictures
LOCO Low Complexity
LR Low Resolution
LS Lossless (near lossless)
LSC Layer segmentation based coding
L-SEABI Low complexity back projected interpolation
M.S. Masters
MANE Media – Aware Network Element
Mbit/s Megabit per second
MC Motion Compensation
MCC Mixed Content Coding
MCL Media Communication Lab
MDDCT Modified Directional Discrete Cosine Transform
MDDT Mode-Dependent Directional Transform
ME Motion Estimation
MJPEG Motion JPEG
MMSP Multimedia Signal Processing
MOMS Maximal-Order interpolation with Minimal Support
MOS Mean Opinion Score
MPEG Moving Picture Experts Group—the official ISO name is ISO/IEC JTC1/SC29/Working
Group 11.
Mpixel Megapixel
Mpm Most Probable Modes
MRSE Mean Root Square Error
MSP Main Still Profile
MV Motion Vector
MVC Multi View Coding
NAB National Association of Broadcasters
NAL Network Abstraction Layer
NGBT Next Generation Broadcast Television
NGVC Next Generation Video Coding
NIQA Natural image quality assessment
NUH NAL Unit Header
NTT Nippon Telegraph and Telephone Corporation
OP Overview Papers
OR Outlier ratio
OSS Open Source Software
P2SM Pseudo 2D String Matching
PCM Pulse Code Modulation
PCS Picture Coding Symposium
PCoIP PC over IP
PLCC Pearson linear correlation coefficient
PPS Picture Parameter Set
PSNR Peak-to-peak signal to noise ratio
PU Prediction Unit
PVC Perceptual Video Coding
PVQ Perceptual Vector Quantization
QOE Quality of Experience
QP Quantizer parameter
RA Random Access
RADL Random Access Decodable
RASL Random Access Skipped
RD Rate Distortion
R&D Research and Development
RDOQ Rate-distortion optimized quantization
RDPCM Residual Differential Pulse Code Modulation
RDH Reversible Data Hiding
RICT Recursive Integer Cosine Transform
RL Reference Layer
RMHD Real Media HD
RMVB Real Media Variable Bitrate
ROI Region of interest
ROT Rotational Transform
RTC Real Time Communications
RTP Real-time Transport Protocol
RQT Residual Quad Tree
SAO Sample adaptive offset
SC Sub Committee
SC Stimulus Comparison
SCADA Supervisory Control and Data Acquisition
SCC Screen Content Coding
SCM Screen content coding test module
SDCT Steerable Discrete Cosine Transform
SDCT-AM Steerable Discrete Cosine Transform-Alternated Minimization
SDCT-BT Steerable Discrete Cosine Transform-Binary Tree
SDM Structural Degradation Model
SDR Standard Dynamic Range
SDSCE Simultaneous Double Stimulus Continuous Evaluation
SE Subjective Evaluation
SEI Supplemental Enhancement Information
SELC Sample based weighted prediction for Enhancement Layer Coding
SG Study Group
SHV Super Hi-Vision
SHVC Scalable High Efficiency Video Coding
SI Switching I
SIQA Screen image quality assessment
SIQM Structure Induced Quality Metric
SIMD Single Instruction Multiple Data
SIP Signal and Image Processing
SMF Sparse Matrix Factors
SMPTE Society of Motion Picture and Television Engineers
SoC System on Chip
SHV Super Hi- Vision
SHVC Scalable HEVC
SP Switching P
SPA Signal Processing: Algorithms, Architectures, Arrangements, and Applications
SPEC Shape primitive extraction and coding
SPL Special
SPS Sequence parameter set
Spl H Special Issues on HEVC
SPIE Society of Photo-Optical and Instrumentation Engineers
SR Super Resolution
SROCC Spearman Rank Order Correlation
SS Single Stimulus
SSCQE Single Stimulus Continuous Quality Evaluation
SSIM Structural Similarity
SSST Southeastern Symposium on System Theory
SSVC Spatially Scalable Video Coding
SVC Scalable Video Coding
SVQA Subjective VQA
SWP Sample-based weighted prediction
TB Transform Block
TE Tool Experiment
TS Test Sequence, Transport Stream
TSM Transform skip mode
TENTM Tandberg, Ericsson and Nokia Test Model
TMuC Test Model under Consideration
TMVP Temporal Motion Vector Prediction
TMO Tone Mapping Operator
TSA Temporal Sub-layer Access
TSF Transform skip flag
TU Transform Unit
Tut Tutorial
TX Texas
TZSearch Test Zone Search
UHD Ultra High Definition
UHDTV Ultra High Definition Television
UTA University of Texas at Arlington
VC Video Coding
VCB Video Coding for Browsers
VCEG Visual Coding Experts Group-he official ITU name is ITU-T/SG 16/Q.6- t
VCIP Visual Communications and Image Processing
VCIR Visual Communication and Image Representation
VDI Virtual desktop infrastructure
VDP Visible difference predictor
VER Vertical
VESA Video Electronics Standards Association
ViMSSIM Video modified Structural Similarity
VLSI Very Large Scale Integrated circuit
VPS Video Parameter Set
VQ Vector Quantization
VQA Video Quality Assessment
VQEG Video Quality Experts Group
VSB Vestigial Sideband
VUI Video Usability Information
WCG Wide Color Gamut
WPP Wavefront Parallel Processing
WD Working Draft
WG Working group
WQVGA Wide Quarter Video Graphics Array
WSIs Whole slide images
WVC Web Video Coding
WVGA Wide Video Graphics Array
YCbCr Y is the Brightness (luma), Cb is blue minus luma (B-Y) and Cr is red minus luma (R-Y)
# of references and # of projects for each category.
Sl. no
|
Subject
|
# of References
|
# of Projects
| -
|
High efficiency video coding (HEVC)
|
406
|
291
| -
|
Screen content coding (SCC)
|
90
|
15
| -
|
H.264/AVC
|
78
|
-
| -
|
DCT References
|
24
|
25
| -
|
Subjective Evaluation (SE)
|
28
|
3
| -
|
Encryption of HEVC (EH)
|
1
|
1
| -
|
VP 8,9,10 (Google)
|
16
|
5
| -
|
JPEG2000
|
25
|
2
| -
|
JPEG-XR
|
10
|
1
| -
|
JPEG-LS
|
9
|
1
| -
|
JPEG
|
11
|
7
| -
|
JPEG-XT
|
11
|
8
| -
|
JPEG PLENO
|
2
|
2
| -
|
JPEG XS
|
3
|
1
| -
|
Locally-adaptive Resolution Lossless low-complexity (LAR-LLC)
|
1
|
6
| -
|
DIRAC (BBC)
|
12
|
3
| -
|
DAALA (Mozilla & other contributors)
|
4
|
3
| -
|
MPEG-DASH
|
1
|
1
| -
|
Advanced Video Standard (AVS) China
|
17
|
8
| -
|
Thor Video Codec (Cisco)
|
1
|
4
| -
|
Beyond HEVC
|
6
|
19
| -
|
AV1 Codec (Alliance for Open Media - AOM)
|
1
|
7
| -
|
Real Media High Definition (Real Networks)
|
-
|
1
| -
|
VC1
|
8
|
1
| -
|
Video Coding 2 (VC2) (SMPTE)
|
-
|
2
| -
|
Legacy Codec
|
1
|
1
| -
|
DSC by VESA
|
5
|
3
|
Dostları ilə paylaş: |