River publishers

Scope

This standard defines the VC-2 video compression system through the stream syntax, entropy coding, coefficient unpacking process and picture decoding process. The decoder operations are defined by means of a mixture of pseudo-code and mathematical operations.

VC2-P1 Compare the performance of VC2 lossless coding with other lossless coding techniques described in JPEG/JPEG-LS, JPEG-XR, JPEG-XT, JPEG2000, HEVC, H.264, MPEG-2 and DIRAC-PRO based on standard comparison metrics.

VC2-P2 Performance comparison of SDCT with DCT and DDCT is investigated in [E392]. In VC2 replace wavelets with INTSDCT and implement the performance comparison based on various test sequences including 4K and 8K and different block sizes. See the Tables and Figures in [E392].

ATSC (advances television systems committee)

The Advanced Television Systems Committee, Inc., is an international, non-profit organization developing voluntary standards for digital television. The ATSC member organizations represent the broadcast, broadcast equipment, motion picture, consumer electronics, computer, cable, satellite, and semiconductor industries.

Specifically, ATSC is working to coordinate television standards among different communications media focusing on digital television, interactive systems, and broadband multimedia communications. ATSC is also developing digital television implementation strategies and presenting educational seminars on the ATSC standards.

ATSC was formed in 1982 by the member organizations of the Joint Committee on InterSociety Coordination (JCIC): the Electronic Industries Association (EIA), the Institute of Electrical and Electronic Engineers (IEEE), the National Association of Broadcasters (NAB), the National Cable Telecommunications Association (NCTA), and the Society of Motion Picture and Television Engineers (SMPTE). ATSC members represent the broadcast, broadcast equipment, motion picture, consumer electronics, computer, cable, satellite, and semiconductor industries.

International adopters of the ATSC standard include Canada, Dominican Republic, El Salvador, Guatemala, Honduras, Mexico, and South Korea.

ATSC 3.0 CANDIDATE STANDARDS (Dec. 2016)

Next generation broadcast TV

The A/341 Video standard specifies how to encode video in the ATSC 3.0 system. It uses HEVC (H.265) video compression, the latest MPEG video coding standard, and provides support for 4K Ultra HDTV as well as future capabilities for transmission of information to enable wider color gamut, higher frame rates and high dynamic range. This is a candidate standard.

Legacy Codec

LC1. J. Chen et al, “ Efficient Video Coding Using Legacy Algorithmic Approaches,” IEEE Trans. on Multimedia, vol. 14, pp. 111-120, Feb. 2012.

LC-P1. See [LC1] The authors have developed a video codec based on the traditional transform predictive coding aided by motion compensation followed by the QM-coder. While its performance is similar to that of H.264/AVC, the main advantage is its royalty few feature. Implement this legacy codec using various test sequences including ultra HD TV resolution.

DSC by VESA

Display stream compression (DSC) standard developed by Video Electronics Standards Association (VESA) addresses low-cost (light weight compression) visually lossless video codec that meets the requirements of display links. The papers by Walls and MacInnis [DSC1, DSC2] provide the background and an overview of DSC problem and its history. Both the algorithmic compression and performance impact of some tools and test results are presented. As detailed description of DSC is beyond the scope of this book, relevant references and pertinent web sites [DSC3 –DSC5] are listed. Also VESA issued a call for technology in order to standardize a significantly more complex codec called advanced DSC (ADSC) [DSC5] that is visually lossless at a lower bit rate than DSC. Peng et al [OP11] in the overview paper on SCC present not only the details on DSC but also discuss on going work and future outlook on SCC and DSC.

DSC1 F.G. Walls and A.S. MacInnis, “VESA display stream compression for television and cinema applications’, IEEE JETCAS, vol.6, issue 4, pp.360-370, Dec. 2016.

DSC2 MF. Walls and A. MacInnis, “VESA display stream compression:

An overview,” in SID Symp. Dig. Tech. Papers, Jun. 2014, vol. 4. no. 1,

pp. 360–363.

DSC3 Video Electronics Standards Association. (2016). VESA Display Stream

Compression (DSC) Standard v1.2. [Online]. Available: http://vesa.org

DSC4 (Jan. 2013). VESA Finalizes Requirements for Display Stream Com-

pression Standard. [Online]. Available: http://www.vesa.org/news/vesa- finalizes-requirements-for-display-stream-compression-standard/

_press.html

DSC5(Jan. 2015). VESA Issues Call for Technology: Advanced Display Stream Compression. [Online]. Available:


http://www.vesa.org/news/vesa- issues-call-for-technology-advanced-display-stream-compression/

DSC6 VESA Updates Display Stream Compression Standard to Support New Applications and Richer Display Content, Jan. 2016 [online] Available: http://www.vesa.org/featured-articles/vesa-updates-displaystream-compression-standard-to-support-new-applications-and-richerdisplay-content

DSC-P1 Go thru the review papers on DSC [DSC1, DSC2] and confirm the performance results shown in Tables II-V using the corresponding test images. This project is fairly complex and may require group effort.
DSC-P2 Access the web site on call for technology for ADSC [DSC5] and contribute some proposals that can meet the requirements of ADSC. Follow this up in terms of comparing your proposals with proposals submitted by other groups.
DSC-P3 See [DSC6] and access the web site. Explore how the DSC standard can support new applications and richer display content..

PSNRAVG

PSNRAVG is a weighted average of luminance (PSNRY) and chrominance (PSNRU and PSNRV) PSNR components. All involved test sequences are in 4:2:0 color format, for which PSNRAVG is computed as (de facto standard)

PSNRAVG = (6 × PSNRY + PSNRU + PSNRV)/ 8.

Since PSNRAVG also takes the impact of the chrominance components into account, it is supposed to provide more reliable results than the conventional PSNRY metric in the cases when the luminance and chrominance components have dissimilar RD behaviors. See reference below:

B. Li, G. J. Sullivan, and J. Xu, RDO with Weighted Distortion in HEVC, document JCTVC-G401, ITU-T/ISO/IEC Joint Collaborative Team on Video Coding (JCT-VC), Geneva, Switzerland, Nov. 2011.

Magli, Dept. of Electronics and T1elecommunications, Politecnico di Torino, Italy, Dr. W.-K. Cham, Chinese University of Hong Kong, Hong Kong and P. Topiwala, FastVDO for providing various resources in this regard.

Index

2

2D 11, 25, 50, 51, 92, 110, 111, 114, 120, 127, 134, 183, 219

3

3D 11, 29, 40, 46, 47, 54, 66, 127, 134, 139, 141, 147, 148, 149, 159, 170, 175, 180, 203, 222

A

AAC 11, 47, 53, 64, 66, 84, 138, 153, 206, 210

ACM MoVid 11

ACQP 11, 45

ACT 11, 96, 97

adaptive color transform (ACT) 91, 96, 103

color space conversion 97

encoder optimization 97

adaptive motion compensation precision 102

adaptive motion vector resolution 98

Advanced Video Coding 169

AHG 11, 219

AI 11, 46, 74, 80, 81, 84, 123, 205, 220

AIF 11, 50

ALF 11, 26, 50

AMVP 11

AOM 11, 18, 20, 22, 48, 84, 212, 220

APIF 11, 50

APSIPA 11, 114, 132, 133

AR 11

ARM 11, 54, 57, 220, 221

ASIC 11, 84, 86, 177

ASIP 11, 143

ASO 11, 42, 55

ATR 11, 57

ATSC 12, 20, 46, 65, 66, 71, 139, 183, 226, 227

AU 12

AVC 12, 18, 20, 21, 23, 25, 26, 27, 29, 30, 34, 36, 39, 40, 42, 43, 44, 45, 46, 48, 49, 50, 52, 53, 54, 55, 57, 58, 59, 61, 62, 65, 66, 67, 68, 69, 70, 71, 73, 74, 76, 78, 80, 81, 82, 85, 87, 88, 89, 99, 112, 114, 115, 116, 117, 118, 119, 120, 126, 129, 131, 132, 134, 136, 137, 139, 145, 146, 149, 150, 151, 152, 154, 156, 157, 158, 161, 169, 174, 176, 178, 179, 183, 184, 186, 187, 189, 190, 191, 192, 193, 198, 199, 207, 211, 212, 213, 223, 227

AVS 12, 18, 20, 52, 53, 55, 59, 60, 62, 67, 71, 80, 87, 120, 132, 142, 151, 173, 181, 210, 211, 212, 219

B

BBC 5, 12, 18, 20, 56, 81, 206, 207

BD 12, 20, 39, 44, 45, 46, 50, 51, 52, 53, 54, 55, 56, 58, 59, 60, 61, 63, 68, 69, 71, 73, 75, 80, 82, 83, 85, 88, 93, 103, 104, 110, 111, 123, 130, 131, 137, 142, 152, 155, 188, 190, 191, 198, 209, 211, 213, 219, 222

BD-rate 93, 104, 110

BH 12, 218, 219, 220

BL 12, 63, 79

BLA 12

block vector (BV) 92

BMSB 12, 113, 215

bpp 12, 205

BRISQUE 12, 80

BS 12, 130, 188

BSTM 12, 50

BV 12, 92, 104

BVP 12, 104

C

CABAC 12, 27, 28, 30, 35, 36, 46, 47, 54, 88, 129, 142, 144, 157, 179, 218

CAVLC 12, 30

CBF 12, 104

CCP 12, 45, 48, 78, 79, 88, 151

CE 12, 132, 198

CfE 12, 79

CfP 12, 23, 91, 112

CI 12, 24

CIF 12, 207, 208, 225

COFDM 12, 139

CPU 12, 47, 63, 77, 82, 136, 175

CRA 12, 35

CRI 12, 79

CSVT 12, 28, 30, 40, 49, 55, 59, 64, 65, 112, 113, 114, 115, 118, 119, 120, 121, 122, 126, 128, 129, 130, 131, 133, 134, 135, 136, 137, 140, 143, 144, 145, 146, 148, 149, 150, 151, 152, 154, 155, 156, 157, 162, 163, 169, 170, 171, 172, 174, 175, 178, 179, 186, 187, 196, 199, 205, 211, 213, 216, 217

CTC 12

CU 12, 20, 26, 28, 30, 33, 34, 44, 57, 68, 69, 75, 82, 88, 92, 93, 94, 103, 104, 107, 113, 136, 139, 142, 143, 144, 148, 150, 152, 155, 156, 159, 218

CUDA 12, 56, 159

CWWSSIM 12

D

DASH 12, 18, 20, 42, 158, 161, 162, 209

DATE 12, 153

DCC 12, 48, 112, 113, 114, 133, 136, 151, 152, 154, 171, 178, 179, 192, 198, 203, 207, 212, 217

DCT 12, 18, 26, 27, 28, 30, 35, 38, 40, 43, 50, 51, 58, 68, 82, 84, 85, 86, 104, 111, 121, 122, 123, 124, 132, 133, 134, 137, 152, 153, 154, 159, 170, 173, 182, 183, 191, 207, 209, 212, 213, 219, 223, 226

DCTIF 12, 62, 132

DDCT 12, 27, 48, 49, 51, 191, 209, 212, 213, 223, 226

DF 12

DiOR 12, 90

DIP 12, 186

DIQA 12, 104, 105

DMB 12, 117

DMOS 12

DMVD 12, 60

DPCM 12, 61, 89, 98, 99, 110, 112, 134, 135, 213

DR 12, 207

DSC 13, 60, 66, 67, 167

DSCQS 13, 105, 171

DSIS 13, 53, 62, 87, 105

DSP 13, 61, 135, 142, 187

DST 13, 27, 28, 30, 35, 38, 50, 51, 104, 121, 132, 133, 134

DTM 13, 101

DTT 13, 199

DTV 13, 65

DVB-H 13, 117

E

EBU 13, 63, 115, 165, 206

EC 13, 64

EE 13, 48, 49, 56, 65, 77, 117, 120, 128, 132, 137, 138, 150, 153, 179, 185, 190, 201, 206, 210, 216

EGK 13

EI 13, 133, 160

EL 13, 63, 74, 75, 79

EPFL 13, 196, 201

ETRI 13, 126, 127, 134, 141, 154, 158, 159, 163

EURASIP 13, 114, 115, 116, 121

F

fast intra coding 103

FCC 13, 155

FDAM 13, 137

FDIS 13, 29, 41, 54, 133

FF 13

FIR 13, 26

FMO 13, 42, 55

FPGA 13, 47, 58, 75, 149, 177, 183, 199

fps 13, 36, 45, 47, 63, 64, 69, 73, 79, 81, 82, 83, 84, 150, 154

FSIM 13

G

GPU 13, 77, 82, 136, 175

H

HD 13, 20, 21, 23, 27, 41, 47, 48, 50, 55, 61, 63, 65, 83, 87, 118, 120, 122, 135, 136, 139, 162, 192, 193, 196, 197, 212, 223, 227

HDR 13, 21, 48, 79, 80, 88, 145, 147, 152, 181, 200, 201, 202

HDTV 13, 25, 46, 58, 63, 64, 66, 83, 140, 170, 207, 225, 226, 227

HE-AAC 13, 66

HEIF 13, 179

HEVC 12, 13, 18, 20, 21, 25, 26, 27, 28, 29, 30, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 79, 80, 81, 82, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 98, 99, 101, 102, 103, 104, 106, 107, 108, 109, 110, 111, 112, 113, 114, 119, 120, 121, 122, 123, 126, 127, 128, 129, 130, 131, 132, 133, 134, 135, 136, 137, 138, 139, 140, 141, 142, 143, 144, 145, 146, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 157, 158, 159, 160, 161, 162, 163, 164, 165, 167, 168, 169, 173, 174, 175, 176, 177, 178, 179, 180, 181, 182, 184, 186, 187, 189, 190, 191, 198, 199, 205, 206, 207, 208, 209, 211, 212, 213, 214, 215, 216, 217, 218, 219, 220, 221, 222, 226, 227, 229

HEVStream 13, 52, 129

HHI 5, 13, 52, 56, 184

High efficiency video coding 13, 18, 20, 28, 36, 40, 47, 89, 111, 112, 126, 127, 129, 133, 135, 138, 173, 174, 175, 213

HLS 13

HM 13, 20, 28, 29, 43, 44, 45, 46, 49, 56, 57, 59, 60, 61, 62, 63, 64, 67, 68, 69, 71, 72, 73, 74, 75, 77, 78, 79, 81, 83, 86, 88, 103, 108, 112, 119, 129, 131, 136, 138, 143, 144, 153, 155, 160, 165, 168, 173, 174, 180, 181, 215, 219, 220

HOR 13, 35

HP 13, 43, 52, 70, 87, 192, 198

Hyper Text Transfer Protocol 13

I

IASTED 13, 49, 127

IBC 13, 90, 91, 92, 93, 98, 104, 108, 109, 110

ICASSP 112, 113, 114, 119, 121, 133, 134, 135, 140, 152, 176, 185, 186, 187, 215

ICCE 48, 67, 122, 133, 135, 136, 137, 140, 145, 146, 153, 156, 157, 176, 183, 187, 199

ICIEA 50, 127, 175

ICIP 40, 50, 51, 52, 112, 113, 114, 115, 116, 124, 127, 128, 131, 134, 137, 146, 147, 148, 150, 153, 154, 176, 178, 179, 183, 185, 186, 190, 192, 201, 208, 210, 215, 216, 219

ICME 58, 114, 134, 136, 139, 140, 144, 175, 176, 179, 186, 189, 210, 214

ICPC 145, 178

ICPR 186

ICT 13, 123

IDR 13

IEC 12, 14, 15, 20, 23, 32, 36, 40, 41, 42, 47, 58, 66, 89, 112, 113, 115, 116, 118, 119, 121, 126, 127, 133, 137, 140, 156, 167, 169, 179, 192, 193, 196, 214, 216, 217, 219, 220, 223, 229

ILR 14

INTDCT 14, 31, 81, 191, 209, 212, 213, 219, 220, 223

Internet Video Coding 14, 70, 71, 156

intra block copy (IBC) 90, 92, 111

hash-based 93, 98, 103, 110

symmetric 110

intra HE 14, 56

intra line copy 111

intra string copy 111

IPTV 14, 42, 146, 158

IQA 14, 104, 105, 172, 173

IS & T 14

ISCAS 14, 50, 113, 114, 127, 128, 129, 136, 170, 176, 179, 183, 215

ISCCSP 116

ISDB-T 14, 117

ITM 14, 70

J

J2K 14, 195, 196

JCI 14, 165

JLS 14, 198

JPEG 14, 18, 20, 43, 45, 48, 53, 54, 55, 57, 63, 68, 83, 105, 115, 132, 153, 165, 180, 181, 182, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 212, 219, 226

JPEG 2000 14, 48, 53, 63, 68, 83, 132, 153, 181, 191, 192, 193, 194, 195, 196

JPEG-LS 14, 18, 20, 43, 45, 48, 54, 55, 63, 68, 197, 198, 200, 226

JPEG-XR 14, 18, 45, 48, 54, 55, 57, 202, 226

Just Noticeable Difference (JND) 111

L

L-SEABI 14, 80

LAR-LLC 14, 18, 205

LCICT 14, 123

LD 14, 46, 74, 80, 81, 84, 87, 153

LDB 14, 123

LDP 14

LOCO 14, 198

LSC 14, 105

M

MANE 14

MDDCT 15, 50

MDDT 15, 26, 27, 40, 49, 50, 128, 155

MMSP 15, 132, 155, 166

MOMS 15, 54

MOS 15, 24, 25, 62, 68, 71, 106, 107, 131, 162, 188, 200

Motion Compensation 15, 113, 219

Motion Estimation 15, 73, 118, 146, 150, 157

Motion JPEG 15, 49

Motion Vector 11, 12, 15, 60, 219

Mpm 15

MRSE 15, 200

MSP 15, 68

Multi View Coding 15

N

NAL 15, 52

NAL Unit Header 15

NIQA 15, 104, 105

O

Open Source Software 15

P

P2SM 15, 110

palette mode 93

coding entries 94

coding indices 95

palette derivation 94

PCM 15, 35, 45, 51, 179

PCoIP 15, 90

Perceptual Vector Quantization 15, 208

Perceptual Video Coding 15, 70, 145, 187

PLCC 15

PPS 15, 94

Prediction Unit 15

Q

QOE 15, 209

R

RADL 15

Random Access 12, 15, 24, 46, 74, 219

RASL 15

rate control 107

Rate Distortion 15, 146, 186

RDOQ 15, 35

RDPCM 15, 61, 99, 100

Real Media HD 15

Reference Layer 15

residual DPCM 98

Reversible Data Hiding 15

RICT 15, 79, 122, 123

RMVB 15, 223

ROI 15, 47, 64, 148

Rotational Transform 15

RQT 16, 45, 68

RTC 16

RTP 16, 42

S

sample-based prediction

angular intra 101

angular intra with edge 101

weighted 100

SAO 16, 20, 26, 27, 33, 34, 35, 36, 62, 69, 83, 86, 151, 153, 160

SCADA 16, 90

Scalable HEVC 16

Scalable High Efficiency Video Coding 16

Scalable Video Coding 16, 57, 58, 65, 119

SCM 16, 73, 74, 94, 104, 111, 112, 143, 144, 181, 215

Screen Content Coding 16, 69, 89, 91, 112, 113, 114, 144, 148, 149, 152, 168, 175, 213, 214, 215, 216

screen contents 90

coding tools 91

features 90

screen image quality assessment (SIQA) 104

objective 106

subjective 107

SDCT 16, 27, 86, 87, 191, 207, 209, 212, 213, 223, 226

SDCT-AM 16

SDCT-BT 16

SDSCE 16, 105

segmentation 107

SEI 16

SELC 16, 43

SHV 16, 41, 46, 47

Signal and Image Processing 16

SIMD 16, 44, 47, 57, 68, 131, 132, 144

SIQA 16, 104

SIQM 16, 106

SMF 16

SoC 16, 47, 221

SP 16, 42, 55, 65, 117, 186

SPA 16, 117, 134

Spatially Scalable Video Coding 16

SPEC 16, 107

Special Issues on HEVC 16

SPS 16, 94

SSCQE 16, 105

Standard Dynamic Range 16

Stimulus Comparison 16, 105

string matching 110

Structural Similarity 12, 16, 105, 187

Sub Committee 16

Subjective Evaluation 16, 18

Super Resolution 16

SVQA 16

SWP 16, 100, 101

T

template matching 110

Test Sequence 16

Test Zone Search 17

TMO 17

TMuC 17, 25, 26, 27, 49, 51, 56, 189

TMVP 17

Transform Block 16

transform skip 90, 104, 111

Transform Unit 17

Transport Stream 16

TSA 17

TSF 17, 104

TSM 16, 104, 111

TZSearch 17, 57, 83, 134, 152, 153

V

VCB 17, 70, 87, 156

VCIP 17, 113, 117, 119, 131, 132, 140, 178, 186, 190, 210, 213

VCIR 17, 49, 50, 126, 169, 186

VDI 17, 90

VDP 17, 201

Vector Quantization 17

Vertical 17, 111

VESA 17, 66, 67

Video Coding 1, 12, 14, 15, 17, 18, 20, 28, 29, 40, 60, 70, 77, 87, 89, 111, 112, 114, 115, 116, 120, 122, 123, 126, 127, 140, 141, 142, 143, 144, 145, 146, 147, 148, 149, 150, 151, 152, 153, 155, 157, 161, 163, 166, 167, 168, 169, 173, 174, 175, 176, 177, 179, 182, 184, 186, 188, 210, 214, 215, 216, 219, 220, 227, 229

Video Quality Assessment 17, 170, 171

ViMSSIM 17, 186

VLSI 17, 36, 47, 79, 83, 127, 144, 146, 148, 151, 155, 156

VPS 17

VSB 17, 66, 139

VUI 17

W

WCG 17, 21, 48, 79, 80

Web Video Coding 17

WPP 17, 47

WQVGA 17

WVGA 17, 23, 47, 72

Y

YCbCr 17, 23, 41, 78, 91, 151