Joint Collaborative Team on Video Coding (jct-vc) of itu-t sg16 wp3 and iso/iec jtc1/SC29/WG11

6.6SEI messages (13)

6.6.1Motion and prediction constrained SEI messages (5)

JCTVC-N0069 Motion and inter-layer prediction constrained SEI message [K. Ugur, M. M. Hannuksela (Nokia)]

(Reviewed Thu. 25th p.m. in Track A (GJS).)

One potential application of SHVC is to enhance the quality of a region of interest (ROI) of the base layer picture with the enhancement layer. In such use, as only a certain region of the picture is enhanced, it would be useful to indicate the details of this operation to avoid redundant decoding of certain regions and minimize complexity. It is asserted that tiles, and more specifically motion-constrained tiles, can be used to support the ROI quality enhancement use case. This contribution proposes some modifications to the motion-constrained tile sets SEI message with the aim of supporting ROI enhancement.

Presentation to be uploaded.

Two scenarios:

• 
  Enhancing an ROI, leaving some non-ROI area the same as the base layer (except perhaps for resampling).
  
• 
  Enhancing an ROI without using BL texture, leaving some non-ROI area the same as the base layer. (A further constraint relative to the first scenario.)
  

The second scenario is related to N0117 and N0236.

Proposes to:

• 
  Indicate "skipped tile sets" where the EL area is identical to the (possibly upsamplesd) BL.
  
• 
  Indicate no-inter-layer-prediction tile sets.
  

by adding additional syntax elements for each tile set rectangle.

In discussion, it was asked what is the purpose of the layer ID syntax element and its relationship with scalable nesting and the layer ID in the NUH.

It was remarked that N0159 is also related.

Revisit after consideration of all potentially-related contributions.
JCTVC-N0087 Inter-layer constrained tile sets SEI message [K. Suehring, R. Skupin, Y. Sanchez, T. Schierl (FhG HHI)]

(Reviewed in Track B Sun. 28th (AS).)

This contribution proposes an SEI message that indicates inter-layer decoding independence between tiles. The syntax is aligned with the (temporal) motion constrained tile sets SEI message. In addition to region of interest based decoding, a decoder can use the information provided by the SEI message for load assignment, e.g. parallel decoding of tiles.

Uses the structure of the motion constrained tile sets SEI message to signal that tiles are independent for inter-layer prediction.

In addition, the proposal also contains a flag to signal that all the tiles are independent.

This is similar to N0159 (proposal 3).

The proposal is also applicable to multi-view coding.

It was commented that there may be a conflict between this application and region of interest signaling.

Others asserted that the proposed method could co-exist with the signaling of region of interest tile sets.

It was commented that region of interest and parallelisation, which is the goal of this proposal, are different applications.

One expert commented that the relationship between motion constrained tile sets and inter-layer constrained tile sets should be discussed.

JCTVC-N0088 Extension of (temporal) motion constrained tile sets SEI message [K. Suehring, R. Skupin, Y. Sanchez, T. Schierl (FhG HHI)]
JCTVC-N0117 HLS: Extensions to Motion-constrained tile sets SEI message [S. Hattori, O. Nakagami, T. Suzuki (Sony)]
JCTVC-N0236 HLS: Extensions of motion-constrained tile sets SEI message for interactivity [C. Auyeung, J. Xu (Sony)]

6.6.2Layer presence and dependency change SEI messages (2)

See BoG report N0374.

JCTVC-N0173 MV-HEVC/SHVC HLS: On Layers Present SEI message [J. W. Kang (ETRI), J. Lee, H. Lee, J. S. Choi, T. C. Thang (UoA)]
JCTVC-N0174 MV-HEVC/SHVC HLS: On Layer Dependency Change SEI message [T. C. Thang (UoA), J. W. Kang, J. Lee, H. Lee, J. S. Choi (ETRI)]

6.6.3Frame packing SEI messages (3)

JCTVC-N0133 HLS: Frame packing arrangement SEI message for bit depth extension [B. Choi, Y. Cho, M. W. Park, J. Y. Lee, H. Wey, C. Kim (Samsung)] [late]

TBA.

For further study.

JCTVC-N0134 HLS: Frame packing arrangement SEI message for full resolution 3D [B. Choi, Y. Cho, M. W. Park, J. Y. Lee, H. Wey, C. Kim (Samsung)] [late]

TBA.

For further study.

JCTVC-N0270 Updated proposal with software for frame packing arrangement SEI message for 4:4:4 content in 4:2:0 bitstreams [Y. Zhang, Y. Wu, S. Kanumuri, S. Sadhwani, G. J. Sullivan, H. S. Malvar (Microsoft)]

This contribution proposes a method to extend the use of the frame packing arrangement SEI message to represent 4:4:4 content in nominally 4:2:0 bitstreams. The contribution is an update of the prior contributions JCTVC-K0240, JCTVC-L0316 and JCTVC-M0281 that provides software and specification text with a graphical illustration (as reported to be requested during discussion at the previous meeting). With the proposed method, it is reported that one constituent frame (e.g. in a top-bottom packing or alternating-frame coding scheme) can be decoded compatibly as an ordinary 4:2:0 image, or can be supplemented with the data from another constituent frame to form a complete 4:4:4 image representation. It is proposed to include support for the additional scheme into the frame packing arrangement SEI message in both AVC and HEVC, to facilitate deployment of systems using this method. Since 4:2:0 is the most widely supported format in products, it is asserted that having an effective way of conveying 4:4:4 content through such decoders can provide the substantial benefit of enabling widespread near-term deployment of 4:4:4 capabilities (especially for screen content coding). The proposed method operates by packing the samples of a 4:4:4 frame into two 4:2:0 frames and encoding the two 4:2:0 frames as the constituent frames of a frame packing arrangement. The semantics of 'content_interpretation_type' are extended to signal this packing arrangement. The proposed scheme is asserted to be of high practical value for applications involving screen content. Relative to native 4:4:4 encoding, the proposed scheme can provide the advantage of compatibility with the ordinary 4:2:0 decoding process that is expected to be more widely supported in decoding products. It is reported that the attached software is capable of handling the frame-packing and frame-unpacking processes and can be used in conjunction with any 4:2:0 codec.

Basically the same as previously proposed. Update includes software and improved text.

TBP.

6.6.4Color enhancement SEI messages (2)

JCTVC-N0180 Color Mapping SEI message [Philippe Bordes, Pierre Andrivon, Patrick Lopez, Franck Hiron (Technicolor)]
JCTVC-N0224 SEI message: post filters to enhance the chroma planes [J. Dong, Y. Ye, Y. He (InterDigital)]

6.6.5Other SEI messages (1)

JCTVC-N0286 Time code SEI message [C. Fogg, B. Lewis, J. Lassahn, T. Prins (Elmental)]