CDVS works on describing contents of an image. This activity wants to extend content description to video. Applications are in video retrieval, computer vision, automotive, security and other application where many video streams need to be evaluated (). Related technology within MPEG can be found in MPEG-7 and video signatures.
Figure 3: The upper part of the diagram shows the “Analyze-Then-Compress” (ATC) paradigm. That is, sets of video features are extracted from raw frames end encoded before transmission resulting in lwo bandwidth communications. This is opposite to traditional “Compress-Then-Analyze” (CTA) paradigm, in which video features are extracted close to complex visual analysis. N14093 Compact Descriptors for Video Search summarizes the context and goals of the exploration. N14094 Compact Descriptors for Video Search: Objectives, Applications and Use Cases reflects thoughts towards applications and requirements. Requirements are outlined in N14095 Draft Requirements for compact descriptors for video search. For some new test data, the usage terms are provided in N14283 Terms and Conditions for the use of audiovisual material in the context of MPEG Compact Descriptors for Video Search provided by RAI. The adhoc group N14164 AHG on compact descriptors for video search will refine applications and requirements. Furthermore, a timeline needs to be defined.
3DV Exploration
Free Viewpoint TV was the vision that drove the development of many different 3D video coding extensions. It is now time to take back a step and see where the future of 3D will go. Super-multiview displays and holographic displays are currently under development. They will provide horizontal as well as vertical parallax. Hence, we need further extensions of current multiview technology, which assumes a linear camera arrangement, in order to accommodate for more general camera arrangements for future displays. For interaction and navigation purposes, modern human computer interfaces need to be developed.
The adhoc group N14163 AHG on FTV (Free-viewpoint Television) will work on this long-term exploration. Initial requirements and use cases are gathered in N14178 Use Cases and Requirements on Free-viewpoint Television (FTV). The group is working on evidence as described in N14179 Description of Exploration Experiments on Free-viewpoint Television (FTV). At the 109th meeting, a seminar is envisioned as outlined inN14284 Preliminary plan of FTV seminar at 109th MPEG meeting.
Full gamut content distribution
Several film studios currently master movies for digital cinema and DVD separately since the colour space of the cinema is much larger than the colour space of a regular TV set. The industry would like to master just one version of the content using the xyz colour space. In order to adapt to the different displays and projectors, transformation hints are desirable which instruct the terminal how to scale the colours of the content to the capabilities of the display. Deploying video in such a way would also allow consumers to actually benefit from a wider colour gamut of a new TV screen.
At this meeting, it was agreed to extend E
HEVC to allow for specification of additional EOTF and xyz colour space information as well as related metadata. No change to the decoding process was proposed.
At some point in the future, evidence on new coding tools for high quality video may be gathered because some B2C applications like DVD or broadcast are rate sensitive. Colour gamut scalability (BT609 to BT2020) might be another area of work. Off-site visits to labs at Dolby and Technicolor demonstrated the benefit of having extend color gamut and HDR display capabilities. The requirements subgroup hopes to come to a decision on whether to move forward at the 108th meeting. At this point, there is no commitment to provide appropriate test material. Furthermore, any evaluation method is completely undefined. Responses to NB on these topics are provided in N14168 Response to NB on color gamut scalability and N14170 Response to NB on XYZ and HDR. Liaison letters N14172, N14279, N14280, N14281, N14307 and N14282 were sent to numerous organizations.
The adhoc group N14162 AHG on Support of HDR XYZ Color Space and HDR will gather test material and evidence on the coding performance of HEVC. It is also charged with further developing N14278 Draft requirements for Higher Dynamic Range (HDR) and Wider Color Gamut (WCG) video coding for Broadcasting, OTT, and Storage Media.