International organisation for standardisation

No.	Title	TBP
Available
	23001-4 Codec Configuration Representation
9771	Disposition of Comments on ISO/IEC CD 23001-4	N	08/05/02
9772	Text of ISO/IEC FCD 23001-4 Codec Configuration Representation	N	08/06/10
	23002-4 Video Tool Library
9773	Disposition of Comments on ISO/IEC CD 23002-4	N	08/05/02
9774	Text of ISO/IEC FCD 23002-4 Video Tool Library	N	08/06/10
9775	WD 1 of ISO/IEC 23002-4/Amd.1 (Conformance and Reference Software)	N	08/06/30
9776	WD 1 of ISO/IEC 23002-4/Amd.2 (Tools for MPEG-4 ASP, AVC HP and SVC)	N	08/06/30
9777	Description of Core Experiments in RVC	N	08/05/02
9778	RVC Work Plan and FU Development Status	N	08/05/02
9779	RVC-SPS v1.0 (Simulation, Profiling and Synthesis Tools)	N	08/05/16
9780	Process for Extending the MPEG RVC Toolbox	N	08/05/02
9781	Description of Exploration Experiments on Toolbox Extension Exercise	N	08/05/02
9782	Status Report on using RVC Framework with non-MPEG Tools and Standards	Y	08/05/02

6Explorations – 3D Video

New test material (a total of 10 sequences using parallel camera arrangements) were provided by various parties (see the expression of thanks in the meeting resolutions). Furthermore, two organizations provided software for depth estimation and view interpolation/generation. First results on interpolation results look promising, but more thorough investigation (in particular also using stereoscopic displays) is necessary. For the subsequent meetings, a work plan has been set up.

The difficulty comes due to the fact that in a 3D video system the different prospective components (encoding of views and depth maps, estimation of depth maps and interpolation) highly rely on each other, and that traditional quality measurements such as PSNR would certainly fail. For a possible approach in evaluating 3DV technology – after a future CfP) proponents would be asked to provide

• 
  Output views (quasi continuous)
  
• 
  Encoded representation of depth + video (a bitstream at specified rates)
  
• 
  Decoder that generates the output views from the bitstream (for proof)
  

Having this available, the output results could be compared against

• 
  Original views (as available from the dense sequence sets), which would establish some kind of upper quality anchor.
  
• 
  As an available 3DV solution, MVC/AVC coding of video plus MVC/AVC coding of depth using available depth estimator, plus available view interpolation. This would certainly produce a number of artifacts at a given bit rate, and should be able to be used as a kind of "lower anchor".
  

To step forward in this direction, a set of exploration experiments was set up, where the available test sequences will be run with the available depth estimator(s) and available view interpolation methods. To find realistic cases of sufficient-quality view interpolation, various cases of sparseness (baseline distances between cameras to be selected from the dense set) will be used for this. Based on expert viewing and using available stereoscopic displays, one or a small number of realistic test cases will be selected. For these, the “lower anchor” encoding and optimization will be performed after the Hannover meeting with the purpose to select appropriate bit rates. The shortest possible time line could then be as follows:

• 
  Until 2008/07: Generate depth maps and interpolated view sequences from the old and new test sets
  
• 
  2008/07: Perform expert viewing with different stereoscopic displays, decide on number of cameras and viewing distances useful for the MVC-plus-depth anchors
  
• 
  2008/07: Draft CfP (internal)
  
• 
  Until 2008/10: Perform experiments to decide about bit rates for the MVC-plus-depth anchors, selection of sequences
  
• 
  2008/10: Expert viewing again, preliminary CfP
  
• 
  Until 2009/01: Refinement of test conditions
  
• 
  2009/01: Final CfP
  
• 
  2009/04: Responses due
  

Documents reviewed

M15281	View rectification for FTV Ref. SW depth estimation improvement	Pablo Carballeira Francisco Morán Julián Cabrera
M15336	3D Video Exploration Experiment on Multi-Baseline Depth Estimation	T.Senoh K.Yamamoto R.Oi T.Mishina M.Okiu
M15338	Depth Map Estimation Software version 2	Olgierd Stankiewicz Krzysztof Wegner
M15364	Comparative study on encoding of depth map with uniform and non-uniform quantization	[e-mail]
M15371	Contribution for 3D Video Test Material of Outdoor Scene	Gi-Mun Um Gun Bang Namho Hur Jinwoong Kim Yo-Sung Ho
M15377	Reference Softwares for Depth Estimation and View Synthesis	Masayuki Tanimoto Toshiaki Fujii Kazuyoshi Suzuki Norishige Fukushima Yuji Mori
M15378	1D Parallel Test Sequences for MPEG-FTV	Masayuki Tanimoto Toshiaki Fujii Norishige Fukushima
M15379	Adjusting method for Multi View Image; Color and Geometry Correction for MPEG-FTV Test Sequences	Masayuki Tanimoto Toshiaki Fujii Norishige Fukushima
M15380	Depth Estimation using Stereo Camera Rectification for Non-parallel Camera Setup	Masayuki Tanimoto Toshiaki Fujii Norishige Fukushima
M15412	Contributions and Comments to Exploration Experiment in 3D Video	Aljoscha Smolic Karsten Mueller Yongzhe Wang
M15413	HHI Test Material for 3D Video	Ingo Feldmann Marcus Mueller Frederik Zilly Ralf Tanger Karsten Mueller Aljoscha Smolic Peter Kauff Thomas Wiegand
M15419	Multiview Video Test Sequence and Camera Parameters	Yo-Sung Ho Eun-Kyung Lee Cheon Lee

Output documents:

No.	Title	TBP	Available
9783	Description of Exploration Experiments in 3D Video Coding	N	08/05/02
9784	Overview of 3D Video Coding	Y	08/05/02