International organisation for standardisation organisation internationale de normalisation

Standards from 3DGC

4	5	2001	Amd.32	RS multi-resolution 3D mesh compression		11/12	13/01	13/04	14/04	3
4	5	2001	Amd.36	RS Pattern based 3D mesh compression		13/11	14/04	2014- 10 or 2015-02		3
4	5	2001	Cor.xx	Corrections for SVA reference software implementation			14/01 (dcor)		14/04	3
4	16	2011	Amd.3	Web3DG coding			14/04	14/07	14/11	3
4	16	2011	Amd.4	Pattern-based 3D Mesh Compression			13/08	2014- 07 or 10		3
4	16	2011	Cor.1	SVA syntax correction			13/08 (dcor)			3
4	27	2009	Amd.5	C for multi-resolution 3D mesh compression			13/01	13/04	14/04	3
4	27	2009	Amd.5	C for Pattern based 3D mesh compression		13/11	14/04	2014- 10 or 2015-02		3
4	27	2009	Cor.1	Corrections for SVA conformance bitstreams			14/01 (dcor)		14/04	3
A	14	201x	1st Ed.	ARRM			12/10		14/04	3
C	5	201x	Amd.1	GTL RS & C		12/02	12/10	13/08	14/04	3
V	1	201x	3^rd Ed.	Architecture			13/11	14/04	14/07	3
V	2	201x	3^rd Ed.	Control information			13/11	14/04	14/07	3
V	3	201x	3^rd Ed.	Sensory information			13/11	14/04	14/07	3
V	4	201x	3^rd Ed.	Virtual world object characteristics			13/11	14/04	14/07	3
V	5	201x	3^rd Ed.	Data formats for interaction devices			13/11	14/04	14/07	3
V	6	201x	3^rd Ed.	Common types and tools			13/11	14/04	14/07	3
V	7	201x	3^rd Ed.	Conformance and reference software		14/04				3

5. Room allocation

3DGC: Monterey

6. Joint meetings

During the week, 3DG had several joint meetings with Requirements, Video, Audio and Systems.

	What	Day	Time1	Time2	Where
3, R	3D Printing	Tue	09:00	09:30	3
3, S, R	Multisensorial AF	Wed	11:30	12:00	3
3, R	3D Printing Requirements	Wed	15:30	16:00	3
3, V	3D video for ARAF	Wed	16:00	17:00	3
3, A	3D audion for ARAF	Wed	17:00	17:30	A
All	Assets	Thu	12:00	13:00	3
3, R	Teleimmersion requirements	Thu	15:30	16:30	3

7. Schedule at a glance

Monday
Session	Agenda/Status/Preparation of the week	14h to 14h30
Session	3DG Plenary, review of contributions	14h30 to 18h
Tuesday (room 15)
Session	MPEG-V	9h to 9:30h
Session	ARAF E2: POI	9:30h to 11:00h
Session	MAR Ref Model	11:00h to 12:00h
Session	MPEG Assets	12:00h to 13:00h
Session	ARAF E2: the 6 use-cases	14h to 15:30h
Session	Tele-immersion Requirements (joint with requirements)	15:30h to 16:30h
Session	MAR Ref Model	16:30h to 18h
Wed
Session	Multisensorial AF	11:30h to 12h
Session	ARAF	14:00h to 15:00h
Session	3D Printing Requirements	15h30 to 16h
Session	3D video for ARAF	16h to 17h
Session	3D audion for ARAF	17h to 17h30
Thu
Session	MPEG-V	9h to 9:30h
Session	ARAF E2: POI	9:30h to 11:00h
Session	MAR Ref Model	11:00h to 12:00h
Session	MPEG Assets	12:00h to 13:00h
Session	ARAF E2: the 6 use-cases	14h to 15:30h
Session	Tele-immersion Requirements (joint with requirements)	15:30h to 16:00h
Session	MAR Ref Model	16:00h to 18h
Friday
Session	Joint meeting with JPEG on Augmented Reality	9h to 10h
Session	3DG Plenary, 3DG Output Documents Review, Liaisons, resolutions	10h to 13h

2. AhG reports

   1. MPEG-V

http://wg11.sc29.org/doc_end_user/documents/107_San%20Jose/ahg_presentations/MPEG-VAhGreport.ppt-1389645803-MPEG-VAhGreport.ppt

2. Augmented Reality

http://wg11.sc29.org/doc_end_user/documents/107_San%20Jose/ahg_presentations/ARAhGreport.ppt-1389645822-ARAhGreport.ppt

3. RGC

http://wg11.sc29.org/doc_end_user/documents/107_San%20Jose/ahg_presentations/AHG_report_presentation_MTL.pptx-1389645855-AHG_report_presentation_MTL.pptx

3. Analysis of contributions

RGC
m32304	MPEG-4 3DG	Updated Collection of Datasets for MTL FU level testing	Christian Tulvan, Marius Preda
m32305	MPEG-4 3DG	Updates on RGC (RVC-CAL) - reference software status All the FUs are implemented in RVC-CAL	Christian Tulvan, Marius Preda
m32372	MPEG-4 3DG	The reference software of SVA for MTL based on ISOIEC 14496-162012 DCOR1 SVA bitstream synthax was modified to take into account a better ordering avoiding therefore feedback loops. This contribution provides the software implementation for encoder and decoder.	Li Cui, Seungwook Lee, Jinsung Choi, Hyungyu Kim, Euee S. Jang
m32374	MPEG-4 3DG	Reference Software implementation of SVA FUs in MTL The FU network for SVA is provided.	Seungwook Lee, Jinsung Choi, Bonki Ku, Li Cui, Jinyeon Choi, Hyungyu Kim, Euee S. Jang
m32375	MPEG-4 3DG	Proposal of the dataset for FU level testing of MTL	Seungwook Lee, Jinsung Choi, Jinyeon Choi, Li Cui, Hyungyu Kim, Euee S. Jang
ARAF
m32335	MPEG-A 3DG	Updates on POI	Traian Lavric, Marius Preda
m32336	MPEG-A 3DG	Updates on m26114 (Initial proto design for server side processing for Augmented Reality)	Traian Lavric, Marius Preda
m32337	MPEG-A 3DG	Updates on AugmentationRegion	Traian Lavric, Marius Preda
m32457	MPEG-A 3DG	Update of MPEG-ARAF reference software Thu: The implementation of AugmentationRegion and OutputActuator is presented, however none of the mis actually using the EXTERNALPROTO but directly the scene. New version is needed.	B.S. Choi, Jeong, Hong
m32458	MPEG-A 3DG	Comments on augmentation region and output actuator The retained solution is to emphasize that the EXTERNPROTO has as normative only the URN and that the name can be changed at the declaration. A example was provided in the specification and a reminder of the EXTERNPROTO mecanism was added.	B.S. Choi, Jeong, Hong
		POI Thu: a similar exercice in specifying the use cases in a complexity increase order was done.
MPEG-V
m32350	MPEG-V 3DG	Proposal of User Preference for 3D Printing	Seungwook Lee, Jinsung Choi, Kyoungro Yoon, Min-Uk Kim, HyoChul Bae
m32396	MPEG-V 3DG	WD 3.0 of MPEG-V Engines API An example of using the Engine API is showed. However, the API is still at a high level, it is not possible yet to go at individual effect level. Thu 9h: an enriched set of APIs is proposed for accessing and sending data. The purpose of step 1 is to design the API of a classical MPEG-V Engine as defined in the Architecture, that is an engine used when consuming the content (and not when authoring it).	Jae-Kwan Yun, Hyun-Woo Oh, Yoonmee Doh, Jae-Doo Huh, Jong-Hyun Jang
m32399	MPEG-V 3DG	Text of automobile sensor use cases for MPEG-V Part 1	Kyoungro Yoon, Min-uk Kim
m32402		Implementation of 4D Media Player Application Format A file format combining mp4 traditional content with multi-sensorial data is proposed. Resolution: Initiate the Multi-sensorial media Application Format. Joint meeting with requirements; Joint meeting with File Format Wed 11:40 change the name of AF into Multi-sensory application format The MPEG-7 BiM should be used to fragment the MPEG-V document and compose it. Check also the timed metadata amendment (an output document of a previous meeting)	Sang-Kyun Kim, Jungyup Oh, Minwoo Kim, Yong Soo Joo
m32485		Update requirements of 3D printing metadata from industrial company A set of user preferences were presented including unfavoured materials, maximal size and hole thickness. It is necessary to also include preferred materials, minimum and optimal size and clarify better the role of thickness parameters. AP: Re-discuss the contribution Tuesday. Joint meeting with requirements. Tue (joint with Requirements): Starfigure – a shop selling printed 3D objects Three types of requirements are introduced: physical size, thickness, description of physical characteristics (elasticity, …) In the metadata related to the object we also need information about the scanning process (resolution, …) Wed: a new version of the requirements is proposed: R1: Object characteristics R2: Material characteristics (mechanical, thermal, electrical, bio characteristics). R3: Fine level description of 3D model MPEG-4 Requirements document MPEG-V Requirements document Thu (14h): The latest version of the MPEG-4 requirements document is v18 (Trondheim 2003). This version is updated The latest version of the MPEG-V requirements is v2.3. This version is now updated.	Seung Wook Lee, Jinsung Choi, Suk-ki Choi
3DG
m32400	MPEG-4 3DG	Exploring Low bit-rate Compression of Live Reconstructed Dynamic Geometry Exploration of a Octree based encoding of point cloud: avantages and limitations of the approach. Prediction between two consecutives point cloud scan be easily done with an XOR at the octree level. Two triangulations techniques were tested. Next steps: include a connectivity coder in the octree approach.	Rufael Mekuria, Pablo Cesar
m32308	MPEG-4 3DG	Results for Open3DGC and OpenCTM benchmarking Description of the experiment	Christian Tulvan, Marius Preda

1. Joint meeting with 3DV

Reference Software for depth estimation (available on the SVN: Exploration/ftv/DERS).

This software is not real-time, OpenCV may also be an option (working real-time on a PC but not on a phone).
3D FTV has a data set with a soccer game containing also the player positions. Some use cases from 3D FTV may be interesting for AR.

2. Joint meeting with 3DA

There is a single band binarilasisation engine able to cover 900 points on a sphere.

MPEG-H Audio has a description of the engine. The reference software uses the engine and can be used as example.

MPEG-H Audio text will be frozen in July, probably the software a bit later.

HRTF can be found on the IRCAM website:

http://recherche.ircam.fr/equipes/salles/listen/

 

Reference software can be found in the contribution RM1-HOA : m32077 (http://phenix.it-sudparis.eu/mpeg/doc_end_user/documents/107_San Jose/wg11/m32077-v2-m32077.zip)

3. Joint meeting with all on MPEG assets

The idea of requesting contributors to provide the reference software under the form of a library is introduced. There were some concerns about how rich the library API should be.

4. Session RMC BoG

• 
  Established the final version of the DataSet files structure
  
• 
  Designed the Generic Stimulus FU
  
• 
  Designed the Generic Validation FU
  
• 
  Decided the set of conformance bitstreams
  
• 
  Partial demo of the SVA implementation (correct network, network with errors, still missing a reconfigured network)
  

5. Session MPEG Assets

The following decisions were taken in the MPEG Assets meeting:

1. 
   The Content repository will have the same structure as the Conformance Assets based on Standard / Part
   
2. 
   The MPEG SVN reflector will be used for communication
   
3. 
   The Content repository will be accessible (read-write) via FTP (the account will be distributed to all Chairs)
   
4. 
   The Content repository will be accessible (read-only) via HTTP using the same interface as the Conformance repository: http://wg11.sc29.org/content
   
5. 
   A CfP will NOT be accepted if the content is not referenced in the MPEG Content repository
   
6. 
   The repository can contain the actual data or the information were the data is available (in this case, it has to be accessible by MPEG members and should include acknowledgments, copyright and terms of use).
   
7. 
   Submitting Content material:
   
   1. 
      An MPEG member can directly submit content to the appropriate location, but in this case, should inform the Content repository administrator about the operation
      
   2. 
      An MPEG member can directly inform the Content repository administrator about the location of the files that should be placed on the Content repository
      

6. Joint Session with JPEG on JPEGAR

Currently there is no interoperability between AR SDKs. An architecture is presented. The work is focused on

• 
  interfaces between entities and the goal of the standard is to specify these interfaces.
  
• 
  metadata
  

The application description may be embedded in the JPEG file format.

Global architecture is common but, different perspectives: JPEGAR has a target image based perspective while ARAF has a scene and user experience based perspective.

Resolution: Decision to work together by holding joint meetings each time WG1 and WG11 have collocated meetings

7. Session 3DG Plenary

Review of the liaison letters, review of all the output documents. The answer to the Liaison letter from WG1 on AR in JPEG was discussed and edited:

Liaison Response to WG1 on JPEG Augmented Reality
WG11 has been made aware of the new WG1 proposed work item on augmented reality and is looking forward to a continuous cooperation during the development process of its Augmented Reality Application Format (ARAF). WG11 recommends holding joint meetings on this topic, whenever WG1 and WG11 have collocated meetings.

4. General issues

   1. General discussion

      1. Reference Software

It is recalled that the source code of both decoder AND encoder should be provided as part of the Reference Software for all technologies to be adopted in MPEG standards. Moreover, not providing the complete software for a published technology shall conduct to the removal of the corresponding technical specification from the standard.

Currently all the AFX tools published in the third edition are supported by both encoder and decoder implementation.

2. Web site

The new web site is available at http://wg11.sc29.org/3dgraphics/. It is a blog-based web site and all members are allowed to post.

5. General 3DG related activities

   1. Promotions

      1. Web Site

         Title	Status of http://wg11.sc29.org/3dgraphics/
         Authors
         Summary	The web site is now empty, contributions are needed.
         Resolution	Action Point: Transfer the old web-site data to the new one.

   2. Press Release:

None

6. Resolutions from 3DG

1. Resolutions related to MPEG-4

   1. General

      1. The Requirements and 3DG subgroups recommends approval of the following documents

         No.	Title	TBP	Available
         	14496 – General
         14194	MPEG-4 Requirements v19	Y	14/01/17

   2. Part 5 – Reference Software

      1. The 3DG subgroup recommends approval of the following documents

         No.	Title	TBP	Available
         	14496-5 – Reference Software
         14289	ISO/IEC 14496-5:2001/AMD27:2011/DCOR1 Correction of SVA Reference Software	N	14/01/17

      2. The 3DG subgroup recommends appointing Seung Wook Lee as editor of ISO/IEC 14496-5:2001/AMD27:2011/DCOR1

   3. Part 16 – Animation Framework eXtension (AFX)

      1. The 3DG subgroup recommends approval of the following documents

         No.	Title	TBP	Available
         	14496-16 – Animation Framework eXtension (AFX)
         14196	Study text on ISO/IEC 14496-16/PDAM4 Pattern based 3D mesh compression	N	14/01/17
         14195	Core Experiments Description for 3DG	N	14/01/17
         14197	Tele-immersion use case and associated draft requirements	N	14/01/17

   4. Part 27 – 3DG Conformance

      1. The Video subgroup recommends approval of the following documents

         No.	Title	TBP	Available
         	14496-27 – 3DG Conformance
         14290	ISO/IEC 14496-27:2009/AMD2:2011/DCOR1 Correction of SVA conformance	N	14/01/17

      2. The 3DG subgroup recommends appointing Seung Wook Lee as editor of ISO/IEC 14496-27:2009/AMD2:2011/COR1

2. Resolutions related to MPEG-A

   1. Part 13 – Augmented Reality Application Format

      1. The 3DG subgroup recommends approval of the following documents

         No.	Title	TBP	Available
         	23000-13 – Augmented Reality Application Format
         14198	WD 4.0 of ARAF 2nd Edition	Y	14/02/07
         14199	Use cases for ARAF 2nd Edition	Y	14/01/17

   2. Part 14 – Mixed and Augmented Reality Reference Model

      1. The 3DG subgroup recommends approval of the following documents

         No.	Title	TBP	Available
         	23000-14 – Mixed and Augmented Reality Reference Model
         14250	Candidate WD 4.0 MAR Reference Model	Y	14/01/17
         14291	Logistic information for the 4th JAhG MAR meeting	Y	14/01/17

      2. The 3DG subgroup would like to request the modification of the title of ISO/IEC 23000-14 from Augmented Reality Reference Model to Mixed and Augmented Reality Reference Model

      3. The 3DG subgroup would like to inform that the 4th JAhG MAR meeting will take place in Seoul, Korea on January 22nd and 23rd, 2014.

3. Resolutions related to MPEG-C

   1. Part 4 – Media Tool Library

      1. The 3DG subgroup recommends approval of the following documents

         No.	Title	TBP	Available
         	23002-4 – Media Tool Library
         14292	Test methodology at FU level for RGC	N	14/01/17

   2. Part 5 – Reconfigurable Media Coding Conformance and Reference Software

      1. The 3DG subgroup recommends approval of the following documents

         No.	Title	TBP	Available
         	23002-5 – Reconfigurable media coding conformance and reference software
         14251	Study Text of ISO/IEC 23002-5/DAM1 GTL reference software and conformance	N	14/01/17

4. Resolutions related to MPEG-V

   1. General

      1. The Requirements and 3DG subgroups recommends approval of the following documents

         No.	Title	TBP	Available
         	23005 – General
         14252	MPEG-V requirements	Y	14/01/17

5. Resolutions related to MPEG-M

   1. Part 2 – MPEG Extensible Middleware (MXM) API

      1. The 3DG subgroup recommends approval of the following documents

         No.	Title	TBP	Available
         	23006-2 – Application Programming Interface
         14253	WD 3.0 of MPEG-V Engines API	N	14/01/27

6. Resolutions related to Explorations

   1. Multisensory Effects Application Format

      1. The Requirements subgroup recommends approval of the following documents:

         No.	Title	TBP	Available
         	Exploration – Multisensory Effects Application Format
         14254	WD 1.0 of Multisensory Effects Application Format	Y	14/01/31

7. Management

   1. Liaisons

      1. The 3DG subgroup recommends approval of the following liaison statements

         No.	Title	TBP	Available
         	Liaison Statements
         14298	Liaison Response to WG1 on JPEG Augmented Reality	Y	14/01/17

   2. Asset management

      1. WG11 recommends approval of the following document

         No.	Title	TBP	Available
         	Assets
         14255	Policy document about MPEG Assets		14/01/17

      2. The WG11 recommends to follow a modular approach, including the documentation of APIs, in the development of the reference software in order to facilitate the maintenance and avoid ambiguity. The WG11 recommends to condition the publication of the CfP by the availability of the content in the MPEG content repository.

1. Establishment of 3DG Ad-Hoc Groups

N14293	AHG on AR
Mandates	Edit the ARAF and MAR RM documents Identify additional needs for ARAF Identify the MPEG technologies that shall be part of ARAF Continue actions to implement the collaborative work-plan for MAR RM with SC24 Investigate the usage of 3DV, 3DA, CDVS and UD in Augmented Reality
Chairmen	Marius Preda (Institut Mines Telecom), Traian Lavric (Institut Mines Telecom), B.S. Choi (ETRI)
Duration	Until 108^th MPEG Meeting
Reflector	mpeg-3dgc AT gti. ssr. upm. es
Subscribe	To subscribe, send email to https://mx.gti.ssr.upm.es/mailman/listinfo/mpeg-3dgc
Meeting	During weekend prior to MPEG	Room size 30	Date March 30, 09h00-13h00
	Before weekend prior to MPEG	Place /Date/Logistics

N14294	AHG on MPEG-V
Mandates	Edit the MPEG-V documents To further develop tools for MPEG-V and discuss related contributions. Improve the requirements for 3D graphics metadata for 3D printing
Chairmen	Kyoungro Yoon (Konkuk University), Marius Preda (Institut Mines Telecom),
Duration	Until 108^th MPEG Meeting
Reflector	[e-mail]
Subscribe	http://lists.uni-klu.ac.at/mailman/listinfo/metaverse
Meeting	During weekend prior to MPEG	Room size 30	Date March 30, 14h00-16h00
	Before weekend prior to MPEG	Place /Date/Logistics

N14295	AHG on Graphics compression
Mandates	To refine requirements of 3D tele-immersive coding To progress the specification and continue implementation of Web3D coding To disseminate benchmark results of MPEG tools
Chairmen	Lazar Bivolarski (LZ), Rufael Mekuria (CWI), Christian Tulvan (Institut Mines Telecom),
Duration	Until 108^th MPEG Meeting
Reflector	mpeg-3dgc AT gti. ssr. upm. es
Subscribe	To subscribe, send email to https://mx.gti.ssr.upm.es/mailman/listinfo/mpeg-3dgc
Meeting	During weekend prior to MPEG	Room size 30	Date March 30, 16h00-17h00
	Before weekend prior to MPEG	Place /Date/Logistics

N14296	AHG on Reconfigurable Media Coding
Mandates	To finalize testing of the reference implementation of GTL FUs To finalize the normative and non-normative parts of RMC software, and the conformance. To discuss and study the developments necessary for ongoing and future amendments of 23001-4, 23002-4 and 23002-5. To further develop tools for SVC and HEVC and discuss related contributions.
Chairmen	Christian Tulvan (Institut Mines Telecom), Mickael Raulet (IRISA)
Duration	Until 108^th MPEG Meeting
Reflector	[e-mail]; mpeg-3dgc AT gti. ssr. upm. es
Subscribe	To subscribe, send email to [e-mail] and https://mx.gti.ssr.upm.es/mailman/listinfo/mpeg-3dgc
Meeting	During weekend prior to MPEG	Room size 30	Date March 30, 17h00-18h00
	Before weekend prior to MPEG	Place /Date/Logistics

N14297	AHG on MPEG Assets
Mandates	Collect all the information about the current place of MPEG conformance and MPEG content Populate the conformance repository on wg11.sc29.org Create the content repository and populate it.
Chairmen	Christian Tulvan (Institut Mines Telecom), Marius Preda (Institut Mines Telecom)
Duration	Until 108^th MPEG Meeting
Reflector	mpeg-3dgc AT gti. ssr. upm. es
Subscribe	To subscribe, send email to https://mx.gti.ssr.upm.es/mailman/listinfo/mpeg-3dgc
Meeting	During weekend prior to MPEG	Room size 30
	Before weekend prior to MPEG	Place /Date/Logistics

8. Closing of the Meeting

See you in Valencia.

1 VBAP: Vector Bases Amplitude Panning, the algorithm is specified in W13412.