International organisation for standardisation

Task Groups

1. 
   MPEG-2 and MPEG-4 Audio, MPEG Audio Conformance, MPEG reference software, MPEG Surround, SAOC
   
2. 
   MPEG-D Unified Speech and Audio Coding
   
3. 
   Audio Exploration: 3D Audio
   

3. Output Documents

No.	Title		TBP	Available
	14496-3 – Audio
12215	ISO/IEC 14496-3:2009/Cor 2, Floating point data corrections		No	11/07/22
12216	DoC on ISO/IEC 14496-3:2009/PDAM 3 Transport of Unified Speech and Audio Coding		No	11/07/22
12217	ISO/IEC 14496-3:2009/DAM 3 Transport of Unified Speech and Audio Coding		No	11/07/22
12218	Low Delay AAC V2 Profile		No	11/07/22
12219	Workplan on Low Delay AAC V2 Additional Information		No	11/07/22
	14496-5 – Reference Software
12220	ISO/IEC 14496-5:2001/AMD 10:2007/Cor 5 ALS Floating point data corrections		No	11/07/22
	14496-24 – Audio and Systems Interaction
12221	WD on ISO/IEC 14496-24:2007/AMD 1 - Audio Systems Interaction		No	11/07/22
	14496-26 – Audio Conformance
12222	ISO/IEC 14496-26:2010/Cor 4, ALS Floating point data corrections		No	11/07/22
	23003-1 – MPEG Surround
12223	Defect Report on ISO/IEC 23003-1:2007, MPEG Surround		No	11/07/22
12224	ISO/IEC 23003-1:2007/AMD 1:2008/DCOR 2 MPEG Surround Conformance		No	11/09/16
	23003-2 – SAOC
12225	Defect Report on ISO/IEC 23003-2:2010, SAOC		No	11/07/22
12226	DoC on ISO/IEC 23003-2:2010/PDAM 1, SAOC Conformance		No	11/07/22
12227	ISO/IEC 23003-2:2010/DAM 1, SAOC Conformance		No	11/07/22
12228	Doc on ISO/IEC 23003-2:2010/PDAM 2, SAOC Reference Software		No	11/07/22
12229	ISO/IEC 23003-2:2010/DAM 2, SAOC Reference Software		No	11/07/22
		23003-3 – Unified Speech and Audio Coding
12230		DoC on ISO/IEC 23003-3/DIS, Unified Speech and Audio Coding	No	11/07/22
12231		ISO/IEC 23003-3/FDIS, Unified Speech and Audio Coding	No	11/09/16
12232		Unified Speech and Audio Coding Verification Test Report	YES	11/09/16
		Exploration – 3D Audio
12233		Thoughts on 3D Audio	No	11/07/22
	Liaison Statements
12085	Response to ITU-R SG 6 on Recommendation ITU-R BS.647-3		No	11/07/22
12086	Response to ITU-R SG 6/WP 6B on USAC		No	11/07/22
12087	Response to IEC TC100 on IEC CDV 62731		No	11/07/22
	NB Responsess
12234	Response to FRNB on MPEG Profiles		No	11/07/22
		Promotion
12235		Unified Speech and Audio Coding	YES	11/07/22

4. Agenda for the 98^th MPEG Audio Meeting

Agenda Item

1. 
   Opening of the meeting
   
2. 
   Administrative matters
   
   1. 
      Communications from the Chair
      
   2. 
      Approval of agenda and allocation of contributions
      
   3. 
      Review of task groups and mandates
      
   4. 
      Approval of previous meeting report
      
   5. 
      Review of AhG reports
      
   6. 
      Joint meetings
      
   7. 
      Received national body comments and liaison matters
      
3. 
   Plenary issues
   
4. 
   Task group activities
   
   1. 
      MPEG-1, MPEG-2, MPEG-4, and MPEG Surround, SAOC
      
   2. 
      Unified Speech and Audio Coding
      
   3. 
      Exploration: 3D Audio
      
5. 
   Discussion of unallocated contributions
   
6. 
   Meeting deliverables
   
   1. 
      Responses to Liaison and NB comments
      
   2. 
      Recommendations for final plenary
      
   3. 
      Establishment of new Ad-hoc groups
      
   4. 
      Approval of output documents
      
   5. 
      Press statement
      
7. 
   Future activities
   
8. 
   Agenda for next meeting
   
9. 
   A.O.B
   
10. 
    Closing of the meeting
    

10. 
    – 3DG report
    

Source: Marius Preda, Chair

6Opening of the meeting

6.1Approval of the agenda

The agenda is approved.

6.2Goals for the week

The goals of this week are:

Review contributions related to 3D graphics aspects of MPEG-V

Review contributions related to Representation of meshes with multiple attributes

Status of refsoft and conformance for Part 16 Amd 1 (multiple attributes)

Review contributions related to Multi-resolution 3D mesh coding

Review RGC (reconfigurable graphics codec) contributions

Investigate future developments of MPEG 3D Graphics Compression

Check the status of AFX 4^th Edition

Review Liaisons

Review the votes

Web-site

6.3Standards from 3DGC

Std	Pt	Edit.	Project	Description	CfP	WD	CD PDAM	FCD FPDAM DAM?!	FDIS FDAM	Gr.
4	5	2001	Amd.31	RS for Efficient representation of 3D meshes with multiple attributes		11/01	11/03	11/07 DAM	12/02	3
4	16	201x	Amd.1	Efficient representation of 3D meshes with multiple attributes		09/10	10/07	11/01	11/07	3
4	16	201x	Amd.2	Multiresolution mesh coding		11/01	11/07	11/12	12/07	3
4	27	2009	Amd.4	C for Efficient representation of 3D meshes with multiple attributes		11/01	11/03	11/07 DAM	12/02	3
C	4	2010	Amd.3	GTL for RMC framework		11/12	12/05	12/10	13/01	V

6.4Room allocation

3DGC: 6I

6.5Joint meetings

During the week, 3DG had several joint meetings with Requirements, Video and Systems. They are indicated in pink in the agenda

6.6Allocation of contributions

6.6.13DG Session 1

Summary

Technicolor: A3DMC is based on repetitive patterns detection and symmetries detection. Compared with SC3DMC the gain is about 60%. A set of examples of models with repetitive patters is presented. A local transformation for each pattern is encoded in the bitstream (position, orientation and scaling). Two compression modes for the transformations: the elementary transformations one after the other or grouped by type (T, R, S, T, R, S or T, T, R, R, S, S …). The algorithm is first identifying the pattern.

For the moment there is only geometry that can be encoded/decoded.
Actions:

1. It is necessary to consider the encoding of other attributes (texCoord, colors, …).

2. Investigation on encoding residual errors between the transformed pattern and the original object.

6.6.23DG Session 2

Summary:

UPM: A set of parameters tested on how to encode the multiresolution texture: scale, compression ratio and child.

Actions

1. Call for textured models. Investigate how this will be combined with MRZ mesh compression.

6.6.33DG Session 3

Summary:

Cascaded Quantization: the cascaded quantization is now implemented and available on SVN. This is similar with the one proposed in AVC.

Actions:

Accepted

6.6.4RGC/RVC session 1

Summary:

Discussions around the decision on using parametrisable FU (the dimension of the vector coming from a token is depending on a parameter that is internal to the FU and comes in the configuration network) or one-dimensional FUs.

Actions/Resolutions:

- do the design for both one-dimensional and n-dimensional FUs for each functionality that needs it (inverse quantization, inverse prediction) and conduct an experiment to clarify what is the appropriate solution for each situation.

6.6.5RGC/RVC session 2

Summary:

Test at the FU level. A set of tokens for input and output was defined. This may be done for some FUs but not for all of them. It is not proposed as a FU level conformance testing but more as a tool during the development of the standard. If successful it may be proposed later as a way to deal with conformance.

Test FUs: 2 solutions: (1) make one testing FU for each operational FU. The testing FU will save at the external resource the output of the operational one and optionally compare with a golden set. (2) make one testing FU for each data type.

Since the data type is not known for the FUs, it is not possible to specify a testing FU for each data type. The solution is to have a single testing FU (with one single input token) and leave the implementer of the network the task to specify the size of each token.

6.6.6RGC/RVC session 3

Summary:

Inverse Quantization

Use words, Finite State Machine, no details are needed with what is inside the diagram.

6.6.7Joint sessions with Systems on MPEG-V (1)

Haptic properties.

Range: Use the min and max values as elements when dealing with the one dimensional data. Use the RangeType (defined in Part 6) for three dimensional kinds of data. The mapping of the haptic texture into the object is not yet provided. Since it is local information, we need access to the vertices. An extension of IFS is therefore needed: HapticIndexedFaceSet.

Tactile Pattern: a combination of baseWaveForms. Amplitude if the signal is also a temporal data. It can only be modified uniformly in time. Phase is not needed. baseWaveForm should be represented by using CS. Change "cycle" in "NoOfCycles". Change "risingTime" in "risingNoOfCycles". Same for "fallingNoOfCycles". No need for "frequency". Same for amplitude. Check the meaning of "trig".

Investigate about the possibility to have the tactilePattern in Part 5 and provide the corresponding information in Part 3 (zoom-in, zoom-out, …).

6.6.8Joint sessions with Systems on MPEG-V (2)

Facial Expression Sensor

The two APs mentioned in the AhG report were implemented. Change the name of the attributes to start with minuscule.

6.6.9Joint sessions with Systems on MPEG-U

Delete Annex B and C and keep them for Study Text.

6.6.10Joint sessions with Systems on MPEG-V (3)

Binarisation Review.

7General issues

7.1General discussion

7.1.1Reference Software

It is recalled that the source code of both decoder AND encoder should be provided as part of the Reference Software for all technologies to be adopted in MPEG standards. Moreover, not providing the complete software for a published technology shall conduct to the removal of the corresponding technical specification from the standard.

Currently all the AFX tools published in the third edition are supported by both encoder and decoder implementation.

7.1.2Web site

The new web site is available at http://wg11.sc29.org/3dgraphics/. It is a blog-based web site and all members are allowed to post.

8Current Voting

Document title	DoC	Editor of DoC
none

9General 3DG related activities

9.1AhG on 3DG activities

Title	Report of AHG on 3DGC documents, experiments and software maintenance
Authors	Francisco Moran
Resolution	accepted

Title	Ad Hoc Group on Multi-Resolution 3D mesh Coding
Authors	Khaled Mamou, Minsu Ahn, Xiangyang Ji
Resolution	accepted

9.2Promotions

9.2.1Web Site

Title	Status of http://wg11.sc29.org/3dgraphics/
Authors
Summary	The web site is now empty, contributions are needed.
Resolution	Action Point: Transfer the old web-site data to the new one.

9.3Joint activities

9.3.1MPEG-V - Information Exchange with Virtual Worlds (formally Metaverse)

MPEG number	Title	Source	Summary, Action Points and Resolutions
m20534	Extension of the ScentCS in ISO/IEC 23005 - Part 6	Markus Waltl, Benjamin Rainer, Christian Timmerer	Not discussed
m21051	Representation of non-uniform haptic property for Virtual world object characteristics	Jaeha Kim, Seongsim Cheon, Jeha Ryu	The need for non-uniform haptic property for example for sub-parts of objects. Proposal for multilayered image-based haptic modeling. It has the advantage of fast computing and memory saving. Each property is represented as an image. The representation is using a mapping on a cube of an object and association for each face with a haptic multi-layered image. There is an issue on the mapping into a cube. This may work well for some objects but is not a generic tool. It will be better to use a generic mapping as in texture mapping. The layers are referring to images. Some of them are gray-scale images; others are color images (they need 3 components as X, Y, Z). Since in the image it is only possible to code values between 0 and 255, it is needed to include the range (or the mapping function).
m21052	A suggestion of advanced Tactile Type for supporting devices having diverse vibration patterns	Jaeha Kim, Seongsim Cheon, Jeha Ryu	There are already devices in the market that allows advanced tactile and vibrations. MPEG-V looks inefficient to code more complex patterns. The contribution proposes a set of wave forms (sinusoidal, square, triangle, saw tooth, Gaussian). The set of parameters for any of them is proposed. In ISO/IEC 25005-3 there is a type called TactileResourcesType that can refer to an external resource containing the image or the waveform. The resolution is to extend this type and allows the representation of the 5 proposed patterns. Action: to check how Fade-in, Fadeout is used for colors and check if it possible to apply the same for the patterns parameters.
m21180	Reference software framework for binary representation of 23005-5/6 AMD1	Jae-Joon Han, Seungju Han, James D.K. Kim, Sang-Kyun Kim, Yong Soo Joo	In the current reference software it is possible to parse MPEG-V XML and obtain an MXM object. The contribution adds the possibility to output binary representation of the XML data. The binary data is obtained from the MXM object tree. Read/Write API is implemented for Part 5 (almost complete). A guide on how extending and using the software is also included. Action: Make the plan for who will implement the rest of the types (from all the parts).
m21181	Study of 23005-5 AMD1 WD	Jae-Joon Han, Seungju Han, James D.K. Kim, Sang-Kyun Kim, Yong Soo Joo	The contribution refers to some errors related to names, namespaces. Recommendation: Accept the study. A discussion on the need of update mode for some sensors was also triggered. Not all the sensors need this mode but the high frequency ones yes (orientation, position, ..). AP: add a table with a list of sensors that need an update mode.
m21336	Additional sensed information of intelligent camera	Seungju Han, Jae-Joon Han, James D.K. Kim, Youngkyoo Hwang, Jungbae Kim, Wonchul Bang, Changkyoo Choi	The contribution proposes to extend the Intelligent camera by adding facial expression basis ID & displacement. The purpose is to allow motion retargeting. Therefore an initialization data is needed for face morphology and expressions ranges (e.g. how much the eyes can be open). First scenario: camera is measuring the user profile (face measures and min/max expressions). This user profile can be stored to be used later with less intelligent camera. Second scenario: a camera download the user profile and computes relative features directly. Proposal for InitialFacialExpressionBasisType: face morphology and expression capabilities. A classification scheme for all the expression capabilities is proposed. It contains 66 parameters (same as for MPEG-4 Face Animation). AP: separate the schema in two components: morphology and expression capabilities. AP: Change the name into FacialExpressionSensor.
m21338	Editorial report on correct text of ISO/IEC23005:4	Jae Joon Han, Marius Preda Bottom of Form	Change the VWObaseType into abstract type and add a restriction base as "anyType". The schema was changed. This allows extensibility of the avatar and virtual object base types.

9.3.2Reconfigurable Graphics Coding

Several joint meetings with Video RVC group took place to review the related contributions. The resolutions are reported in the table above.

9.4Explorations

3DG group participates to the document w11832 Augmented Reality Applications, Functionnalities and Standardisation areas.

10Liaison

Answer to WG1 liaison letter on Augmented Reality

11Resolutions related to MPEG-4

11.1Part 5 Reference Software

11.1.1The 3DG subgroup recommends approval of the following documents

No.	Title	TBP	Available
	14496-5 – Reference Software
12088	DoCR on ISO/IEC 14496-5:2001/PDAM31	No	11/07/22
12089	DAM of ISO/IEC 14496-5:2001/Amd. 31	No	11/07/22

11.1.23DG subgroup thanks UKNB for the comments related to ISO/IEC 14496-5:2001/PDAM 31.

11.2Part 16 Animation Framework eXtension (AFX)

11.2.1The 3DG subgroup recommends approval of the following documents

No.	Title	TBP	Available
	14496-16 – Animation Framework eXtension (AFX)
12090	FDAM of ISO/IEC 14496-16:2011/Amd. 1	No	11/07/22
12091	Request for Amendment of ISO/IEC 14496-16	No	11/07/22
12092	PDAM of ISO/IEC 14496-16:2011/Amd. 2 Multi-resolution 3D mesh coding	No	11/08/22
12093	Core Experiments Description of AFX	No	11/07/22

11.2.23DG subgroup recommends appointing Minsu Ahn, Khaled Mammou and Xiangyang Ji as editors of ISO/IEC 14496-16:2011/Amd 2 Multi-resolution 3D mesh coding.

11.3Part 27 3DG Conformance

11.3.1The 3DG subgroup recommends approval of the following documents

No.	Title	TBP	Available
	14496-27 – 3DG Conformance
12094	DAM of ISO/IEC 14496-27:2009/Amd. 4		11/07/22

12Resolutions related to MPEG-C

12.1Part 4 Media Tool Library

12.1.1The 3DG subgroup recommends approval of the following documents

No.	Title	TBP	Available
	23002-4 – Media Tool Library
12095	WD of ISO/IEC 23002-4 Amd. 3 Graphics Tool Library for Reconfigurable Multimedia Coding Framework		11/07/22

12.1.23DG subgroup recommends replacing Matthieu Wipliez by Mickaël Raulet as co-editor of ISO/IEC 23002-4:2011/AMD 3 Graphics Tool Library for Reconfigurable Multimedia Coding Framework.

13Resolutions related to Explorations

13.1Augmented Reality

13.1.1The 3DG subgroup recommends approval of the following documents

No.	Title	TBP	Available
	Exploration – Augmented Reality
12096	MPEG Vision, Position and Technologies for Augmented Reality		11/07/22

14Management

14.1Liaisons

14.1.1The 3DG subgroup recommends approval of the following documents

No.	Title	TBP	Available
	Liaison Statements
12097	Liaison to WG1 on Augmented Reality	Y	11/07/22

15Establishment of 3DG Ad-Hoc Groups

N12098	AHG on 3DG documents, software maintenance and core experiments
Mandate:	Maintain and edit 3DG documents Coordinate 3DG related conformance and reference software Coordinate editing of the www.mpeg-3dgc.com web site
Chairmen:	Francisco Morán Burgos, Seung Wook Lee
Duration:	Until 98^th meeting
Meetings:	Sunday before 98^th meeting
Reflector:	mpeg-3dgc AT gti. ssr. upm. es
Subscribe:	https://mx.gti.ssr.upm.es/mailman/listinfo/mpeg-3dgc

N12099	AHG on Multi-Resolution 3D mesh Coding
Mandate:	Design the encoding of additional attributes per vertex Update the verification model software with support for encoding additional attributes per vertex Continue the evaluation experiments Update the testing platform (MMW.com)
Chairmen:	Khaled Mamou, Minsu Ahn, Xiangyang Ji
Duration:	Until 98^th meeting
Meetings:	Sunday before 98^th meeting
Reflector:	mpeg-3dgc AT gti. ssr. upm. es
Subscribe:	https://mx.gti.ssr.upm.es/mailman/listinfo/mpeg-3dgc

N12140	AHG on Graphics Tool Library
Mandate:	Design the GTL FUs (textual description and the block diagram specifying the input/output interfaces and behaviour) Implement and test GTL FUs
Chairmen:	Christian Tulvan, Seung Wook Lee
Duration:	Until 98^th meeting
Meetings:	Sunday before 98^th meeting
Reflector:	mpeg-3dgc AT gti. ssr. upm. es
Subscribe:	https://mx.gti.ssr.upm.es/mailman/listinfo/mpeg-3dgc

16Closing of the Meeting

See you in Geneva.

Systems Report