Organisation internationale de normalisation

Process for conducting CEs

The CE process of Proposal, Cross-check and Integration are followed.

The following picture illustrates the listening test results required for a successful Core Experiment. Note that the Alternate Encoder (AE) could be the MPEG Reference Encoder.
The process is summarized as follows:
Proposal and Cross-Check

The CE proponent shows the merit of the tool (i.e. listening test results) in which

• 
  AE+CE shown an improvement over AE at the 95% level of significance
  
• 
  AE is not different from RQx at the 95% level of significance
  

Or

• 
  AE+CE shown an improvement over AE at the 95% level of significance
  
• 
  AE+CE shown an improvement over RQx at the 95% level of significance
  

The company doing the cross-check shows the merit of the tool (i.e. listening test results) in which

• 
  AE+CE shown an improvement over AE at the 95% level of significance
  
• 
  AE is not different from RQx at the 95% level of significance
  

Or

• 
  AE+CE shown an improvement over AE at the 95% level of significance
  
• 
  AE+CE shown an improvement over RQx at the 95% level of significance
  

This listening test evidence is necessary for the CE to be successful. All evidence is considered when judging the overall outcome of a CE. The first alternative for evidence is illustrated in the following diagram.

Integration

If the CE shows merit and is therefore to be accepted, the proponent is obligated to integrate, prior to the next MPEG meeting, informative but perhaps sub-optimal code into the MPEG Reference Encoder. The addition of this code must result in an improvement in the performance of the MPEG Reference Encoder.