International organisation for standardisation

USAC Verification Test

Roch Lefebvre, VoiceAge, presented

m21171

Activity report from the expert panel for USAC Verification Test item selection

Roch Lefebvre, Max Neuendorf, David Virette, Toru Chinen

The contribution reported on the process used by the expert panel to select the 24 test and 3 training items for the USAC Verification Test. These were to be distributed as 8 items from the three content types speech, music and mixed speech and music. Furthermore, it was agreed that

• 
  Items would not be “pathological” such as pitch pipe.
  
• 
  Items would be critical for both USAC and the two anchor codes, HE-AAC V2 and AMR-WB+.
  

Prior to the actual selection listening task, the candidate items were pre-processed to normalize the level of all items, to shorten items to approximately 8 seconds, to create mono items from stereo candidates.

The actual listening task was hosted by Fraunhofer-IIS at their Erlangen, Germany office. The final selections were reported to the AhG on USAC email reflector on May 10, 2011. The items were further divided into two sub-tests, with 4 items in each content type.

Representatives from the following USAC Verification Test test sites gave a verbal report on their listening test setups:

m21172	Report of VoiceAge participation to the USAC Verification Tests	Roch Lefebvre, Frederick Lavoie, Philippe Gournay
m21204	ETRI Listening test results for USAC Verification Test	Taejin Lee, Seungkwon Beack, Kyeongok Kang
m21221	Report on Panasonic listening test for USAC verification test	Takeshi Norimatsu, Zhao Dan, Tomokazu Ishikawa, Chong Kok Seng
m21230	Sony listening test report on USAC verification test	Toru Chinen, Yuki Yamamoto, Mitsuyuki Hatanaka, Hiroyuki Honma, Masayuki Nishiguchi
m21232	Telcordia and PUT report on participation in the USAC Verification Tests	Tomasz Zernicki, Maciej Bartkowiak, Lukasz Januszkiewicz
m21233	Philips setup USAC verification test	Werner Oomen,Jeroen Koppens
m21235	Huawei report on USAC verificaton test	David Virette, Wei Xiao
m21236	Dolby listening test site report on USAC verification test	Heiko Purnhagen, Kristofer Kjorling
m21237	Yonsei listening test report on USAC verification test	Jeongook Song,Eunwoo Song, Hong-Goo Kang
m21242	Report on USAC Verification test results from Samsung	Miyoung Kim, Eunmi Oh
m21244	USAC Verification Tests - Orange Labs report	Gregory Pallone, Pierrick Philippe
m21245	Report on the USAC Verification Test at NTT DOCOMO	Kei Kikuiri
m21246	Fraunhofer IIS Report on USAC Verification Test	Daniel Fischer, Max Neuendorf
m21270	Qualcomm listening test report on USAC verification test	Jeff Huang

The Audio Chair presented

m21115

USAC Verification Test Scores

S.R. Quackenbush

This contribution contained only an Excel spreadsheet containing all raw scores and pivot tables for each test showing

• 
  Mean score and 95% confidence interval as averaged over all items and all listeners at all test sites.
  
• 
  Mean score for each item as averaged over all listeners at all test sites.