Organisation internationale de normalisation

2MPEG-7 Visual and Photo Player MAF

2.1MPEG-7 Visual related work in Archamps

The MPEG-7 breakout group was active during the whole week. Input documents related to the Visual part in 15938-3 are listed in the table below.

m15605	List of Adjacent Clip Pairs in the VCE-7 Dataset	Kota Iwamoto Ryoma Oami
m15606	Removal of Partially Identical Clips from the VCE-7 Dataset	Kota Iwamoto Ryoma Oami
m15607	Camera Capturing of Video Clips for VCE-7 Robustness Test	Kota Iwamoto Ryoma Oami
m15616	A Proposal on Conformance Testing for Photo Player Application Format	Ryoma Oami
m15623	Proposal on implementation Capturing on camera and Interlaced/Progressive conversion for VCE-7 modification	Weon-Geun Oh Ju-Kyong Jin Jun-Woo Lee Dong-Seok Jeong
m15627	Cross verification results of Image Signature	Karol Wnukowicz
m15646	Improved Matching for Global Image Signature Factor 7 speedup by using simplified Hamming-distance matching (0.3% loss in precision), no change to descriptor and extraction process	Paul Brasnett Miroslaw Bober
m15647	Proposed Improvements for Local Image Signature Based on speeded-up matching as described for the global descriptor in 15646, it is possible to achieve more precision in a 4-stage hierarchical matching process, up to 80 localized features. Now, average precision including medium and heavy conditions is approx. 98%. Still most problems in case of heavy cropping. Decision to adopt the localized descriptor for Study of FPDAM (text to be provided by end of week). Further discussion whether more than 80 local features should be used, e.g. to allow even more heavy cropping in cases of high-resolution images.	Paul Brasnett Miroslaw Bober
m15658	Image Signature for Complex Conditions	Weon-Geun Oh Ayoung Cho Won-Keun Yang Jun-Woo Lee Dong-Seok Jeong
m15666	Validation Report for VCE-5 VCE-5 did not exist. Therefore, this document which obviously contains outdated content was not considered.	Sangki Kim Hyobin Lee Sangyoun Lee
m15670	Video content contribution for VCE-7 from KBS	Geun-Soo Park Ju-Kyong Jin Weon-Geun Oh Dong-Seok Jeong
m15671	Video content contribution for VCE-7 from Inha University	Ju-Kyong Jin Weon-Geun Oh Dong-Seok Jeong
m15673	Comments on the preliminary call for proposal for video signature	Weon-Genu Oh Daeil Yoon Hae-Kwang Kim
m15701	Image Signature for all modifications 3D histogram signature (MGST feature, AP feature, Hue feature). In Addition, 2 versions of concentric circle image signature. Those are operated in 3-stage matching. Matching precision 96.4 % under all modifications.	Weon-Geun Oh Ayoung Cho Won-Keun Yang Jun-Woo Lee Dong-Seok Jeong
m15702	Cross verification result for ETRI VCE-6 proposal	Min-Jeong Lee Heung-Kyu Lee

A Study Text of ISO/IEC 15938-3:2001/FPDAM 3 Image Signature Tools (N9979) was issued. This contains the additional possibility to extract signatures from local image features, where up to 80 local Trace Transform features can be defined for prominent feature points as detected by scale-adaptive Harris corner and Laplacian edge detectors (see M15647). Fast matching is implemented as a hierarchical 4-stage process, using simplified Hamming distance. The performance (with same false alarm rate) was reported to be approx. 98% precision (average) including "medium" and "heavy" conditions.

For the previous global signature descriptor, another speedup of the (non-normative) matching was achieved as well, which now enables to search 70 million images per second with only marginal loss in detection rate (under "light" conditions which are suitable for the global signature type, 99.3% precision are still achieved under the same negligible false alarm rate as before). The MPEG-7 Visual XM Document version 34.0 (N9982) contains these new non-normative fast matching procedures.

A document “Use Cases of Visual Signature Tools” (N9980) was issued, listing various scenarios such as

• 
  Metadata association (services annotating unknown content)
  
• 
  Signature-based search for duplicate content
  
• 
  Identification of lost or stolen content, e.g. museum catalogues
  
• 
  Sharing content in multi-user environment
  
• 
  Unknown object identification, e.g. buildings, animals, …
  

With regard to the subsequent Amd.4 of MPEG-7 Visual, the Call for Proposals on Video Signature Tools (N9981) was issued. Currently, over 100 hours of content are available from donations and download of freely available materials. The National Film and Television School (UK) has offered up to 200 hours of additional content (selection of shots that are usable for the given purpose is still pending / to be done). Therefore, it appears sure that sufficient amount of content (200 hours in total required) is now available or should be available in near future. The timeline is as follows:

• 
  Pre-registration open since end of Hannover meeting, distribution of (currently< available) datasets starts immediately from different sites in Europe, Asia, US
  
• 
  Update of CfP and final definition of dataset 08/10
  
• 
  Responses due 09/02, possibly WD
  
• 
  PDAM 09/04
  
• 
  FPDAM 09/10
  
• 
  FDAM 10/04
  

ISO/IEC 23000-3 / FPDAM 1 Photo Player MAF Reference Software (N9222 of July 2007 meeting) is now delivered and under ballot. The Working Draft of ISO/IEC 23000-3/Amd.2 Conformance Testing for Photo Player MAF (N9983) was started with following timeline:

• 
  PDAM 08/10
  
• 
  FPDAM 09/02
  
• 
  FDAM 09/07