SHREC 2010 - Shape Retrieval Contest based on Generic 3D Warehouse

Call For Participation:
SHREC 2010 - Shape Retrieval Contest based on Generic 3D Warehouse

Objective

The objective of this track is to evaluate the performance of 3D shape retrieval approaches on a Generic 3D shape benchmark based on the Google 3D Warehouse.

Introduction


With the increasing number of 3D models are created everyday and stored in databases. Effectively searching a 3D repository for 3D shapes which are similar to a given 3D query model has become an important area of research. Benchmarking allows researchers to evaluate the quality of results of different 3D shape retrieval approaches. Here, we propose a new publicly available 3D shape benchmark based on the Google 3D Warehouse to advance the state of art in 3D shape retrieval
Task description
The task is to evaluate the dissimilarity between every two objects in the database mentioned above and then output the dissimilarity matrix.

Data set
All the 3D models in the generic shape benchmark were acquired by a web crawler from the Google 3D Warehouse. To classify the 3D shape models into a ground truth database, one person based on the Google tags has classified objects into ground truth categories based mainly on visual similarity. In this benchmark, there will be over three thousand 3D models. The file format used to represent the 3D models will be the ASCII Object File Format (*.off).

Evaluation Methodology
We will employ the following evaluation measures: Precision-Recall curve; Average Precision (AP) and Mean Average Precision (MAP); E-Measure; Discounted Cumulative Gain; Nearest Neighbor, First-Tier (Tier1) and Second-Tier (Tier2).

Procedure
The following list is a step-by-step description of the activities:

Schedule
January 26 - Call for participation.
January 29 - few sample models of the test database will be available on line .
February 3 - Please register before this date.
February 3 - Distribution of the whole database. Participants can start the retrieval. .
February 13 - Submission of results (dissimilarity matrix) and a one page description of their method(s)).
February 17 - Distribution of relevance judgments and evaluation scores.
February 20 - Submission of final descriptions (two page) for the contest proceedings.
February 24 - Track is finished, and results are ready for inclusion in a track report
March 7 - Camera ready track papers submitted for printing
May 2 - EUROGRAPHICS Workshop on 3D Object Retrieval including SHREC'2010

Data Set
Test data set , Thumbnails, Classification file

Please Cite the paper :
SHREC'10 Track: Generic 3D Warehouse., T.P. Vanamali, A. Godil, H. Dutagaci,T. Furuya, Z. Lian, R. Ohbuchi, In: M. Daoudi, T. Schreck, M. Spagnuolo, I. Pratikakis, R. Veltkamp (eds.), Proceedings of the Eurographics/ACM SIGGRAPH Symposium on 3D Object Retrieval, 2010.
pdf paper