2007 Language Recognition Evaluation
The 2007 NIST Language Recognition evaluation (LRE-07) is part of an ongoing series of evaluations of language recognition technology. LRE-07 will be held in the second half of calendar year 2007. It is planned for October of 2007, with the evaluation workshop to be held in December in Orlando, Florida. The evaluation will be similar to previous NIST language evaluations held in 1996, 2003, and 2005. A detailed evaluation plan describing the evaluation task and the evaluation protocols is now available (LRE07EvalPlan-v8b.pdf, updated July 20, 2007).
There will be two data sets and a supplement data set available for training and development:
Sites planning to participate in the evaluation (including sites that are LDC members) must complete and sign the LDC license agreement and an addendum to the license and fax them to the LDC. Upon receiving the signed licenses, the LDC will send the sites the requested training data sets.
To register for the evaluation, fill out the registration form and fax it to NIST. Last day to register is September 1, 2007.
A beta version of the scoring software implementing the performance measurement as described in the LRE07 evaluation plan is now available (score_lre07.v01d.tgz, updated November 26, 2007).
The latest version of the evaluation data key is now available (lid07key_v5.txt), last updated 10/31/07.
The schedule for the evaluation is given below:
Mar 1, 2007 - Additional training data available
[ LRE Home ]
Page Created: July 31, 2007
Multimodal Information Group
is part of
NIST is an agency of the U.S. Department of Commerce
Accessibility Statement | Disclaimer | FOIA