<%@LANGUAGE="JAVASCRIPT" CODEPAGE="65001"%> NIST Speech Group Website
Information Technology Lab, Information Access Division NIST: National Institute of Standards and Technology

  • Multimodal Information Group Home
  • Benchmark Tests
  • Tools
  • Test Beds
  • Publications
  • Links
  • Contacts
  • 2003 Language Recognition Evaluation

    The 2003 NIST Language Recognition evaluation (LRE-03) is part of an ongoing series of evaluations of language recognition technology. The protocols and procedures of this year's evaluation is given in the evaluation plan (LRE03EvalPlan-v1.pdf, updated January 13, 2003).

    Those who are interested in participating in the evaluation must fill out a registration form and return to NIST before the registration deadline of February 19, 2003.

    Sites must put in a request to NIST to get the training and/or development data. Non-LDC members must sign the LDC license agreement before NIST can send them the data.

    The LRE-03 answer key is now available online.

    Important Updates:

    • Nov 29, 2005: Post LRE-03 answer key to the to website.

    • July 29, 2003: Language recognition resources made publicly available. MIT-Lincoln Labs is making available their speech detection (using talkative) marks for both the development and evaluation data used for the 2003 NIST Language Recognition evaluation. View the readme file for details.

    • January 21, 2003: Note to system developers. An overlap exists between the published LDC CallFriend corpus and the data used for the 1996 NIST Language Recognition evaluation. If using the 1996 NIST development and evaluation data for system development, sites should view the conversation lists used for each. This is to avoid testing on training data during system development.

    • January 13, 2003: The dates of the evaluation workshop have changed and are now reflected in the evaluation plan and schedule.
    2003 NIST Language Recognition Evaluation Schedule
    February 19, 2003
    Registration deadline
    February 24, 2003
    Evaluation period begins
    March 10, 2003
    Evaluation period ends
    March 12, 2003
    Preliminary results released to participants
    April 28-29, 2003
    Evaluation workshop

    [ LRE Home ]



    Page Created: December 20, 2002
    Last Updated: November 4, 2008

    Multimodal Information Group is part of IAD and ITL
    NIST is an agency of the U.S. Department of Commerce
    Privacy Policy | Security Notices|
    Accessibility Statement | Disclaimer | FOIA