<%@LANGUAGE="JAVASCRIPT" CODEPAGE="65001"%> NIST Speech Group Website
Information Technology Lab, Information Access Division NIST: National Institute of Standards and Technology


  • Multimodal Information Group Home
  • Benchmark Tests
  • Tools
  • Test Beds
  • Publications
  • Links
  • Contacts
  • 2002 Speaker Recognition Evaluation

    The 2002 NIST Speaker Recognition evaluation is part of an ongoing series of yearly evaluations conducted by NIST. These evaluations provide an important contribution to the direction of research efforts and the calibration of technical capabilities. They are intended to be of interest to all researchers working on the general problem of text independent speaker recognition. To this end the evaluation was designed to be simple, to focus on core technology issues, to be fully supported, and to be accessible.

    Evaluation Documentation

  • 27-Feb-2002:
  • The Evaluation Plan for the 2002 NIST Speaker Recognition Evaluation is available in postscript and pdf format. The current version number is v60. Updates from the previous version focus on the evaluation CD layout.

  • Protocol for submitting system results
  • The multi-modal speaker detection condition uses data taken from the FBI Voice Database. Two documents that are distributed with this data set are available here.
  • User Manual (pdf) or (ps)
  • 1998 FV1 evaluation plan (pdf) or (ps)

  • Please Note: the data names and structure will be different in the 2002 NIST evaluation, and the NIST evaluation will only use level I and III testing.

  • Resources for the Extended Data Evaluation

  • One Speaker Detection key and description.

  • License Agreement: The development and evaluation data used for this evaluation is provided free of charge. To obtain these data, participants are required to sign the LDC's limited license agreement which restrict the use of the data for this evaluation. The signed license agreement must be received by the LDC before NIST distribute development or evaluation data to a particular site.
  • Schedule

    • March 1, 2002 - Deadline for signing up to participate in the evaluation

    • March 18, 2002 - Evaluation data to arrive at participating sites
    • April 15, 2002 - Evaluation results due at NIST
    • TBD - Deadline for registration and payment for the Speaker Recognition Evaluation Workshop.
    • May 20-21, 2002 - Two day Speaker Recognition Evaluation Workshop.

    Scoring Software

    NIST is using a new segmentation scoring script. This script reports segmentation cost as defined in the 2002 evaluation plan.

    The generic segmentation scoring script which was used to evaluate the segmentation tasks of this evaluation, is now available.



    [ SRE Home ]

     

     

    Page Created: Month Day, Year
    Last Updated: November 4, 2008

    Multimodal Information Group is part of IAD and ITL
    NIST is an agency of the U.S. Department of Commerce
    Privacy Policy | Security Notices|
    Accessibility Statement | Disclaimer | FOIA