<%@LANGUAGE="JAVASCRIPT" CODEPAGE="65001"%> NIST Speech Group Website
Information Technology Lab, Information Access Division NIST: National Institute of Standards and Technology


  • Multimodal Information Group Home
  • Benchmark Tests
  • Tools
  • Test Beds
  • Publications
  • Links
  • Contacts
  • 2000 Speaker Recognition Evaluation

    The 2000 NIST Speaker Recognition evaluation is part of an ongoing series of yearly evaluations conducted by NIST. These evaluations provide an important contribution to the direction of research efforts and the calibration of technical capabilities. They are intended to be of interest to all researchers working on the general problem of text independent speaker recognition. To this end the evaluation was designed to be simple, to focus on core technology issues, to be fully supported, and to be accessible.

    Evaluation Documentation

  • The Evaluation Plan was last modified 01/18/2000 and contains full documentation regarding the 2000 NIST Speaker Recognition Evaluation.
  • Supporting documentation for the evaluation test material, NIST Speech Discs r65_1_1 through r65_9_1.
  • Protocol for submitting system results
  • Download the 2000 NIST Speaker Evaluation answer keys.
  •        Supporting Ahumada DevTest Documentation

  • MIT-LL has provided a table documenting handset label type and probability for the Ahumada developtment data Format per line:

    < basefilename > MALE 1 < HS > Pr(HS)

    HS := CARB|ELEC
  • Schedule

    • 03/31/2000 - Deadline for signing up to participate in the evaluation

    • 04/17/2000 - Evaluation data to arrive at participating sites
    • 05/08/2000 - Evaluation results due at NIST
    • 06/12/2000 - Deadline for registration and payment for the Speaker Recognition Evaluation Workshop
      Also available General Information regarding the workshop administrivia
    • 06/26/2000-06/27/2000 - Two day Speaker Recognition Evaluation Workshop at the Maritime Institute of Technology

    Evaluation Data

    The development and evaluation data used for this evaluation is provided free of charge. To obtain these data, participants are required to sign limited license agreements which restrict the use of the data for this evaluation:

  • Participants which are not members of the LDC must complete the LDC's License Agreement and return it to the LDC
  • Participants performing the optional one-speaker detection task using the Spanish Ahumada data must complete the Ahumada License Agreement (Word Document, Postscript, or PDF) and return it to:

    Dr. Javier Ortega-Garcia
    EUIT Telecomunicacion - UPM
    Ctra. Valencia km. 7
    28031 Madrid
    SPAIN

  • Scoring Software

    Modified scoring software for the tasks of tracking and segmentation is now available. This version-0 of the scoring software is designed to work with the development test sets. The official software will be a more versatile package, and will be released with the results.

    The generic segmentation scoring script which was used to evaluate the segmentation tasks of this evaluation, is now available.



     



    [ SRE Home ]

     

     

    Page Created: Month Day, Year
    Last Updated: November 4, 2008

    Multimodal Information Group is part of IAD and ITL
    NIST is an agency of the U.S. Department of Commerce
    Privacy Policy | Security Notices|
    Accessibility Statement | Disclaimer | FOIA