Information Technology Lab, Information Access Division NIST: National Institute of Standards and Technology

  • Multimodal Information Group Home
  • Benchmark Tests
  • Tools
  • Test Beds
  • Publications
  • Links
  • Contacts
  • MADCAT 2008 Phase 1 Evaluation

    The pilot evaluation for the first MADCAT phase was held during the fall 2008.

    Evaluation Planning

    The MADCAT 2008 Phase 1 Evaluation Plan (revision 3) describes the Evaluation Tasks, Data, Post-Editing Protocol, Evaluation Metrics.

    Data Resources

    Training data, development data and pilot evaluation data releases were provided by the LDC.

    Software

    The MATCAT scoring package (MATCATEval) is available from the NIST Speech Group tools page.

    Schedule

    The table below lists the dates of the major milestones in the pilote evaluation.

    Date Milestone Description
    June 3 - Sept 9, 2008 Training & Development Data
    Aug 27 - Sept 17, 2008 Pilot Dry-Run
    Sept 22 - Nov 14, 2008 Pilot Evaluation
    Jan 20 - May 6, 2009 Formal Evaluation (if required)

     

     

     

    Page Created: September 30, 2008
    Last Updated: November 4, 2008

    {right_content}
    Multimodal Information Group is part of IAD and ITL
    NIST is an agency of the U.S. Department of Commerce
    Privacy Policy | Security Notices
    Accessibility Statement | Disclaimer | FOIA