Information Technology Lab, Information Access Division NIST: National Institute of Standards and Technology

  • Multimodal Information Group Home
  • Benchmark Tests
  • Tools
  • Test Beds
  • Publications
  • Links
  • Contacts
  • Automatic Content Extraction
    2004 Evaluation (ACE04)

    The NIST series of evaluations of information extraction technology continues in the late summer of 2004 for ACE and TIDES participants and all other researchers that find the task of interest.

    This web-site will be updated as more information becomes available.

    July 21th, 2004

    July 16th, 2004

    July 9th, 2004

    • Updated version (6) of the 2004 ACE evaluation plan. The updates to the evaluation plan include:
      • a value-based evaluation of TERN
      • an appendix documenting the CTM format required for STT input
      • some additional clarification of evaluation and scoring conditions

    June 29th, 2004

    • Slightly updated version (5a) of the 2004 ACE evaluation plan. The only difference from version 5 is a change in the "Scoring Parameter Settings" table to correct the values for Wm-cr.

    June 18th, 2004

    • Updated: version 5 of the 2004 ACE evaluation plan. Documents the "EDR co-reference (given mentions)" and "RDR given entities" tasks.
    • The 2004 ACE evaluation registration form has been posted. To officially register this form must be complete and returned to NIST by July 15th, 2004.

    May 19th, 2004

    • The 2004 ACE evaluation plan (version 3) has been posted.

    Time Expression Recognition and Normalization (TERN)

    There will be a separate TIMEX2 task in conjunction with this year's ACE evaluation. Participation can be in the English and/or the Chinese version of the task. The evaluation period will be August 2-13, 2004. A one day TERN workshop will be held on September 23rd 2004. (Immediately following the ACE evaluation workshop.) View the call for participation (CFP).

    • 5/03/04: Download the TERN evaluation plan (pdf).
    • Follow the instructions in the CFP in order to notify NIST of your tentative interest in the evaluation and to receive the training data.
    • If you decide to participate in the formal evaluation, follow the registration instructions. The registration deadline is June 30th, 2004.
    [ ACE Home ]

     

     

     

    Page Created: September 6, 2007
    Last Updated: November 4, 2008

    ACE04 links:

    ACE04 Home

    Software

    Resources

    ACE Home

    Multimodal Information Group is part of IAD and ITL
    NIST is an agency of the U.S. Department of Commerce
    Privacy Policy | Security Notices
    Accessibility Statement | Disclaimer | FOIA