Information Technology Lab, Information Access Division NIST: National Institute of Standards and Technology

  • Multimodal Information Group Home
  • Benchmark Tests
  • Tools
  • Test Beds
  • Publications
  • Links
  • Contacts
  • Automatic Content Extraction & Entity Translation
    2007 Evaluations (ACE07 & ET07)

    The NIST series of information extraction technology evaluation will continue in January 2007. ACE07 will include:

    • A pilot evaluation using Spanish data for the tasks of entity detection and recognition (EDR) and temporal expression recogntion and normarlization (TERN)
    • A pilot evaluation of an Entity Translation task.

    The evaluation will be open to ACE participants and all other researchers that find the task of interest.

    February 22th, 2007:

    The official version of the ACE evaluation plan is available. This version updated the workshop schedule and contains the current NIST policy for publicly releasing results.

    January 18th, 2007:

    A slightly updated version of the Entity Translation evaluation plan (version 1.8).

    January 10th, 2007:

    A slightly updated version of the Entity Translation evaluation plan (version 1.6). View the same document with changes marked.

    January 5th, 2007:

    An official version of the Entity Translation evaluation plan (version 1.4b) is available.

    November 14th, 2006:

    The draft version of the Entity Translation evaluation plan is available. Another slight update to the ACE evaluation plan reflecting the fact that NIST is reviewing our policy for publicly releasing results.

    October 28th, 2006:

    The ACE evaluation plan was slightly updated to correct typos. If necessary, future modification to the ACE evaluation plan will clearly track the changes.

    October 17th, 2006:

    The evaluation plan, describing the ACE 2007 evaluation protocols and data, is now available. The 2007 evaluation will be very similar to the last ACE test (Dec. '05), in fact NIST will be reusing much of the data from that test, but we will have new data as described in the evaluation plan.

    [ ACE Home ]

     

     

     

    Page Created: September 6, 2007
    Last Updated: November 4, 2008

    ACE07 links:

    ACE07 Home

    Documentation

    Entity Translation

    Software

    Schedule

    ACE Home

    Multimodal Information Group is part of IAD and ITL
    NIST is an agency of the U.S. Department of Commerce
    Privacy Policy | Security Notices
    Accessibility Statement | Disclaimer | FOIA