This web-site will be updated as more information becomes available.

July 21th, 2004

• Updated version (7) of the 2004 ACE evaluation plan. Minor update not effecting the ACE evaluation. The formula for the TERN evaluation has been modified.

July 16th, 2004

• A sample ASR file has been posted. Sites registered for the 2004 evaluation may request the 2001 ACE ASR evaluation data which is in much the same format as the ASR data we are using for 2004.
• A sample "ground truth EDR mentions" file for the co-reference task has been posted.
• A sample "ground truth EDR entities" file for the the RDR given ground truth entities task has been posted.

July 9th, 2004

• Updated version (6) of the 2004 ACE evaluation plan. The updates to the evaluation plan include:
  • a value-based evaluation of TERN
  • an appendix documenting the CTM format required for STT input
  • some additional clarification of evaluation and scoring conditions
    

June 29th, 2004

• Slightly updated version (5a) of the 2004 ACE evaluation plan. The only difference from version 5 is a change in the "Scoring Parameter Settings" table to correct the values for Wm-cr.

June 18th, 2004

• Updated: version 5 of the 2004 ACE evaluation plan. Documents the "EDR co-reference (given mentions)" and "RDR given entities" tasks.
• The 2004 ACE evaluation registration form has been posted. To officially register this form must be complete and returned to NIST by July 15th, 2004.
  

May 19th, 2004

• The 2004 ACE evaluation plan (version 3) has been posted.
  

Time Expression Recognition and Normalization (TERN)

There will be a separate TIMEX2 task in conjunction with this year's ACE evaluation. Participation can be in the English and/or the Chinese version of the task. The evaluation period will be August 2-13, 2004. A one day TERN workshop will be held on September 23rd 2004. (Immediately following the ACE evaluation workshop.) View the call for participation (CFP).

• 5/03/04: Download the TERN evaluation plan (pdf).
• Follow the instructions in the CFP in order to notify NIST of your tentative interest in the evaluation and to receive the training data.
• If you decide to participate in the formal evaluation, follow the registration instructions. The registration deadline is June 30th, 2004.

ACE04 Home

Software

Resources

ACE Home