Automatic Content Extraction (ACE) Evaluation

Information Technology Lab, Information Access Division

NIST: National Institute of Standards and Technology

Multimodal Information Group Home

Benchmark Tests

ACE Phase 1 (2000)
Corpus Annotation

Three sites are participating in the annotation process of the ACE Pilot Study Corpus; BBN, LDC, and MITRE. Approximately 3 weeks will be spent annotating the TRAINING data, 2 weeks each for the DEVTEST and EVALTEST data.

NIST maintains a bug report of errors found in the annotated data.

03/10/2000
TO BE ANNOTATED:
TRAINING data for Newswire and Broadcast News sources

BBN LDC MITRE

03/20/2000
TO BE ANNOTATED:
TRAINING data for Newspaper sources

BBN LDC MITRE

03/27/2000
First Incremental Release of ANNOTATED:
TRAINING data

ace_pilot_annotated.v0

04/03/2000
TO BE ANNOTATED:
DEVELOPMENT TEST data (Newswire, Broadcast News & Newspaper sources)

BBN LDC MITRE

04/05/2000
Full Release of ANNOTATED:
TRAINING data

ace_pilot_annotated.v0.1

04/17/2000
TO BE ANNOTATED:
EVALUATION TEST data (Newswire, Broadcast News & Newspaper sources)

BBN LDC MITRE

04/18/2000
Full Release of ANNOTATED:
TRAINING & DEVELOPMENT data

Training & Development (v0.1)
Development Only (v0.1)

05/08/2000
Phase 1 Evaluation Data Evaluation Data (v0)

[ ACE Home ]

Page Created: September 6, 2007
Last Updated: November 4, 2008

ACE Phase 1 links:

Multimodal Information Group is part of IAD and ITL
NIST is an agency of the U.S. Department of Commerce