Automatic Content Extraction (ACE) Evaluation

ACE Phase 1 2000
Workshop

Location and Workshop Activities

The workshop was held at the Comfort Suites at Laurel lakes, 14402 Laurel Place, Laurel, Maryland.

Agenda for Automatic Content Extraction (ACE) Program Kick-off Workshop

Wednesday, November 29, 2000

1000 - 1030	30	Welcome & Overview of ACE Program	J.K. Davis
1030 - 1150	100	Session 1: ACE Contractor Reports - Tasks & Technology	.
1030 - 1045	15	BBN-Report	Lance Ramshaw
1045 - 1100	15	SRI	Andy Kehler
1100 - 1115	15	NYU	Adam Meyers
1115 - 1130	15	MITRE	David Day
1130 - 1145	15	UPenn	Marth Palmer
1145 - 1200	15	Proposition Bank Discussion	Marth Palmer
1200 -1300	60	Working Lunch	.
1300 - 1500	120	Session 2: Discussion of Metonymy	.
1300 -1340	40	Range of Phenomena in Different Domains	Lisa Ferra
1340 - 1500	80	Discussion: Metonymy	J.K. Davis
1500 - 1530	30	Break	.
1530 - 1730	120	Session 3: Relation Detection Task Definition	.
1530 - 1730	120	Progress, Issues, Discussions, and Recommendations BBN-RDC	Doddington Ramshaw Appelt

Thursday, November 30, 2000

0900 - 1420	320	Session 4: Entity Detection Task Evaluation	.
0900 - 1040	100	Entity Detection Task Description, Performance Metrics, & Re-Eval Results Confustion Matrix of newswire (MS excel)	George Doddington
1040 - 1100	20	Break	.
1100 - 1115	15	BBN Report on EDT Technology & Re-Eval	Lance Ramshaw
1115 - 1130	15	SRI Report on EDT Technology & Re-Eval	Doug Appelt
1130 - 1145	15	NYU Report on EDT Technology & Re-Eval	Ralph Grishman
1145 - 1200	15	MITRE Report on EDT Technology & Re-Eval	David Day
1200 - 1300	60	Working Lunch
1300-1320	20	Issues Discussion: Degraded Output ASR Transcripts, Speaker Turns, Sentence Boundaries, OCR Error Models	Ralph Grishman
1320 - 1340	20	Precision/Recall as EDT Scoring Metric	Jim Mayfield
1340 - 1400	20	Single EDT Scoring metric	George Doddington
1400-1430	30	Discussion of EDT Scoring metric	George Doddington
1430 - 1730	210	Session 5: EDT+	.
1430 - 1520	50	Discussion of Enhancements to EDT	George Doddington
1520 - 1550	30	Break	.
1550-1640	50	Discusion of EDT+ Corpus/Annotation Needs	George Doddington
1640-1730	50	Discussion and Draft of EDT+ Tasks	George Doddington

Friday, December 1, 2000

0900 - 1030	90	Session 6: Cross-Document Information Tracking	.
0900 - 0945	45	Overview of XDIT Infrastructure	J.K. Davis Alan Goldschen
0945 - 1030	45	Discussion of XDIT for EDT & RDT	J.K. Davis
1030 - 1100	30	Break	.
1100 - 1200	60	General Wrap-up Discussions	George Doddington
1200 - 1300	60	Working Lunch	.

[ ACE Home ]

Page Created: September 6, 2007
Last Updated: November 4, 2008

ACE Phase 1 links:

ACE Phase 1 Home

Multimodal Information Group is part of IAD and ITL
NIST is an agency of the U.S. Department of Commerce