|
Multimodal Information
Group Home
Benchmark Tests
Tools
Test
Beds
Publications
Links
Contacts
|
ACE Phase 1 (2000)
Corpora
Corpora
ACE Pilot Corpus
ACE Mini-1 Corpus
ACE Mini-2 Corpus
Software
Current Version:
09/06/2000 : EDT_ref_compare
(v24) and edt-eval (v04)
Corrects a problem with the mention detection scoring in EDT, namely that
mentions with correct extents were being counted twice.
History of software:
Version 23 of EDT_ref_compare
Same as previous version with a bug fix to reinstate ability to output
html visualization files.
Version 22 of EDT_ref_compare
This version rearranged entity mapping to skip comparisons for which
a better match is impossible. This is performed by comparing the score
for the current best mapping with the maximum possible score for the
current (partial) mapping and abandoning the search whenever the maximum
possible score would be worse than the current best score. More rapid
search is achieved by sorting the entities according to maximum possible
score and putting the most important entities in the innermost loops.
This version runs about 10 percent slower on the easy cases of ref-tst
mappings, but is a "zillion" times faster on cases where the cohorts
list is potentially astronomical.
NOTE: This version may/will produce different ref-tst mappings because
of the order of comparison is different.
Version 21 of EDT_ref_compare
Same as version 20, but optimized for speed.
Version 20 of EDT_ref_compare
Expanded the scoring output to condition the evaluation of entity
detection on the entity's type and number of mention.
Version 19 of EDT_ref_compare
Version 18 of EDT_ref_compare
[ ACE Home ]
Page Created: September 6, 2007
Last Updated: November 4, 2008
|
ACE Phase 1 links:
ACE Phase 1 Home
Documentation
Schedule
Resources
Contacts
ACE Home
|
