NIST Metrics for Machine Translation 2010 Evaluation (MetricsMaTr10) Official Release of Results

History of Changes

Introduction

NIST continued the MetricsMaTr Challenge, a series of research challenge events for machine translation (MT) metrology promoting the development of innovative, even revolutionary, MT metrics, with MetricsMaTr10. Please visit the for general information on the MetricsMaTr evaluation series, and the MetricsMaTr10 page for specfics on the 2010 evaluation.

MetricsMaTr10 was implemented in accordance with the MetricsMaTr10 evaluation plan. It took place in the spring/summer of 2010 as part of the Joint Fifth Workshop on Statistical Machine Translation and MetricsMaTr10, a workshop of ACL 2010.

Results in this report are limited to the MetricsMaTr10 test set; results for the WMT10 test set will be available on the WMT10 web site.

Data

MetricsMaTr10 evaluation set

Tracks

Metrics

Correlation Results

References

References to this report should cite: Peterson, K. & M. Przybocki, NIST 2010 Metrics for Machine Translation Evaluation (MetricsMaTr10) Official Release of Results, http://www.itl.nist.gov/iad/mig/tests/metricsmatr/2010/results.

Disclaimer

Certain commercial equipment, instruments, software, or materials are identified in this paper in order to specify the experimental procedure adequately. Such identification is not intended to imply recommendation or endorsement by NIST, nor is it intended to imply that the equipment, instruments, software or materials are necessarily the best available for the purpose.


Questions and comments regarding this report should be sent to mt_poc@nist.gov.