Go Back

Metrics

Baseline Metrics

Metric NameAffiliationLinkParticipating track(s)
Single ReferenceMultiple References
BLEU-1IBMhttp://talesdemo.watson.ibm.com/BLEUyesyes
BLEU-4IBMhttp://talesdemo.watson.ibm.com/BLEUyesyes
BLEU-v11bNational Institute of Standards and Technologyhttp://www.nist.gov/speech/tools/yesyes
BLEU-v12National Institute of Standards and Technologyhttp://www.nist.gov/speech/tools/yesyes
METEOR-v0.6Carnegie Mellon Universityhttp://www.cs.cmu.edu/~alavie/METEOR/yesyes
NIST-v11bNational Institute of Standards and Technologyhttp://www.nist.gov/speech/tools/yesyes
TER-v0.7.25University of Maryland / BBN Technologieshttp://www.cs.umd.edu/~snover/tercom/yesyes

Site Metrics

Metric NameAffiliationLinkParticipating track(s)
Single ReferenceMultiple References
4-GRRUniversity of Southern California, Information Sciences Instituteyesyes
ATEC1City University of Hong Kongyesyes
ATEC2City University of Hong Kongyesyes
ATEC3City University of Hong Kongyesyes
ATEC4City University of Hong Kongyesyes
BEwT-EUniversity of Southern California, Information Sciences Instituteyesyes
BadgerBabbleQuestyesyes
BadgerLiteBabbleQuestyesyes
Bleu-sbpUniversity of Southern California, Information Sciences Instituteyesyes
BleuSPRWTH Aachen Universityyesyes
CDerRWTH Aachen Universityyesyes
DP-OrUniversitat Politècnica de Catalunya, LSIyesyes
DP-OrpUniversitat Politècnica de Catalunya, LSIyesyes
DR-OrUniversitat Politècnica de Catalunya, LSIyesyes
EDPMUniversity of Washingtonyesyes
LETHarbin Institute of Technology, School of Computer Science and Technologyyesyes
METEOR-rankingCarnegie Mellon Universityyesyes
MaxSimNational University of Singaporeyesyes
Meteor-v0.7Carnegie Mellon Universityyesyes
RTEStanford Universityyesno
RTE-MTStanford Universityyesno
SEPIA1Columbia Universityyesyes
SEPIA2Columbia Universityyesyes
SNRHarbin Institute of Technology, School of Computer Science and Technologyyesyes
SR-OrUniversitat Politècnica de Catalunya, LSIyesyes
SVM-RankHarbin Institute of Technology, School of Computer Science and Technologyyesyes
TERpUniversity of Maryland / BBN Technologiesyesyes
ULChUniversitat Politècnica de Catalunya, LSIyesyes
ULCoptUniversitat Politècnica de Catalunya, LSIyesyes
invWerRWTH Aachen Universityyesyes
mBLEUCarnegie Mellon Universityyesyes
mTERCarnegie Mellon Universityyesyes