The Defense Language Institute (DLI) and MIT Lincoln Laboratory (MIT-LL) have collaborated to develop a MT Comprehension test protocol based on the Defense Language Proficiency Test (DLPT), a broadly accepted measure of effectiveness for evaluating foreign language proficiency. The adaptation of the DLPT for machine translation evaluation is known as the DLPT-star. The NIST OpenMT08 evaluation included such a test, in collaboration with DLI and MIT-LL. Ten Arabic-to-English and ten Chinese-to-English systems that participated in the respective OpenMT08 Progress test were included. For Chinese-to-English, this meant all ten systems that participated in the Progress test; for Arabic-to-English, systems were selected from the top, middle, and bottom of the range of BLEU scores attained. The full DLPT-star results from OpenMT08 were not made available to the public, unlike originally planned. The chart below lists the DLPT-star scores on the Progress test for the system that attained the highest score in each condition, as well as the DLPT-star score for the reference translation included in the test: