3 Interpreter testing

Interpreter conformance testing focuses on testing a CGM interpreter for conformance to Version 1 CGM as specified in the FIPS 128-2 and the ATA profile. A Registered Test Report will be produced at the end of the testing process. If no errors are detected by the testing process, a Certificate of Validation and Registered Test Report will be issued. The Certificate of Validation is valid for two years. If errors are detected during the validation, the Registered Test Report will list the errors and be issued as a Registered Test Report. The Registered Test Report is listed in the VPL and is valid for one year.

 Interpreters are tested in conjunction with a specific environment. The environment consists of the computer hardware, output devices (display or printer), operating system, and any application software or programs required to support the implementation under test (IUT). The certificate and Registered Test Report issued as a result of validation pertain only to the interpreter and environment actually tested.
 

3.2 Testing steps

The validation process for interpreter testing is a multi-step process conducted in two phases that is initiated by a client's Request for Validation.

1. Pre validation

a. Test Suite installation and interpretation
b. Completion of Operator Test Script

a. On-site validation
b. Test report summary
c. Notification of conformance
d. Certificate and VSR

a. Test Suite installation and interpretation --
The client is provided with the Interpreter Validation Test (IVaT) suite. The IVaT suite consists of a collection of CGM files, an operator script, and a set of reference pictures. The metafiles are copied from the (NIST supplied) disk to the client's system. Each metafile must be interpreted using the IUT. The resulting picture is then compared to the reference picture and a pass/fail decision is made based on the criteria described in the operator script.

b. Completion of Operator Test Script --
The client submits the completed operator test script for pre validation inspection. Upon completion of pre validation, the schedule and arrangements for on-site validation are confirmed.

a. On-site validation --
The on-site validation consists of the NIST personnel witnessing the installation and execution of a 'new' copy of the IVaT suite.

b. Test Report --
NIST/ITL prepares a draft VSR summarizing the testing procedures and results of the interpreter testing. The report includes information about the interpreter and the environment under which it was tested, and all errors (behavior not in conformance with the standard and application profile). Finally, the report clearly indicates whether or not the interpreter meets the conformance requirements of FIPS 128-2 and the ATA profile.

c. Notification of Conformance --
The Test Report along with a Notification of Conformance is sent to the client. The Notification of Conformance lists the interpreter and environment for which the Certificate and Registered Test Report will be issued. Additionally, any errors and/or conditionally supported capabilities will be identified.

The client has 30 days to review the Test Report and to notify NIST/ITL in writing of any objections. If there are no objections, the client returns the signed Notification of Conformance. Receipt of this notification is required before the Certificate of Validation and Registered Test Report can be issued. Note, the finalized VSR is designated as a Registered Report and issued as such.

d. Certificate of Validation and Registered Report --
A Certificate of Validation will be issued for interpreters which have successfully passed the conformance requirements of both the FIPS 128-2 and ATA profile. AP. A Registered Test Report, without a certificate, will be issued for interpreters which have been tested and contain errors. The Certificate of Validation and Registered Test Report will be published in the Validated Products List.

The cost for CGM interpreter testing is as follows: