Conformance Testing Assistant (ConTesA)

The Conformance Testing Assistant (ConTesA) enables users to test NIEM XML schemas against the automated rules from the NIEM Naming and Design Rules (NDR). This is an important first step in verifying NIEM conformance.

  • Validates XML schemas against the automated rules of the NIEM NDR.
  • Generates a conformance report available in spreadsheet, HTML, and XML formats.
  • Tests single XML schemas or multiple schemas bundled in a zip file.
  • Saves conformance reports to the user accounts.

Do not upload sensitive or classified materials to ConTesA.

The current version of ConTesA works for NIEM XML schemas based on version 3.0 of the NDR or later. For an older version of ConTesA that works for the NIEM 2.x series, please follow this link.

Scope

Automated NDR Rules

Some of the rules that the NDR defines are written in Schematron. ConTesA is able to run validation on all such rules.

The image below shows a rule written in Schematron from the NDR:

NDR schematron rule

Out of scope

Full NIEM or NDR conformance

ConTesA cannot verify that a schema is fully NIEM conformant; only that it passes the set of automated rules from the NDR. The NDR also has free-text rules that cannot be automated and must be checked manually.

The image belows shows a rule written in free text from the NDR:

NDR free-text rule

IEPD conformance

ConTesA can check a very limited number of rules from the Model Package Description (MPD) Specification. Ensuring that an IEPD meets all applicable rules currently requires manual review.

XML schema validation

ConTesA does not run XML schema validation. This is required for NIEM conformance, but there are many tools available that already do this, including XMLSpy, Oxygen XML Editor, and Xerces.

Usage

Log in

Register for a new account or log in.

Upload a file

This can be either a single NIEM XML schema or a set of schemas packaged together in a zip file.

Because ConTesA does not perform XML schema validation, it is not necessary to upload a NIEM release or NIEM subset along with your own files.

Review results

After ConTesA has finished validation, review the status panel for highlights and the conformance reports. You may need to refresh the page to get the links for the conformance reports.

The image below shows the validation status panel for a single schema that was uploaded to ConTesA, crash_model.xsd. There, you can see an overview of the results and view or download a conformance report for more information.

Example validation status panel

There may be some or many rules from the NDR that will not be applicable to your schema. For example, if your schema does not include any simple union types, then no NDR rules related to simple union types will be executed. This is the “Rules not executed” count that is represented in the gray box. This is a different count than the number of NDR rules that require manual review, which is not reported.

Confirm all applicable files were tested

The NDR requires a ct:conformanceTargets attribute on all NIEM XML schemas. The value of this attribute informs ConTesA of which rule set(s) to use for testing. Without this attribute, no conformance tests will be run.

See the section about the Conformance Targets Attribute Specification for more information about this attribute and examples of how to define it.

Any file that does not include the ct:conformanceTargets attribute, or any file that was not able to be tested for other reasons (such as not being well-formed XML), will appear under the line for “No Rules to Run”. Be sure to check this list, fix all applicable schemas that should be tested, and re-run them in ConTesA.

  • The image below shows example schema highway_model.xsd that did not include a ct:conformanceTargets attribute and was therefore unable to be validated by ConTesA.
  • The missing attribute should be added to the schema and then it should be retested.

Result for schema that was not tested

Conformance Report

A conformance report will be available in three formats: HTML, spreadsheet, and XML.

Summary

The conformance report will include a summary section, listing the number of rules that passed and failed.

Conformance report - summary section

Auto Fail Rules

The key section to review from the conformance report lists the rules that the schema did not pass. Use the line number from the report to help track down the error or warning, and look up the rule number in the NDR if you need more information about it.

Conformance report - rules auto failed

Frequently Asked Questions

I can’t logout of ConTesA?

Try deleting your browser’s data cache and cookies.

Where are my files?

The files uploaded for conformance testing are not stored on the ConTesA servers. Data exists temporarily in memory on the servers while the files are being processed; once processing is complete the data is cleared from memory.

What is my username?

Your username is the email address you used for registration with the ConTesA site.

I don’t remember my registration email, how do I login?

Unfortunately, we cannot retrieve your user information without record of the email address you used to register.

Where is my user data stored?

Your user data is securely stored on the ConTesA servers.

What user data do you have?

ConTesA only stores the user data entered for registration as well as a record of the file names and their associated conformance reports.