Report Formats

mcp-conformance produces reports in three formats:

Reports

JSON (canonical)

Machine-readable output with scenario IDs, step traces, assertion results, and timing.

mcp-conformance run json

Markdown (human-readable)

Console-friendly summary with pass/fail per scenario and step-level errors.

mcp-conformance run

JUnit XML (CI)

CI-friendly format compatible with GitHub Actions, Jenkins, and other CI systems.

Exit Codes

Assertion Catalog

HTTP layer: status, header, header_absent, content_type, body_json_path, redirect_location_contains

JSON-RPC layer: jsonrpc_version, result_exists, result_shape, error_code, error_message

OAuth layer: token_type, response_contains_keys, scope_contains

Wire layer: header, header_absent, content_type, redirect_location_contains