Reporters

JSON

JSON Reporter

report_json.py


from llmtest_core.reporters import JSONReporter
 
reporter = JSONReporter()
print(reporter.render(suite_result))

JUnit

JUnit Reporter

For GitHub Actions, Jenkins, and other CI systems:

report_junit.py


from llmtest_core.reporters import JUnitReporter
 
reporter = JUnitReporter()
with open("results.xml", "w") as f:
    f.write(reporter.render(suite_result))

pytest Summary

Automatic after every test run — no configuration needed:

Output


────────── assertllm summary ──────────
  LLM tests: 5 passed, 1 failed
  Assertions: 14/15 passed
  Total cost: $0.000234
  Avg latency: 823ms

The pytest summary is always shown automatically. Use JSON/JUnit reporters for programmatic access or CI integration.

Last updated on March 9, 2026

CLI