Reproducibility Audit¶
One-command audit¶
python main/reproducibility_audit.py
What this audit covers¶
- package test execution
- environment manifest generation
- deterministic rerun checks
- bundle breadth/coverage summaries
- stress-suite execution summaries
- runtime and cost summaries
Primary outputs¶
main/output/repro/reproducibility_audit.jsonmain/output/repro/reproducibility_audit.mdmain/output/repro/environment_manifest.jsonmain/output/repro/benchmark_breadth_summary.jsonmain/output/repro/runtime_cost_report.json
How to use audit outputs in reports¶
Include:
- exact command used
- protocol version/hash
- environment manifest path
- rerun agreement summary
This makes external validation substantially easier.
Manual runbook¶
For command-by-command execution details, see:
docs/reference/reproducibility_runbook.md