Track backtest reports in git; add a report comparison tool
The reports are the evidence behind the production baseline, so they belong next to the README that quotes them rather than living only on one machine. Un-ignores reports/*.json (~2.6 MB compressed for all 11); the snapshot DBs they run against stay ignored. Renames the reports to a single dated scheme so they sort chronologically and say what they measured. Each name is derived from the report's own contents (the atr_trail_sweep / regime_overlay / blue_sky_projected / sizing_test sections, and the qualified counts that identify the A/B arms), not from the ad-hoc slugs they carried before. The run the README quotes is now backtest-20260711-prod-baseline.json. reports/compare_reports.py loads every report into one sortable table (portfolio monitor, entry variants, exit policies, portfolio sim), filters by report and lookback, and highlights the best row for a chosen metric — max drawdown correctly ranking lowest-as-best. Stdlib tkinter, no dependencies. Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
This commit is contained in:
+2
-1
@@ -36,5 +36,6 @@ alembic/versions/__pycache__/
|
||||
combined-ca-bundle.pem
|
||||
|
||||
# Local research artifacts
|
||||
# Backtest reports in reports/ are tracked: they are the evidence behind the
|
||||
# production baseline in the README. The snapshot DBs they run against are not.
|
||||
backtest_snapshots/
|
||||
reports/backtest-*.json
|
||||
|
||||
Reference in New Issue
Block a user