Random-entry / null-model benchmark
Methodology · Null benchmarking / signal-information test
componentsetupno reproduced evidence
Stage
setup
Licence
internal
Blockers
0
Leakage audit
not applicable
Claims
What the upstream repository, author or a static read asserts — never evidenceunverified
Comparing a candidate against randomized entries under matched exposure, holding time, side balance, session window and risk sizing shows whether signal selection adds information beyond drift/exposure.
claimed by internal methodology plan
Reproduced by TradeRep
Only findings with an openable evidence artifact countNothing reproduced yet, so no performance figure may be attributed to this item. Promotion requires independently reproduced evidence — a README claim is not a result.
Source & licence
Repository
internal methodology addition
Upstream
External Futures Bot Validation Plan §2
Immutable SHA
Not pinned yet — reproduction should record one.
Licence status
internal — TradeRep methodology addition; no third-party code.
Disposition
Required comparison output for every external candidate: null-model percentile.
Notes
Distinct from the Strategy Lab's own synthetic benchmark strategies (A0.1), which exercise the engine rather than benchmark a candidate's signal.
Audit targets, data & blockers
Audit targets
- · exposure matching
- · holding-time matching
- · side balance
- · session-window matching
- · number of null repetitions
Test data
Same approved partitions as the candidate under test.
Blockers
None recorded.
Statistics
Baseline · stress · OOS · funded simulationbaseline
No recorded statistics.
stress
No recorded statistics.
oos
No recorded statistics.
funded simulation
No recorded statistics.
Reuse decisions
What is worth keeping, and what was rejectedReusable pieces
None recorded.
Rejected pieces
None recorded.
Gate outcomes
No scientific gate has produced an outcome for this item.
Read from research-output/registry/bot-testers.json · docs/EXTERNAL_FUTURES_BOT_VALIDATION_PLAN.md