Bot Tester

Bot Tester

External futures bots and the reusable components extracted from them. Each record separates what its upstream claims from what TradeRep has actually reproduced, and no README figure is ever shown as a result. External code enters here first — it does not jump into production TradeRep.

External-bot validation is owned by the external-bot research lane, not by the reboot/organization lane that maintains this index. Stage values, claims and blockers here are seeded from that lane's own committed artifacts (see sources) and must stay consistent with them. Nothing in this file promotes a bot, authorises funded execution, or counts as reproduced evidence.

DashboardNew AdditionsMonitorStrategies

Full bots
4
Components
4
With reproduced evidence
0
Blocked
5
Funded/live execution
NOT AUTHORISED
Seeded from documents owned by the external-bot lane. Not present in this checkout: docs/EXTERNAL_BOT_AUDIT_2026-09-17.md, docs/EXTERNAL_FUTURES_BOT_VALIDATION_PLAN.md, research/external-systems/OPEN_SOURCE_FUTURES_EXPANSION.md — the records below quote them, and the documents themselves arrive when that lane’s work merges.

Full bots

Entire external systems under evaluation
NQ Quantfull botstress testingno reproduced evidence yetmeatham07-design/nq-quant

Mechanical intraday NQ/MNQ strategy + validation methodology

setupdebuggingbacktest runningbaseline completestress testingoos testingfunded gategate complete
Claims — not evidence
  • unverified · Author-reported performance for the published strategy. (upstream author / repository)
  • unverified · Production code uses 5m setup/zone detection with 1m execution to address intrabar ambiguity. (upstream code reading (static audit))
  • unverified · Code includes explicit commissions/slippage and daily/consecutive-loss stops. (upstream code reading (static audit))
Reproduced by TradeRep
  • Nothing reproduced yet. No performance figure may be attributed to this item.
LaT-PFNfull botdebuggingno reproduced evidence yet1 blocker(s)meatham07-design/latpfn-trading

Isolated zero-shot time-series forecasting candidate (pretrained PyTorch model)

setupdebuggingbacktest runningbaseline completestress testingoos testingfunded gategate complete
Claims — not evidence
  • unverified · Emits forecast, uncertainty, direction/confidence and regime from a pretrained LaT-PFN model. (upstream code reading (static audit))
  • unverified · The wrapper's lagged context mode corrects an older misaligned legacy mode. (upstream code/comments)
  • unverified · Author live-record evidence. (upstream author)
Reproduced by TradeRep
  • Nothing reproduced yet. No performance figure may be attributed to this item.
  • latpfn-baseline-blocker: An open implementation blocker prevents a reproducible baseline run; owned by the external-bot lane.
MNQ AI Traderfull botdebugging data blockedno reproduced evidence yet2 blocker(s)meatham07-design/mnq-ai-trader

Execution/risk architecture + LLM decision layer (paper-trading system)

setupdebuggingbacktest runningbaseline completestress testingoos testingfunded gategate completedebugging data blocked
Claims — not evidence
  • unverified · Broker/local position reconciliation, hard safety gates, commission handling, DOM/order-flow features and paper-trading infrastructure. (upstream code reading (static audit))
  • unverified · Upstream explicitly describes it as paper trading, not live-money validated. (upstream documentation)
Reproduced by TradeRep
  • Nothing reproduced yet. No performance figure may be attributed to this item.
  • mnq-ai-trader-no-recorded-sessions: No native recorded sessions exist, so deterministic historical replay feasibility is unresolved (DATA_BLOCKED).
  • mnq-ai-trader-llm-cost-control: Historical audit must run with cached/offline LLM mode first to prevent uncontrolled API cost and nondeterministic re-evaluation.
NQ Strategy Bfull botdebuggingno reproduced evidence yet1 blocker(s)prashanthaitha24/nq-strategy-b-bot

External strategy lane — 5m IFVG retest inside an active 15m bullish FVG

setupdebuggingbacktest runningbaseline completestress testingoos testingfunded gategate complete
Claims — not evidence
  • unverified · A 5m IFVG retest inside an active 15m bullish FVG in a morning window, with declared stop/target, is tradable. (upstream repository / economic hypothesis)
Reproduced by TradeRep
  • Nothing reproduced yet. No performance figure may be attributed to this item.
  • nq-strategy-b-incomplete-repo: The historical repository is incomplete, so repository reproduction (study A) is limited; the causal clean-room implementation (study B) is the path that can advance through gates.

Components

Reusable pieces extracted from external systems — the part that is usable even when a bot's alpha is not
Deterministic replay invariantscomponentsetupno reproduced evidence yetinternal clean-room implementation

Execution integrity / replay determinism

setupdebuggingbacktest runningbaseline completestress testingoos testingfunded gategate complete
Claims — not evidence
  • unverified · Canonical event ordering, duplicate-event rejection and monotonic replay assertions make a replay deterministic and non-anticipating. (internal design note)
Reproduced by TradeRep
  • Nothing reproduced yet. No performance figure may be attributed to this item.
Independent replication manifest + comparisoncomponentsetupno reproduced evidence yet1 blocker(s)internal clean-room implementation

Second-engine replication for finalists

setupdebuggingbacktest runningbaseline completestress testingoos testingfunded gategate complete
Claims — not evidence
  • unverified · Recording code/data/config hashes plus trade-level reconciliation turns engine disagreement into an investigation trigger rather than a silent reconciliation. (internal design note)
Reproduced by TradeRep
  • Nothing reproduced yet. No performance figure may be attributed to this item.
  • no-finalist-to-replicate: Replication applies to finalists; across A0-A5 and the Strategy Factory campaigns there is currently no surviving finalist.
Market-intelligence causality guards (order flow, volume profile, regime)componentsetupno reproduced evidence yet1 blocker(s)internal clean-room implementation

Order-flow / volume-profile / regime features with causality enforcement

setupdebuggingbacktest runningbaseline completestress testingoos testingfunded gategate complete
Claims — not evidence
  • unverified · CVD/aggressor imbalance, execution pressure, volume-profile levels and a microstructure regime gate are usable research features. (upstream concept source)
Reproduced by TradeRep
  • Nothing reproduced yet. No performance figure may be attributed to this item.
  • microstructure-data-blocked: TradeRep's canonical data is 1-minute OHLC; aggressor/DOM features require tick or trade data that does not exist in the current dataset. Tests depending on them are marked DATA_BLOCKED rather than approximated.
Random-entry / null-model benchmarkcomponentsetupno reproduced evidence yetinternal methodology addition

Null benchmarking / signal-information test

setupdebuggingbacktest runningbaseline completestress testingoos testingfunded gategate complete
Claims — not evidence
  • unverified · Comparing a candidate against randomized entries under matched exposure, holding time, side balance, session window and risk sizing shows whether signal selection adds information beyond drift/exposure. (internal methodology plan)
Reproduced by TradeRep
  • Nothing reproduced yet. No performance figure may be attributed to this item.

Evaluation ladder

Every candidate runs this, in order
  1. 01 Static code/methodology audit
  2. 02 Reproduce author tests/backtests where data permit
  3. 03 Leakage/lookahead audit
  4. 04 Cost/slippage stress
  5. 05 Random/null benchmark
  6. 06 Walk-forward/OOS evaluation
  7. 07 Cross-market evaluation where supported
  8. 08 Paper/shadow audit with orders disabled
  9. 09 Compare shadow predictions/fills with TradeRep
  10. 10 Funded/live execution remains a separate explicit decision and is NOT enabled

Read from research-output/registry/bot-testers.json · docs/status/TRADE_REP_MASTER_TRACKER.json