arXivTrading, Microstructure & Execution
Where Backtests and Live Trading Part Ways: Six Defects from One Intraday System
Six defects from data, code, and configuration caused live intraday trading to diverge from backtest replay, none visible in summary statistics, each requiring specific controls.
Featured in No. 135 on 16 Oct 2026 · on release day
- Released
- 16 Oct 2026
- First featured
- No. 135 · 16 Oct 2026
- Published in
- Not yet, as far as Semantic Scholar knows
- Fanfare
- 2 of 5
- Identifier
- arXiv:2610.21846
- Authors
- Alex Vidovich and Zivana Zerjal
Abstract
From arXiv (CC0).
Backtests of intraday strategies can drift away from what the live system actually does; in our case, the drift never showed in summary statistics. We report six defects found while running one intraday US equity system live and comparing its live days with their backtest replay. Three came from data: a default feed that carried a small fraction of real opening volume, historical prices adjusted for dividends that live orders never see, and data the live system downloaded but the backtest never did. Two came from code: a sizing step that exceeded a limit the live account enforces, and UTC timestamps read as New York time. One came from configuration: settings that were switched on but never reached the code that places orders. For each we give the symptom, the size of the error, the cause and the test or control that now guards against it. All six sat where two paths that should agree had drifted apart. We close with a ten-point checklist. We make no claim about whether the system is profitable.
Citations and venue from Semantic Scholar (ODC-BY), refreshed weekly. Summary: Quant Letter (CC BY 4.0).