---
title: Thinking Fast, Trading Late: System One Decision Models vs the Market
url: https://www.ml-quant.com/papers/arxiv/2611.03985/
site: ML-Quant (https://www.ml-quant.com)
updated: 2026-11-06
license: Summaries CC BY 4.0; links go to the original sources
index: https://www.ml-quant.com/llms.txt
identifier: arXiv:2611.03985
source_url: https://arxiv.org/abs/2611.03985
featured: 2026-11-06
citations: unknown
topic: LLMs & Text
---


# Thinking Fast, Trading Late: System One Decision Models vs the Market

A pre-registered blinded test finds that language-model readings of company news lose their predictive power in real time and that commercial models identify masked companies in two-thirds of cases.

- Source: https://arxiv.org/abs/2611.03985
- Identifier: arXiv:2611.03985
- Released: 2026-11-04
- First featured: Quant Letter No. 138 (2026-11-06): https://www.ml-quant.com/issues/2026-11-06/
- Citations (Semantic Scholar): not tracked
- Published in: not yet
- Topic: LLMs & Text
- Authors: Amir Dehkordi, Alireza Kargarzadeh, Nariman Khaledian, Navid Parvini, Sid Ghatak, Arman Khaledian

## Abstract (arXiv, CC0)

Large language models (LLMs) read company news at scale, and backtests suggest that their readings predict stock returns. We ask how much of that predictability survives a test that rules out look-ahead, memorization and selection. We propose OLIVIA, a protocol for such tests: point-in-time inputs with company identities masked, selection on validation data only, an analysis plan frozen by cryptographic hash, and a test period unblinded once through a logged lock. We apply it to AI decision models, non-generative language models that return probabilities for typed questions, reading news about S&P 500 stocks: an open-weights model we fine-tuned on 2024-2025 data, three commercial models and standard baselines. The fine-tuned model's signal replicated on two validation quarters (daily information coefficients 0.055 and 0.065) but fell to 0.020 (t = 1.7) on the blinded January-July 2026 test. The commercial models' readings line up with the overnight move to the open (information coefficient 0.074 to 0.077) but not with the move after it, so the news is priced by the time a trader can act on it at the open. No model can tell over- from under-reaction, and no pre-registered strategy survives costs and a deflated Sharpe ratio. Commercial models identify masked companies in 62% to 74% of cases against a 28% baseline: masking hides names, not companies. The market reads the news first.

## Related

- [Can LLM-based Financial Investing Strategies Outperform the Market in Long Run?](https://www.ml-quant.com/papers/arxiv/2505.07078/): FINSABER, a backtesting framework, shows that Large Language Models' effectiveness in stock trading decreases over longer periods and larger symbol universes, emphasizing the need for trend detection and risk controls.
- [The Memorization Problem: Can We Trust LLMs'Economic Forecasts?](https://www.ml-quant.com/papers/arxiv/2504.14765/): The study shows that large language models can remember exact economic figures from before their knowledge cutoff dates, which may skew their predictive abilities in forecasting and backtesting trading strategies.
- [LLMs Don't Know What They Know: Benchmarking Temporal Self-Knowledge for Financial Backtesting](https://www.ml-quant.com/papers/arxiv/2611.06808/): A benchmark of 2,226 dated facts reveals that frontier language models underreport their knowledge and answer most facts they claim not to know, compromising backtest validity.
- [MintEval: Do LLMs Implement the Trading Strategy You Asked For? A Behavioural-Equivalence Benchmark for Natural-Language-to-Strategy Code](https://www.ml-quant.com/papers/arxiv/2610.03080/): Introduces a benchmark that compares LLM-generated trading code to reference strategies bar by bar on identical data, revealing silent failures in implementation despite passing functional tests.
- [Look-Ahead Bias in Stock Return Predictions](https://www.ml-quant.com/papers/ssrn/4586726/): Large language models like ChatGPT can generate profitable trading signals from news sentiment, but backtesting can yield biased results due to overlapping periods.
- [Scaling LLM Test-Time Compute Optimally can be More Effective than Scaling Model Parameters](https://www.ml-quant.com/papers/arxiv/2408.03314/): The research investigates enhancing Large Language Models' (LLMs) performance using more test-time computation, suggesting a compute-optimal scaling strategy based on prompt difficulty.