---
title: LLM Trading Agents Earn Beta, Not Alpha: A Look-Ahead-Free Benchmark
url: https://www.ml-quant.com/papers/arxiv/2611.19530/
site: ML-Quant (https://www.ml-quant.com)
updated: 2026-11-20
license: Summaries CC BY 4.0; links go to the original sources
index: https://www.ml-quant.com/llms.txt
identifier: arXiv:2611.19530
source_url: https://arxiv.org/abs/2611.19530
featured: 2026-11-20
citations: unknown
topic: ML & AI Methods
---


# LLM Trading Agents Earn Beta, Not Alpha: A Look-Ahead-Free Benchmark

A look-ahead-free benchmark of six language-model traders across three markets finds no significant alpha; market exposure explains 78% of returns and agent decisions match random sector picks.

- Source: https://arxiv.org/abs/2611.19530
- Identifier: arXiv:2611.19530
- Released: 2026-11-17
- First featured: Quant Letter No. 140 (2026-11-20): https://www.ml-quant.com/issues/2026-11-20/
- Citations (Semantic Scholar): not tracked
- Published in: not yet
- Topic: ML & AI Methods
- Authors: Jackson Wang

## Abstract (arXiv, CC0)

Large language model (LLM) trading agents now trade stocks for their users, and benchmarks rank models by their agents' returns. Yet a single run's return says little about skill. In our study, two runs of the same model that differed only in the random seed ended 5.2 points apart on average, so telling skill from luck takes many backtests across markets, models and seeds. However, live arenas trade each day only once, and backtests either use the few months after a model's training cutoff or run on years the model may remember, often with news joined to prices by calendar date. In this paper, we present rta-bench-1, a backtest over three US markets (a rally, a bear market and a crash). It shows each headline only after its publication minute, plays each period blind and named, and checks every run for look-ahead. It also splits each return into factor exposure and alpha and scores every decision against random choices of the same day and sector. In 91 runs of six models from four vendors, no alpha was significant, market and style exposure accounted for a median 78% of the return, and the decisions did no better than random stocks of the same sector. The agents bought the stocks with the most positive news, yet in ablations they earned as much without their headlines. Still, the agents carried out rules reliably, since a single cash rule in the prompt cut a GPT-based agent's share in stocks by 30.3 points in all six pairs. Builders should therefore supply the edge themselves and report exposures and alpha, and benchmarks should replay news by publication time.

## Related

- [Propose, Don't Judge: An Anytime-Valid Referee for LLM Agents That Mine Investment Factors](https://www.ml-quant.com/papers/arxiv/2609.27051/): Proposes a statistical referee that judges investment factors proposed by language-model agents using out-of-sample market outcomes, ensuring false-discovery control at any stopping time.
- [Does Autonomous Quant Research Improve? Leakage, Evidence Scarcity and Forward Tests in an LLM Factor-Discovery Loop](https://www.ml-quant.com/papers/ssrn/7555699/): An autonomous agent evolved 940 factors over 17 days and finds that reusing backtest data inflates edge by a quarter to a third and in-sample improvement predicts worse performance.
- [Can AI Make Money in Crypto? Measuring the Gap from Backtests to Real Markets](https://www.ml-quant.com/papers/arxiv/2609.34510/): A benchmark compares machine learning, reinforcement learning, and large language model trading methods across historical backtests, paper trading, and live markets to measure the gap.
- [AlphaDiverse: Post-Training Local Quantitative Research Agents for Diverse Exploration in Alpha Factor Mining](https://www.ml-quant.com/papers/arxiv/2609.29014/): Proposes a multi-agent system with post-training that automates alpha factor mining locally, using diverse research paths and joint optimization to broaden exploration while maintaining prediction quality.
- [Can Generative AI agents behave like humans? Evidence from laboratory market experiments](https://www.ml-quant.com/papers/arxiv/2505.07457/): Large Language Models (LLMs) have potential in mimicking human behavior in economic markets, but need more research for improved diversity and accuracy.
- [Agentic Finance: Building, Training and Governing Autonomous Agents in Financial Markets](https://www.ml-quant.com/papers/ssrn/7697398/): A practical guide to building and training large language model and reinforcement-learning agents for trading, covering guardrails, learning methods, and multi-agent market dynamics including herding and flash crashes.
