ML-QuantSubscribe

arXivML & AI Methods

Investor's Last Exam: Can AI Agents Do Equity Investment Without Seeing the Future?

Investor's Last Exam benchmarks AI agents on frozen financial databases, finding leading models score 68.1 overall yet only 52.5 on forecast accuracy.

Featured in No. 137 on 30 Oct 2026 · on release day

Scatter plot showing forecast errors for Tesla across three AI models relative to zero-credit limits.
Figure 9: Forecast errors despite correct supporting analysis. Absolute Tesla forecast errors divided by each metric’s zero-credit error limit. Every marker lies beyond one. All three systems earn full supporting-analysis credit but zero forecast-outcome credit.
Released
30 Oct 2026
First featured
No. 137 · 30 Oct 2026
Published in
Not yet, as far as Semantic Scholar knows
Fanfare
4 of 5
Identifier
arXiv:2610.38342
Authors
Huangfei Jiang et al.

Abstract

From arXiv (CC0).

Financial agents must form forecasts and investment judgments from decision-time evidence, with predictions evaluated against subsequent outcomes. Existing benchmarks assess financial knowledge, research workflows, or forecasting, but evaluating the full research process requires a strictly frozen information set and professional evaluation criteria. We introduce Investor's Last Exam (ILE), an equity-research benchmark led by experienced buy-side investors and fund managers. Its three components are a versioned financial database spanning 3.43 million document versions and nine source categories, supplemented by structured market data, with validated timestamps governing retrieval and computation; a task taxonomy organized around professional analyst deliverables; and an expert-led framework linking scoring criteria to sources, calculations, and assumptions through financial dependency graphs. Evaluation spans 86 assignments and jointly assesses research quality, forecast accuracy, and simulated investment performance. GPT-6 Astra and Claude Opus 5.5 lead overall at 68.1 and 66.9 out of 100, yet even Astra scores only 52.5 on Forecast & Model. Our results show that even state-of-the-art models fail to translate overall research capability into predictive performance. ILE shifts the evaluation unit from isolated capabilities to the evidence--assumption--judgment chain, allowing researchers to locate where analytical advantages fail to translate into forecasts and investment judgments, and providing a traceable, diagnostic foundation for training and evaluating financial agents.

Citations and venue from Semantic Scholar (ODC-BY), refreshed weekly. Summary: Quant Letter (CC BY 4.0).

    Type to search. Try rough volatility, LLM agents or FinGPT.

    ↑↓ move↵ openesc closeFull search page