---
title: From SEC Filings to Financial Signals: Evaluating LLMs on Stock Market Reactions and Analyst Forecasts
url: https://www.ml-quant.com/papers/arxiv/2610.24268/
site: ML-Quant (https://www.ml-quant.com)
updated: 2026-10-23
license: Summaries CC BY 4.0; links go to the original sources
index: https://www.ml-quant.com/llms.txt
identifier: arXiv:2610.24268
source_url: https://arxiv.org/abs/2610.24268
featured: 2026-10-23
citations: unknown
topic: LLMs & Text
---


# From SEC Filings to Financial Signals: Evaluating LLMs on Stock Market Reactions and Analyst Forecasts

Analysis of 13 language models on 45,964 Form 10-Q filings shows finance-specialized models produce modest advantages in return ranking but lag analyst consensus in earnings forecasts.

- Source: https://arxiv.org/abs/2610.24268
- Identifier: arXiv:2610.24268
- Released: 2026-10-20
- First featured: Quant Letter No. 136 (2026-10-23): https://www.ml-quant.com/issues/2026-10-23/
- Citations (Semantic Scholar): not tracked
- Published in: not yet
- Topic: LLMs & Text
- Authors: Shengkun Wang, Taoran Ji, Linhan Wang, Sattar Mansi, Chang-Tien Lu, Yinlin Chen

## Abstract (arXiv, CC0)

Form 10-Q MD&A sections combine long-form management narrative with accounting and forward-looking information. Benchmarks for financial filings commonly evaluate question answering or numerical reasoning, leaving unclear whether outputs from large language models (LLMs) align with market and analyst outcomes. We evaluate prompted, zero-shot outputs from 13 general-purpose and finance-specialized LLMs on 45,964 Form 10-Q filing events from 2001 to 2024, linking MD&A text to cross-sectional fundamental ranks, pre-filing analyst forecasts, and realized abnormal returns. The evaluation covers return ranking under five controlled information views and next-quarter EPS forecasting under direct and consensus-anchored interfaces. Relative to disclosure alone, adding cross-sectional fundamental ranks raises mean effective-date rank correlation (RankIC) by 0.0089 for effective-event-date returns and 0.0098 for following-day returns, whereas analyst-summary context provides no comparable average gain. Across the four disclosure-containing views, finance-specialized models show an effective-event-date group advantage but no statistically reliable following-day advantage, while general-purpose Qwen models produce the strongest individual return-ranking results. Under the full-information view, direct LLM forecasts average the 43.4th percentile of the analyst distribution and do not consistently beat individual analysts. Consensus anchoring raises the mean inside-range share from 41.1% to 59.5% but increases reported-EPS error.

## Related

- [Transforming the Voice of the Customer: Large Language Models for Identifying Customer Needs](https://www.ml-quant.com/papers/arxiv/2503.01870/): Large Language Models are streamlining the process of identifying customer needs, letting analysts concentrate on more valuable work while still delivering precise insights.
- [The (Short-Term) Effects of Large Language Models on Unemployment and Earnings](https://www.ml-quant.com/papers/arxiv/2509.15510/): Large Language Models like ChatGPT have boosted earnings for workers in certain occupations without affecting unemployment rates, indicating they enhance income rather than replace jobs.
- [The News in Earnings Announcement Disclosures: Capturing Word Context Using LLM Methods](https://www.ml-quant.com/papers/ssrn/5198675/): The paper reveals that textual disclosures in companies' earnings announcements, analyzed through a large language model, account for a significant portion of stock return variations and immediate price revisions.
- [RAG-IT: Retrieval-Augmented Instruction Tuning for Automated Financial Analysis - A Case Study for the Semiconductor Sector](https://www.ml-quant.com/papers/arxiv/2412.08179/): The study introduces a new method for automating earnings reports analysis using Large Language Models, with promising initial findings.
- [ECC Analyzer: Extracting Trading Signal from Earnings Conference Calls using Large Language Model for Stock Volatility Prediction](https://www.ml-quant.com/papers/arxiv/2404.18470/): Stock Volatility Prediction: ECCAnalyzer, a new tool, uses advanced language models to extract data from earnings conference calls, enhancing stock volatility predictions and surpassing traditional analysis methods.
- [Getting Inspiration for Feature Elicitation: App Store- vs. LLM-based Approach](https://www.ml-quant.com/papers/arxiv/2408.17404/): A study comparing AppStore and large language model approaches for refining app features finds both are effective, but LLMs excel in novel unseen app scopes, emphasizing the role of human analysts.