---
title: Can Language Models Learn to Forecast Stock Prices
url: https://www.ml-quant.com/papers/arxiv/2609.36914/
site: ML-Quant (https://www.ml-quant.com)
updated: 2026-10-02
license: Summaries CC BY 4.0; links go to the original sources
index: https://www.ml-quant.com/llms.txt
identifier: arXiv:2609.36914
source_url: https://arxiv.org/abs/2609.36914
featured: 2026-10-02
citations: unknown
topic: ML & AI Methods
---


# Can Language Models Learn to Forecast Stock Prices

Post-training Qwen3-4B via supervised fine-tuning and policy optimization more than doubles direction-magnitude score on chronological stock-price predictions to 43.31.

- Source: https://arxiv.org/abs/2609.36914
- Identifier: arXiv:2609.36914
- Released: 2026-09-30
- First featured: Quant Letter No. 133 (2026-10-02): https://www.ml-quant.com/issues/2026-10-02/
- Citations (Semantic Scholar): not tracked
- Published in: not yet
- Topic: ML & AI Methods
- Authors: Jiacheng Guo, Suozhi Huang, Shuzhen Li, Yunlong Gao, Zerui Cheng, Jason Ge, Shushu Liang, Zihao Li, Hao Lu, Ming Yin, Shilong Liu, Jiashuo Liu

## Abstract (arXiv, CC0)

Post-training has been shown to significantly improve language models' performance on tasks with verifiable outcomes, including mathematical reasoning, software engineering, and computer use. However, whether the same approach can improve forecasting in financial markets is much less clear. Compared with tasks with verifiable outcomes, not only are realized returns noisy, but even what constitutes a relevant information set for making effective predictions is not obvious a priori: the model must decide which observations to gather and then commit to a numerical judgment before the outcome is known. We study this question in a chronological stock-price sandbox, where a language model gathers price, volume, relative-performance, and market-context evidence and predicts a future return. We post-train Qwen3-4B with supervised fine-tuning (SFT) on tool-use demonstrations, then proximal policy optimization (PPO) with a terminal reward given by the forecast score against the realized return. The resulting AURA-4B more than doubles the starting direction--magnitude score, from 20.94 to 43.31, and is comparable to frontier language models on this benchmark. Conditional magnitude agreement rises from 33.3 to 66.2, while directional accuracy changes from 62.9 to 65.4. SFT expands tool use, and PPO further increases the share of ranking and market-context queries. These results show that post-training can substantially improve financial forecasting performance, together with changes in how the model investigates the market, on this outcome-selected benchmark.

## Related

- [Adjoint Matching: Fine-tuning Flow and Diffusion Generative Models with Memoryless Stochastic Optimal Control](https://www.ml-quant.com/papers/arxiv/2409.08861/): The study presents Adjoint Matching, a new algorithm that enhances dynamical generative models by refining reward fine-tuning, leading to improved consistency, realism, and adaptability to unseen human preference reward models.
- [Scaling Proprioceptive-Visual Learning with Heterogeneous Pre-trained Transformers](https://www.ml-quant.com/papers/arxiv/2409.20537/): The paper presents Heterogeneous Pre-trained Transformers (HPT), a method for training robotic models across various tasks, improving the performance of fine-tuned policies by over 20% on unseen tasks in both simulated and real-world environments.
- [Continual Diffusion: Continual Customization of Text-to-Image Diffusion with C-LoRA](https://www.ml-quant.com/papers/arxiv/2304.06027/): CLoRA, a new method, prevents catastrophic forgetting in text-to-image models when introducing new concepts, achieving top performance in continual learning settings for image classification.
- [Fine-tuning can cripple your foundation model; preserving features may be the solution](https://www.ml-quant.com/papers/arxiv/2308.13320/): Concept forgetting in AI models can be significantly reduced by a new fine-tuning method called LDIFS, which helps retain pre-trained knowledge while working on different tasks.
- [Critique Fine-Tuning: Learning to Critique is More Effective than Learning to Imitate](https://www.ml-quant.com/papers/arxiv/2501.17703/): The article introduces Critique Fine-Tuning (CFT), a new method for training language models that critiques incorrect responses, showing better results than the traditional Supervised Fine-Tuning (SFT) method in math benchmarks.
- [Efficient Online Reinforcement Learning Fine-Tuning Need Not Retain Offline Data](https://www.ml-quant.com/papers/arxiv/2412.07762/): The article introduces Warm-start RL (WSRL), a new reinforcement learning approach that doesn't require offline data, leading to quicker learning and better performance than previous algorithms.