Can Language Models Learn to Forecast Stock Prices

Post-training has been shown to significantly improve language models' performance on tasks with verifiable outcomes, including mathematical reasoning, software engineering, and computer use. However, whether the same approach can improve forecasting in financial markets is much less clear. Compared with tasks with verifiable outcomes, not only are realized returns noisy, but even what constitutes a relevant information set for making effective predictions is not obvious a priori: the model must decide which observations to gather and then commit to a numerical judgment before the outcome is known. We study this question in a chronological stock-price sandbox, where a language model gathers price, volume, relative-performance, and market-context evidence and predicts a future return. We post-train Qwen3-4B with supervised fine-tuning (SFT) on tool-use demonstrations, then proximal policy optimization (PPO) with a terminal reward given by the forecast score against the realized return. The resulting AURA-4B more than doubles the starting direction--magnitude score, from 20.94 to 43.31, and is comparable to frontier language models on this benchmark. Conditional magnitude agreement rises from 33.3 to 66.2, while directional accuracy changes from 62.9 to 65.4. SFT expands tool use, and PPO further increases the share of ranking and market-context queries. These results show that post-training can substantially improve financial forecasting performance, together with changes in how the model investigates the market, on this outcome-selected benchmark.

1. 15 Jan 2025

   Adjoint Matching: Fine-tuning Flow and Diffusion Generative Models with Memoryless Stochastic Optimal Control

   The study presents Adjoint Matching, a new algorithm that enhances dynamical generative models by refining reward fine-tuning, leading to improved consistency, realism, and adaptability to unseen human preference reward models.

   Machine learning

   242cites
2. 3 Oct 2024

   Scaling Proprioceptive-Visual Learning with Heterogeneous Pre-trained Transformers

   The paper presents Heterogeneous Pre-trained Transformers (HPT), a method for training robotic models across various tasks, improving the performance of fine-tuned policies by over 20% on unseen tasks in both simulated and real-world environments.

   Machine learningIn Neural Information Processing Systems

   206cites
3. 8 May 2024

   Continual Diffusion: Continual Customization of Text-to-Image Diffusion with C-LoRA

   CLoRA, a new method, prevents catastrophic forgetting in text-to-image models when introducing new concepts, achieving top performance in continual learning settings for image classification.

   Machine learningIn Trans. Mach. Learn. Res.

   176cites
4. 3 Jul 2024

   Fine-tuning can cripple your foundation model; preserving features may be the solution

   Concept forgetting in AI models can be significantly reduced by a new fine-tuning method called LDIFS, which helps retain pre-trained knowledge while working on different tasks.

   Machine learningIn Trans. Mach. Learn. Res.

   103cites
5. 5 Feb 2025

   Critique Fine-Tuning: Learning to Critique is More Effective than Learning to Imitate

   The article introduces Critique Fine-Tuning (CFT), a new method for training language models that critiques incorrect responses, showing better results than the traditional Supervised Fine-Tuning (SFT) method in math benchmarks.

   Machine learning

   63cites
6. 12 Dec 2024

   Efficient Online Reinforcement Learning Fine-Tuning Need Not Retain Offline Data

   The article introduces Warm-start RL (WSRL), a new reinforcement learning approach that doesn't require offline data, leading to quicker learning and better performance than previous algorithms.

   Machine learningIn International Conference on Learning RepresentationsFeatured 2×

   73cites