AlphaPilot: Multi-Turn Tool-Using LLM Agents for Adaptive Alpha Mining with Reinforcement Learning

Formulaic alpha mining seeks interpretable expressions that rank assets by future returns. The task is challenging because it demands simultaneous processing of unstructured market descriptions, historical data, and quantitative evaluation of candidate factors, yet most existing methods exploit only a subset of these signals. We introduce AlphaPilot, a reinforcement-learning framework that trains multi-turn tool-using LLM agents for adaptive alpha mining. The agent conditions on market descriptions, proposes factor expressions, queries real-data evaluator feedback, and updates a retained factor pool across turns. This design jointly leverages market text, LLM financial knowledge, real data, and evaluation feedback. At inference time, AlphaPilot performs day-by-day search and pool updates to adapt to shifting market regimes. Across three independent runs in out-of-sample rolling backtests on CSI300 and CSI500, AlphaPilot achieves mean total returns of 42.93% and 54.19%, with mean Sharpe ratios of 2.46 and 2.86, respectively. It attains the highest mean total return, Sharpe, and RankIC among the evaluated methods on both universes.

1. 2 Oct 2026

   Can AI Make Money in Crypto? Measuring the Gap from Backtests to Real Markets

   A benchmark compares machine learning, reinforcement learning, and large language model trading methods across historical backtests, paper trading, and live markets to measure the gap.

   arXiv

   0cites
2. 14 May 2025

   Can Generative AI agents behave like humans? Evidence from laboratory market experiments

   Large Language Models (LLMs) have potential in mimicking human behavior in economic markets, but need more research for improved diversity and accuracy.

   arXiv

   20cites
3. 18 Dec 2024

   VickreyFeedback: Cost-efficient Data Construction for Reinforcement Learning from Human Feedback

   An auction mechanism is introduced to enhance cost-efficiency in fine-tuning large language models using Reinforcement Learning from Human Feedback, focusing on quality feedback and model performance.

   arXivIn Prima

   3cites
4. 9 Oct 2024

   MA-RLHF: Reinforcement Learning from Human Feedback with Macro Actions

   The MA-RLHF framework integrates macro actions into the learning process of large language models, enhancing learning efficiency and performance in tasks like text summarization and dialogue generation.

   Machine learningIn International Conference on Learning Representations

   15cites
5. 16 Oct 2026

   RICE-Alpha: Reliability-Informed Correction with Event Graphs for LLM-Agent Stock Forecasting

   RICE-Alpha uses event graphs and historical reliability to improve LLM-based stock forecasting, achieving stronger results on Nasdaq-100 and Hang Seng panels than competing LLM agents.

   arXiv

   3fanfare
6. 9 Oct 2026

   LiveMACE: Process-Aware Evaluation of LLM Agent Capabilities in Evolving Markets

   A benchmark evaluates frontier LLMs as live trading agents and finds that realized returns often diverge from capability-specific measurements, revealing outcome-capability gaps through decision traces.

   arXiv

   0cites