BuySideFlow: A Point-in-Time Benchmark for LLM Agents in Investment Research

Large language models (LLMs) can generate SQL and SQL--Python workflows for investment research, but ensuring point-in-time (PIT) validity remains challenging. Agents must enforce disclosure cutoffs and select the appropriate historical states and record versions throughout data retrieval and financial analysis. We introduce \textsc{BuySideFlow}, a benchmark of 408 practitioner-derived Chinese-language tasks spanning equities, funds, fixed income, and macroeconomics over a fixed snapshot from a licensed production financial database. We provide executable references and a taxonomy of temporal errors, pairing result checks with expert audits of executed workflows. We evaluate nine agent configurations on all tasks, with result accuracy ranging from 16.2\% to 36.8\%. An audit of 900 runs on 100 shared tasks confirms PIT violations in 193 of the 380 runs that pass result checks (50.8\%), showing that output agreement alone does not establish temporal validity.

1. 25 Sep 2026

   Propose, Don't Judge: An Anytime-Valid Referee for LLM Agents That Mine Investment Factors

   Proposes a statistical referee that judges investment factors proposed by language-model agents using out-of-sample market outcomes, ensuring false-discovery control at any stopping time.

   arXiv

   1cites
2. 25 Sep 2026

   AlphaDiverse: Post-Training Local Quantitative Research Agents for Diverse Exploration in Alpha Factor Mining

   Proposes a multi-agent system with post-training that automates alpha factor mining locally, using diverse research paths and joint optimization to broaden exploration while maintaining prediction quality.

   arXiv

   1cites
3. 14 May 2025

   Can Generative AI agents behave like humans? Evidence from laboratory market experiments

   Large Language Models (LLMs) have potential in mimicking human behavior in economic markets, but need more research for improved diversity and accuracy.

   arXiv

   21cites
4. 23 Oct 2026

   Fake News, Real Crashes: Information Injection Attacks on LLM Financial Trading Agents

   Fabricated news reaches 62% attack success against LLM trading agents, far exceeding prompt injection, with surface-form credibility cues mattering more than content accuracy.

   arXiv

   0cites
5. 23 Oct 2026

   Quant-Arena: Benchmarking LLM Agents for Quantitative Trading Research

   A public benchmark tests whether large language models can complete end-to-end quantitative research with real trading constraints; no frontier model beats the equal-weight market in 2024.

   arXiv

   0cites
6. 23 Oct 2026

   VQuant: An Agentic Large Language Model Architecture for Automated Quantitative Financial Analysis and Document Generation: Reasoning-Augmented Tool Orchestration, In-Loop Numerical Computation, and Multi-Format Reporting

   A platform couples a language model with deterministic execution to turn natural-language requests into auditable reports where every figure is from live data or reproducible code, not model hallucination.

   SSRN

   3fanfare