The Price of Thought: Does Test-Time Reasoning Pay in LLM Trading?

While inference-time reasoning in large language models (LLMs) promises better decision making, its higher computational cost may not yield better economic outcomes. Yet reasoning controls are rarely evaluated as economic interventions, where changes in model outputs must translate into better portfolios after trading costs. We conduct a controlled study of representative LLMs from the DeepSeek, GPT, and Gemini families. We vary reasoning effort while holding information available at each formation date, prompts, output formats, and portfolio construction fixed. Our evaluation covers a full year of U.S. equities under three input conditions: numerical, identifiable news, and masked news. It includes more than 800,000 asset predictions and repeated model generations. Across all three model families, additional reasoning does not produce a reliable improvement in net portfolio returns. For DeepSeek, where we examine the full progression from no reasoning to maximum reasoning, performance is nonmonotonic. Repeated generations also produce unstable treatment effects and portfolio selections, even when overall scores remain similar. These findings show that additional reasoning can change financial decisions without reliably improving their economic value, motivating validation for each task before deployment.

1. 15 May 2024

   AgentClinic: a multimodal agent benchmark to evaluate AI in simulated clinical environments

   AI Evaluation in Clinical Environments: The paper introduces AgentClinic, a benchmark for assessing large language models in simulated clinical environments, highlighting the significant impact of biases on diagnostic accuracy and patient interactions.

   Machine learning

   263cites
2. 1 May 2024

   Learning Performance-Improving Code Edits

   The research presents a framework for optimizing programs using large language models, achieving a mean speedup of 6.86, outperforming average individual programmers.

   Machine learningIn International Conference on Learning Representations

   167cites
3. 13 Dec 2023

   Generative agent-based modeling with actions grounded in physical, social, or digital space using Concordia

   Concordia is a library designed to help build and operate Generative Agent-Based Models (GABMs), using Large Language Models (LLMs) to simulate physical or digital environments.

   Machine learning

   166cites
4. 28 Aug 2024

   Jamba-1.5: Hybrid Transformer-Mamba Models at Scale

   Transformer-Mamba Models: Jamba-1.5 is a new large language model with enhanced conversational and instruction-following capabilities, featuring a unique quantization technique for cost-effective inference.

   Machine learning

   56cites
5. 31 Jul 2024

   MindSearch: Mimicking Human Minds Elicits Deep AI Searcher

   Mimicking Human Minds for Search: MindSearch is a Large Language Model-based framework that simulates human cognitive processes for web information seeking, greatly enhancing response quality.

   Machine learningIn International Conference on Learning Representations

   82cites
6. 19 Dec 2025

   Adaptive Partitioning and Learning for Stochastic Control of Diffusion Processes

   An adaptive reinforcement learning algorithm enhances learning in controlled diffusion processes by partitioning state-action spaces, providing theoretical guarantees and effective results in applications like portfolio selection.

   arXiv

   1cites