---
title: Agentic AI in Automated Markets
url: https://www.ml-quant.com/papers/arxiv/2610.22522/
site: ML-Quant (https://www.ml-quant.com)
updated: 2026-10-23
license: Summaries CC BY 4.0; links go to the original sources
index: https://www.ml-quant.com/llms.txt
identifier: arXiv:2610.22522
source_url: https://arxiv.org/abs/2610.22522
featured: 2026-10-23
citations: unknown
topic: ML & AI Methods
---


# Agentic AI in Automated Markets

Deep reinforcement learning simulates three agent archetypes in automated markets, finding herd-followers generate frequent short stress episodes while manipulators create persistent volatility.

- Source: https://arxiv.org/abs/2610.22522
- Identifier: arXiv:2610.22522
- Released: 2026-10-19
- First featured: Quant Letter No. 136 (2026-10-23): https://www.ml-quant.com/issues/2026-10-23/
- Citations (Semantic Scholar): not tracked
- Published in: not yet
- Topic: ML & AI Methods
- Authors: Irene Aldridge, Lourenco Belleau-Bhowmik, James Chan, Josh Chang, Kelly Deng, Pranav Dhingra, Xinda Ding, Haodong Fang, Satya Hanumanchi, Carter He, Shuang He, Yadong Hou

## Abstract (arXiv, CC0)

Automated markets increasingly host autonomous, learning trading agents and are powered by formulaic automated market makers (AMMs). We study how heterogeneous agent behavior shapes stress, risk-adjusted performance, liquidity, and volatility in these types of markets. Three behavioral archetypes are modeled as agentic reinforcement learning (RL) systems: a rational arbitrageur, a manipulator, and a retail herd-follower. Each archetype is defined by its reward function within a common, asset-agnostic exposure-control environment, and each is trained with a value-based Deep Q-Network (DQN) and with REINFORCE using a learned baseline. A pilot on hourly cryptocurrency data (AAVE, ETC, SUI) motivates the hypotheses. Herd-followers produce the most frequent but shortest stress episodes, manipulators the fewest but most persistent, and rational agents the most stable rolling Sharpe ratios despite higher return volatility. SHAP attributions tie these patterns to drawdown and cross-asset signals, short-term volatility and position state, and momentum, respectively. The results motivate behavior-specific regulation rather than uniform limits on volatility or turnover.

## Related

- [AlphaPilot: Multi-Turn Tool-Using LLM Agents for Adaptive Alpha Mining with Reinforcement Learning](https://www.ml-quant.com/papers/arxiv/2610.15488/): A reinforcement-learning framework trains multi-turn tool-using LLM agents to discover factor expressions by conditioning on market descriptions and querying real-data feedback.
- [Can AI Make Money in Crypto? Measuring the Gap from Backtests to Real Markets](https://www.ml-quant.com/papers/arxiv/2609.34510/): A benchmark compares machine learning, reinforcement learning, and large language model trading methods across historical backtests, paper trading, and live markets to measure the gap.
- [Reinforcement Learning in Market-Making](https://www.ml-quant.com/papers/ssrn/4991392/): The paper presents a deep reinforcement learning framework for optimal market-making trading, using the Soft Actor-Critic algorithm to manage complex, high-dimensional problems with continuous state and action spaces.
- [Mastering Diverse Domains through World Models](https://www.ml-quant.com/papers/arxiv/2301.04104/): Algorithm Mastery: DreamerV3, a universal algorithm, excels in over 150 varied tasks, including diamond collection in Minecraft without human input, expanding the scope of reinforcement learning.
- [SimPO: Simple Preference Optimization with a Reference-Free Reward](https://www.ml-quant.com/papers/arxiv/2405.14734/): Simple Preference Optimization: SimPO improves reinforcement learning from human feedback by using the average log probability of a sequence as the implicit reward, enhancing training stability and computational efficiency.
- [Critique-out-Loud Reward Models](https://www.ml-quant.com/papers/arxiv/2408.11791/): The article presents CLoud reward models that use human feedback to improve reinforcement learning, enhancing accuracy and win rate in ArenaHard.