Agentic AI in Automated Markets

Automated markets increasingly host autonomous, learning trading agents and are powered by formulaic automated market makers (AMMs). We study how heterogeneous agent behavior shapes stress, risk-adjusted performance, liquidity, and volatility in these types of markets. Three behavioral archetypes are modeled as agentic reinforcement learning (RL) systems: a rational arbitrageur, a manipulator, and a retail herd-follower. Each archetype is defined by its reward function within a common, asset-agnostic exposure-control environment, and each is trained with a value-based Deep Q-Network (DQN) and with REINFORCE using a learned baseline. A pilot on hourly cryptocurrency data (AAVE, ETC, SUI) motivates the hypotheses. Herd-followers produce the most frequent but shortest stress episodes, manipulators the fewest but most persistent, and rational agents the most stable rolling Sharpe ratios despite higher return volatility. SHAP attributions tie these patterns to drawdown and cross-asset signals, short-term volatility and position state, and momentum, respectively. The results motivate behavior-specific regulation rather than uniform limits on volatility or turnover.

1. 16 Oct 2026

   AlphaPilot: Multi-Turn Tool-Using LLM Agents for Adaptive Alpha Mining with Reinforcement Learning

   A reinforcement-learning framework trains multi-turn tool-using LLM agents to discover factor expressions by conditioning on market descriptions and querying real-data feedback.

   arXiv

   0cites
2. 2 Oct 2026

   Can AI Make Money in Crypto? Measuring the Gap from Backtests to Real Markets

   A benchmark compares machine learning, reinforcement learning, and large language model trading methods across historical backtests, paper trading, and live markets to measure the gap.

   arXiv

   0cites
3. 23 Oct 2024

   Reinforcement Learning in Market-Making

   The paper presents a deep reinforcement learning framework for optimal market-making trading, using the Soft Actor-Critic algorithm to manage complex, high-dimensional problems with continuous state and action spaces.

   SSRN

   3shares
4. 24 Apr 2024

   Mastering Diverse Domains through World Models

   Algorithm Mastery: DreamerV3, a universal algorithm, excels in over 150 varied tasks, including diamond collection in Minecraft without human input, expanding the scope of reinforcement learning.

   Machine learning

   1,538cites
5. 10 Jul 2024

   SimPO: Simple Preference Optimization with a Reference-Free Reward

   Simple Preference Optimization: SimPO improves reinforcement learning from human feedback by using the average log probability of a sequence as the implicit reward, enhancing training stability and computational efficiency.

   Machine learningIn Neural Information Processing Systems

   1,235cites
6. 28 Aug 2024

   Critique-out-Loud Reward Models

   The article presents CLoud reward models that use human feedback to improve reinforcement learning, enhancing accuracy and win rate in ArenaHard.

   Machine learning

   102cites