Continuous-Time Mean-Variance Portfolio Selection Reinforcement Learning Problems for a Markov Regime-Switching System with No-Shorting Constraints

This paper is the first to study the continuous-time mean-variance portfolio selection problem with no-shorting constraints in a Markov regime-switching market using reinforcement learning (RL). The main challenge stems from the interaction between random regime shifts and portfolio non-negativity constraints, which typically causes the coupled Hamilton-Jacobi-Bellman (HJB) equations to lose smoothness across different state regions. Additionally, directly imposing no-shorting constraints on randomized policies disrupts their analytically tractable Gaussian structure, complicating both exploratory modeling and reinforcement learning. To address these challenges, we propose an auxiliary exploratory approach that limits the policy to a Gaussian distribution and applies the no-shorting constraint solely to its mean. We explicitly characterize the optimal policy for this auxiliary problem and demonstrate that, by appropriately selecting the exploration variance, its optimal mean policy exactly matches the optimal policy of the original constrained mean-variance problem. Building upon this analytical framework, we develop a model-free reinforcement learning algorithm that learns the optimal portfolio policy directly from trajectory data. Numerical experiments support the theoretical results and show that the proposed method can effectively recover the optimal no-shorting portfolio in a regime-switching market.

1. 16 Oct 2026

   Malliavin-Informed Policy Gradients for Continuous-Time Portfolio Optimization Neural Variance Reduction under Black-Scholes, Heston, and Rough Bergomi Dynamics

   The paper develops a Malliavin-informed policy-gradient estimator using stochastic control variates to reduce variance in continuous-time reinforcement learning for dynamic portfolio selection.

   SSRN

   2fanfare
2. 9 Oct 2025

   Diffusion-Augmented Reinforcement Learning for Robust Portfolio Optimization under Stress Scenarios

   The research introduces a framework called DARL that combines DDPMs with DRL for portfolio management, improving its ability to withstand crises.

   arXivFeatured 2×

   3cites
3. 22 Sep 2025

   Adaptive and Regime-Aware RL for Portfolio Optimization

   The study presents a new reinforcement learning framework for portfolio optimization, which performs well under financial stress and supports dynamic asset allocation.

   arXiv

   2cites
4. 7 Aug 2025

   Two Stochastic Control Methods for Mean-Variance Portfolio Selection of Jump Diffusions and Their Relationship

   The paper examines the maximum principle and dynamic programming principle in mean-variance portfolio selection of jump diffusions, studying their interrelation.

   arXivIn 2026 38th Chinese Control and Decision Conference (CCDC)Featured 2×

   1cites
5. 3 Jan 2024

   Discrete-Time Mean-Variance Strategy Based on Reinforcement Learning

   The article discusses a new reinforcement learning-based model for analyzing real-world data, which is more applicable than the continuous-time model.

   arXiv

   4cites
6. 19 Jul 2023

   Evaluation of Deep Reinforcement Learning Algorithms for Portfolio Optimisation

   The study finds that PPO and A2C deep reinforcement learning algorithms are more effective for portfolio optimization due to their noise handling and policy derivation capabilities, despite their high sample complexity.

   SSRN

   5cites