---
title: Continuous-Time Mean-Variance Portfolio Selection Reinforcement Learning Problems for a Markov Regime-Switching System with No-Shorting Constraints
url: https://www.ml-quant.com/papers/arxiv/2610.32301/
site: ML-Quant (https://www.ml-quant.com)
updated: 2026-10-30
license: Summaries CC BY 4.0; links go to the original sources
index: https://www.ml-quant.com/llms.txt
identifier: arXiv:2610.32301
source_url: https://arxiv.org/abs/2610.32301
featured: 2026-10-30
citations: unknown
topic: Portfolio & Allocation
---


# Continuous-Time Mean-Variance Portfolio Selection Reinforcement Learning Problems for a Markov Regime-Switching System with No-Shorting Constraints

The study develops a model-free reinforcement learning algorithm that learns optimal no-shorting portfolio policies from trajectory data in regime-switching markets by decoupling constraints from policy exploration.

- Source: https://arxiv.org/abs/2610.32301
- Identifier: arXiv:2610.32301
- Released: 2026-10-26
- First featured: Quant Letter No. 137 (2026-10-30): https://www.ml-quant.com/issues/2026-10-30/
- Citations (Semantic Scholar): not tracked
- Published in: not yet
- Topic: Portfolio & Allocation
- Authors: Minghui Zhang, Xun Li, Xin Zhang

## Abstract (arXiv, CC0)

This paper is the first to study the continuous-time mean-variance portfolio selection problem with no-shorting constraints in a Markov regime-switching market using reinforcement learning (RL). The main challenge stems from the interaction between random regime shifts and portfolio non-negativity constraints, which typically causes the coupled Hamilton-Jacobi-Bellman (HJB) equations to lose smoothness across different state regions. Additionally, directly imposing no-shorting constraints on randomized policies disrupts their analytically tractable Gaussian structure, complicating both exploratory modeling and reinforcement learning. To address these challenges, we propose an auxiliary exploratory approach that limits the policy to a Gaussian distribution and applies the no-shorting constraint solely to its mean. We explicitly characterize the optimal policy for this auxiliary problem and demonstrate that, by appropriately selecting the exploration variance, its optimal mean policy exactly matches the optimal policy of the original constrained mean-variance problem. Building upon this analytical framework, we develop a model-free reinforcement learning algorithm that learns the optimal portfolio policy directly from trajectory data. Numerical experiments support the theoretical results and show that the proposed method can effectively recover the optimal no-shorting portfolio in a regime-switching market.

## Related

- [Malliavin-Informed Policy Gradients for Continuous-Time Portfolio Optimization Neural Variance Reduction under Black-Scholes, Heston, and Rough Bergomi Dynamics](https://www.ml-quant.com/papers/ssrn/7598820/): The paper develops a Malliavin-informed policy-gradient estimator using stochastic control variates to reduce variance in continuous-time reinforcement learning for dynamic portfolio selection.
- [Diffusion-Augmented Reinforcement Learning for Robust Portfolio Optimization under Stress Scenarios](https://www.ml-quant.com/papers/arxiv/2510.07099/): The research introduces a framework called DARL that combines DDPMs with DRL for portfolio management, improving its ability to withstand crises.
- [Adaptive and Regime-Aware RL for Portfolio Optimization](https://www.ml-quant.com/papers/arxiv/2509.14385/): The study presents a new reinforcement learning framework for portfolio optimization, which performs well under financial stress and supports dynamic asset allocation.
- [Two Stochastic Control Methods for Mean-Variance Portfolio Selection of Jump Diffusions and Their Relationship](https://www.ml-quant.com/papers/arxiv/2508.01138/): The paper examines the maximum principle and dynamic programming principle in mean-variance portfolio selection of jump diffusions, studying their interrelation.
- [Discrete-Time Mean-Variance Strategy Based on Reinforcement Learning](https://www.ml-quant.com/papers/arxiv/2312.15385/): The article discusses a new reinforcement learning-based model for analyzing real-world data, which is more applicable than the continuous-time model.
- [Evaluation of Deep Reinforcement Learning Algorithms for Portfolio Optimisation](https://www.ml-quant.com/papers/arxiv/2307.07694/): The study finds that PPO and A2C deep reinforcement learning algorithms are more effective for portfolio optimization due to their noise handling and policy derivation capabilities, despite their high sample complexity.