---
title: A Bayesian oriented exploration and reinforcement learning in continuous-time mean-variance portfolio optimization
url: https://www.ml-quant.com/papers/arxiv/2611.10759/
site: ML-Quant (https://www.ml-quant.com)
updated: 2026-11-14
license: Summaries CC BY 4.0; links go to the original sources
index: https://www.ml-quant.com/llms.txt
identifier: arXiv:2611.10759
source_url: https://arxiv.org/abs/2611.10759
featured: 2026-11-13
citations: unknown
topic: Portfolio & Allocation
---


# A Bayesian oriented exploration and reinforcement learning in continuous-time mean-variance portfolio optimization

A continuous-time reinforcement learning framework using Thompson Sampling balances wealth and information gain, with exploration endogenously tied to posterior uncertainty.

- Source: https://arxiv.org/abs/2611.10759
- Identifier: arXiv:2611.10759
- Released: 2026-11-10
- First featured: Quant Letter No. 139 (2026-11-13): https://www.ml-quant.com/issues/2026-11-13/
- Citations (Semantic Scholar): not tracked
- Published in: not yet
- Topic: Portfolio & Allocation
- Authors: Kexin Chen, Xiang Yu, Shanshan Zhao

## Abstract (arXiv, CC0)

We propose a new reinforcement learning (RL) framework for the continuous-time mean-variance portfolio optimization with unknown market parameters. To better reflect the impact of improved information of the unknown drift on the degree of exploration, we consider a novel randomization based on continuous-time stochastic filtering. Specifically, we construct a continuous-time analog to Thompson Sampling by treating the unknown drift as a random draw from a generalized sampling distribution parameterized by the filter's posterior mean and variance. The new learning objective measures the tradeoff between the wealth performance and the weighted KL divergence between the policy and the true Bayesian posterior, which transforms the classical feedback control into an information guided stochastic policy. As a result, the degree of exploration endogenously depends on the Reward-Biased Maximum Likelihood Estimation that decays with the shrinking filter's variance. This allows us to devise an efficient model-based learning algorithm in the mean-variance portfolio optimization with theoretical guarantee and superior learning performance.

## Related

- [Bayesian Portfolio Optimization by Predictive Synthesis](https://www.ml-quant.com/papers/arxiv/2510.07180/): The article discusses a portfolio optimization technique using Bayesian predictive synthesis, which merges various asset return prediction models to handle financial market uncertainty.
- [Diffusion-Augmented Reinforcement Learning for Robust Portfolio Optimization under Stress Scenarios](https://www.ml-quant.com/papers/arxiv/2510.07099/): The research introduces a framework called DARL that combines DDPMs with DRL for portfolio management, improving its ability to withstand crises.
- [Adaptive and Regime-Aware RL for Portfolio Optimization](https://www.ml-quant.com/papers/arxiv/2509.14385/): The study presents a new reinforcement learning framework for portfolio optimization, which performs well under financial stress and supports dynamic asset allocation.
- [Causal Portfolio Optimization: Principles and Sensitivity-Based Solutions](https://www.ml-quant.com/papers/arxiv/2504.05743/): The article introduces a new risk management framework that uses Bayesian and neural networks for efficient portfolio optimization, based on Common Causal Manifolds.
- [Bayesian Optimization for CVaR-based portfolio optimization](https://www.ml-quant.com/papers/arxiv/2503.17737/): The paper presents new Bayesian Optimization algorithms for portfolio allocation, reducing risk and meeting performance goals, proven through practical examples.
- [Discrete-Time Mean-Variance Strategy Based on Reinforcement Learning](https://www.ml-quant.com/papers/arxiv/2312.15385/): The article discusses a new reinforcement learning-based model for analyzing real-world data, which is more applicable than the continuous-time model.