A Bayesian oriented exploration and reinforcement learning in continuous-time mean-variance portfolio optimization
A continuous-time reinforcement learning framework using Thompson Sampling balances wealth and information gain, with exploration endogenously tied to posterior uncertainty.
Featured in No. 139 on 13 Nov 2026 · 3 days after release
- Released
- 10 Nov 2026
- First featured
- No. 139 · 13 Nov 2026
- Published in
- Not yet, as far as Semantic Scholar knows
- Fanfare
- 2 of 5
- Identifier
- arXiv:2611.10759
- Authors
- Kexin Chen et al.
Abstract
From arXiv (CC0).
We propose a new reinforcement learning (RL) framework for the continuous-time mean-variance portfolio optimization with unknown market parameters. To better reflect the impact of improved information of the unknown drift on the degree of exploration, we consider a novel randomization based on continuous-time stochastic filtering. Specifically, we construct a continuous-time analog to Thompson Sampling by treating the unknown drift as a random draw from a generalized sampling distribution parameterized by the filter's posterior mean and variance. The new learning objective measures the tradeoff between the wealth performance and the weighted KL divergence between the policy and the true Bayesian posterior, which transforms the classical feedback control into an information guided stochastic policy. As a result, the degree of exploration endogenously depends on the Reward-Biased Maximum Likelihood Estimation that decays with the shrinking filter's variance. This allows us to devise an efficient model-based learning algorithm in the mean-variance portfolio optimization with theoretical guarantee and superior learning performance.
Citations and venue from Semantic Scholar (ODC-BY), refreshed weekly. Summary: Quant Letter (CC BY 4.0).