---
title: Dynamic Programming for Value-at-Risk Markov Decision Processes in Continuous Spaces
url: https://www.ml-quant.com/papers/arxiv/2610.24439/
site: ML-Quant (https://www.ml-quant.com)
updated: 2026-10-23
license: Summaries CC BY 4.0; links go to the original sources
index: https://www.ml-quant.com/llms.txt
identifier: arXiv:2610.24439
source_url: https://arxiv.org/abs/2610.24439
featured: 2026-10-23
citations: unknown
topic: Portfolio & Allocation
---


# Dynamic Programming for Value-at-Risk Markov Decision Processes in Continuous Spaces

The paper establishes validity of dynamic programming equations for Value-at-Risk objectives in continuous state and action spaces, enabling optimal execution problems with VaR goals.

- Source: https://arxiv.org/abs/2610.24439
- Identifier: arXiv:2610.24439
- Released: 2026-10-20
- First featured: Quant Letter No. 136 (2026-10-23): https://www.ml-quant.com/issues/2026-10-23/
- Citations (Semantic Scholar): not tracked
- Published in: not yet
- Topic: Portfolio & Allocation
- Authors: Xian Chen, Erick Delage, Weikai Wang

## Abstract (arXiv, CC0)

Value-at-Risk (VaR) is a widely adopted quantile-based risk measure in practice, yet incorporating VaR objectives into Markov decision processes (VaR MDPs) remains a longstanding challenge. Recent work has derived dynamic programming equations for VaR MDPs in finite state and action spaces but left the case of more general spaces unresolved. This paper establishes, for the first time, the validity of these equations in continuous spaces, for both finite- and infinite-horizon settings. Such cases naturally arise in many real-world dynamic decision-making problems. As an application, we study an optimal execution problem with a VaR objective and demonstrate that our framework enables the characterization of optimal dynamic strategies, resolving an open question in the field.

## Related

- [Conditional value-at-risk under reward-penalty mechanism with applications to robust portfolio management](https://www.ml-quant.com/papers/arxiv/2610.09246/): Derives a closed-form expression for worst-case conditional value-at-risk under reward-penalty mechanisms and distribution uncertainty, enabling optimal portfolio allocations that balance losses with downside risk.
- [Cost-aware Portfolios in a Large Universe of Assets](https://www.ml-quant.com/papers/arxiv/2412.11575/): Research suggests portfolio models that include transaction costs, highlighting the importance of considering these costs when rebalancing a portfolio.
- [Portfolio Optimization under Transaction Costs with Recursive Preferences](https://www.ml-quant.com/papers/arxiv/2402.08387/): The Merton investment-consumption problem is expanded to incorporate transaction costs and stochastic differential utility, using new math techniques to understand all parameter combinations and previously difficult aspects.
- [Quantifying Credit Portfolio sensitivity to asset correlations with interpretable generative neural networks](https://www.ml-quant.com/papers/arxiv/2309.08652/): A unique method using Variational Autoencoders has been suggested to measure credit portfolio Value-at-Risk sensitivity to asset correlations, providing a clearer latent space representation.
- [Value-at-Risk-Based Portfolio Insurance: Performance Evaluation and Benchmarking Against CPPI in a Markov-Modulated Regime-Switching Market](https://www.ml-quant.com/papers/arxiv/2305.12539/): Study compares VaR-based and constant proportion portfolio insurance strategies in regime-switching framework.
- [Optimal Trading Filters and the Value of Predictive Signals](https://www.ml-quant.com/papers/arxiv/2610.24558/): Wiener-Hopf factorization yields optimal trading filters for return forecasts under transient price impact, showing fractional filters and the value of mean-reversion timing for signals.