Dynamic Programming for Value-at-Risk Markov Decision Processes in Continuous Spaces

Value-at-Risk (VaR) is a widely adopted quantile-based risk measure in practice, yet incorporating VaR objectives into Markov decision processes (VaR MDPs) remains a longstanding challenge. Recent work has derived dynamic programming equations for VaR MDPs in finite state and action spaces but left the case of more general spaces unresolved. This paper establishes, for the first time, the validity of these equations in continuous spaces, for both finite- and infinite-horizon settings. Such cases naturally arise in many real-world dynamic decision-making problems. As an application, we study an optimal execution problem with a VaR objective and demonstrate that our framework enables the characterization of optimal dynamic strategies, resolving an open question in the field.

1. 9 Oct 2026

   Conditional value-at-risk under reward-penalty mechanism with applications to robust portfolio management

   Derives a closed-form expression for worst-case conditional value-at-risk under reward-penalty mechanisms and distribution uncertainty, enabling optimal portfolio allocations that balance losses with downside risk.

   arXiv

   1cites
2. 18 Dec 2024

   Cost-aware Portfolios in a Large Universe of Assets

   Research suggests portfolio models that include transaction costs, highlighting the importance of considering these costs when rebalancing a portfolio.

   arXiv

   3cites
3. 14 Feb 2024

   Portfolio Optimization under Transaction Costs with Recursive Preferences

   The Merton investment-consumption problem is expanded to incorporate transaction costs and stochastic differential utility, using new math techniques to understand all parameter combinations and previously difficult aspects.

   arXiv

   4cites
4. 21 Sep 2023

   Quantifying Credit Portfolio sensitivity to asset correlations with interpretable generative neural networks

   A unique method using Variational Autoencoders has been suggested to measure credit portfolio Value-at-Risk sensitivity to asset correlations, providing a clearer latent space representation.

   arXivIn AIABI@AI*IA

   6cites
5. 24 May 2023

   Value-at-Risk-Based Portfolio Insurance: Performance Evaluation and Benchmarking Against CPPI in a Markov-Modulated Regime-Switching Market

   Study compares VaR-based and constant proportion portfolio insurance strategies in regime-switching framework.

   arXiv

   7cites
6. 23 Oct 2026

   Optimal Trading Filters and the Value of Predictive Signals

   Wiener-Hopf factorization yields optimal trading filters for return forecasts under transient price impact, showing fractional filters and the value of mean-reversion timing for signals.

   arXiv

   2fanfare