Deep catastrophic-risk-aware reinforcement learning

Estimating extreme risk in reinforcement learning becomes increasingly difficult as the confidence level increases, since only a small number of observations contribute to empirical estimates of Conditional Value-at-Risk (CVaR). In this paper, we extend an Extreme Value Theory (EVT) approach for CVaR optimization to high-dimensional neural-network policies. Using a peaks-over-threshold representation and method-of-moments estimation, we obtain a differentiable tail-risk objective and show that, conditional on the selected threshold, its finite-sample gradient can be computed directly through automatic differentiation. We first validate the approach in a controlled experiment with a known optimal solution and then investigate its performance in a deep-hedging problem with rare extreme market movements. Our results show similar hedging behavior for EVT- and empirical-CVaR-trained policies under normal conditions, while EVT-trained policies exhibit lower hedging losses under the extreme-scenario evaluation across the training sample sizes considered. These results suggest that EVT can provide a practical alternative for training neural policies when the observations relevant to extreme risk are scarce.

1. 16 Oct 2026

   Data-Driven Dynamic Portfolio Selection with Vine Copula Simulation and Reinforcement Learning

   A data-driven approach combines vine-copula simulation with reinforcement learning to optimize dynamic portfolio selection across equities and gold with CVaR penalties.

   arXiv

   0cites
2. 9 Oct 2026

   Conditional value-at-risk under reward-penalty mechanism with applications to robust portfolio management

   Derives a closed-form expression for worst-case conditional value-at-risk under reward-penalty mechanisms and distribution uncertainty, enabling optimal portfolio allocations that balance losses with downside risk.

   arXiv

   1cites
3. 25 Sep 2026

   The Critical Line Algorithm and the Constrained LASSO: One Curve, Two Literatures

   Shows that mean-variance portfolio selection and the constrained LASSO trace identical piecewise-linear solution paths, mapping their parametrizations exactly.

   arXiv

   2cites
4. 9 Oct 2025

   Diffusion-Augmented Reinforcement Learning for Robust Portfolio Optimization under Stress Scenarios

   The research introduces a framework called DARL that combines DDPMs with DRL for portfolio management, improving its ability to withstand crises.

   arXivFeatured 2×

   3cites
5. 22 Sep 2025

   Myopic Optimality: why reinforcement learning portfolio management strategies lose money

   Myopic Optimization (MO) outperforms Reinforcement Learning (RL) in portfolio management, resulting in lower costs, increased profits, and reduced model risk.

   arXiv

   1cites
6. 22 Sep 2025

   Adaptive and Regime-Aware RL for Portfolio Optimization

   The study presents a new reinforcement learning framework for portfolio optimization, which performs well under financial stress and supports dynamic asset allocation.

   arXiv

   2cites