---
title: Deep catastrophic-risk-aware reinforcement learning
url: https://www.ml-quant.com/papers/arxiv/2610.27214/
site: ML-Quant (https://www.ml-quant.com)
updated: 2026-10-23
license: Summaries CC BY 4.0; links go to the original sources
index: https://www.ml-quant.com/llms.txt
identifier: arXiv:2610.27214
source_url: https://arxiv.org/abs/2610.27214
featured: 2026-10-23
citations: unknown
topic: Portfolio & Allocation
---


# Deep catastrophic-risk-aware reinforcement learning

The study applies extreme value theory to train neural hedging policies on tail risk, achieving lower losses under extreme scenarios when relevant observations are scarce.

- Source: https://arxiv.org/abs/2610.27214
- Identifier: arXiv:2610.27214
- Released: 2026-10-21
- First featured: Quant Letter No. 136 (2026-10-23): https://www.ml-quant.com/issues/2026-10-23/
- Citations (Semantic Scholar): not tracked
- Published in: not yet
- Topic: Portfolio & Allocation
- Authors: Carlos Pérez Octavio Mendoza, Frédéric Godin

## Abstract (arXiv, CC0)

Estimating extreme risk in reinforcement learning becomes increasingly difficult as the confidence level increases, since only a small number of observations contribute to empirical estimates of Conditional Value-at-Risk (CVaR). In this paper, we extend an Extreme Value Theory (EVT) approach for CVaR optimization to high-dimensional neural-network policies. Using a peaks-over-threshold representation and method-of-moments estimation, we obtain a differentiable tail-risk objective and show that, conditional on the selected threshold, its finite-sample gradient can be computed directly through automatic differentiation. We first validate the approach in a controlled experiment with a known optimal solution and then investigate its performance in a deep-hedging problem with rare extreme market movements. Our results show similar hedging behavior for EVT- and empirical-CVaR-trained policies under normal conditions, while EVT-trained policies exhibit lower hedging losses under the extreme-scenario evaluation across the training sample sizes considered. These results suggest that EVT can provide a practical alternative for training neural policies when the observations relevant to extreme risk are scarce.

## Related

- [Data-Driven Dynamic Portfolio Selection with Vine Copula Simulation and Reinforcement Learning](https://www.ml-quant.com/papers/arxiv/2610.20037/): A data-driven approach combines vine-copula simulation with reinforcement learning to optimize dynamic portfolio selection across equities and gold with CVaR penalties.
- [Conditional value-at-risk under reward-penalty mechanism with applications to robust portfolio management](https://www.ml-quant.com/papers/arxiv/2610.09246/): Derives a closed-form expression for worst-case conditional value-at-risk under reward-penalty mechanisms and distribution uncertainty, enabling optimal portfolio allocations that balance losses with downside risk.
- [The Critical Line Algorithm and the Constrained LASSO: One Curve, Two Literatures](https://www.ml-quant.com/papers/arxiv/2609.25704/): Shows that mean-variance portfolio selection and the constrained LASSO trace identical piecewise-linear solution paths, mapping their parametrizations exactly.
- [Diffusion-Augmented Reinforcement Learning for Robust Portfolio Optimization under Stress Scenarios](https://www.ml-quant.com/papers/arxiv/2510.07099/): The research introduces a framework called DARL that combines DDPMs with DRL for portfolio management, improving its ability to withstand crises.
- [Myopic Optimality: why reinforcement learning portfolio management strategies lose money](https://www.ml-quant.com/papers/arxiv/2509.12764/): Myopic Optimization (MO) outperforms Reinforcement Learning (RL) in portfolio management, resulting in lower costs, increased profits, and reduced model risk.
- [Adaptive and Regime-Aware RL for Portfolio Optimization](https://www.ml-quant.com/papers/arxiv/2509.14385/): The study presents a new reinforcement learning framework for portfolio optimization, which performs well under financial stress and supports dynamic asset allocation.