---
title: MLP-Initialized Reinforcement Learning for Exit Timing in SPX Short-Straddle Portfolios
url: https://www.ml-quant.com/papers/arxiv/2610.13126/
site: ML-Quant (https://www.ml-quant.com)
updated: 2026-10-16
license: Summaries CC BY 4.0; links go to the original sources
index: https://www.ml-quant.com/llms.txt
identifier: arXiv:2610.13126
source_url: https://arxiv.org/abs/2610.13126
featured: 2026-10-16
citations: unknown
topic: Derivatives & Volatility
---


# MLP-Initialized Reinforcement Learning for Exit Timing in SPX Short-Straddle Portfolios

An MLP-initialized reinforcement-learning framework optimizes exit timing for short-straddle options, achieving 37.54% cumulative return and a Sharpe ratio of 1.705 out-of-sample over 2024-2026.

- Source: https://arxiv.org/abs/2610.13126
- Identifier: arXiv:2610.13126
- Released: 2026-10-12
- First featured: Quant Letter No. 135 (2026-10-16): https://www.ml-quant.com/issues/2026-10-16/
- Citations (Semantic Scholar): not tracked
- Published in: not yet
- Topic: Derivatives & Volatility
- Authors: Jianning Wang, Robert Ślepaczuk, Paweł Sakowski

## Abstract (arXiv, CC0)

This paper studies exit timing for SPX short-straddle portfolios using a two-stage supervised and reinforcement-learning framework. Historical episodes first generate ex-post optimal hold/exit labels for training a multilayer perceptron (MLP) using only contemporaneously available state variables at deployment. The trained MLP then initializes reinforcement-learning actors that are fine-tuned with a risk-aware trading reward. Out-of-sample evaluation over 2024-2026 shows that the supervised MLP substantially outperforms passive holding and representative fixed-time and profit-and-loss-based exit rules. Across seven independent seeds, MLP-initialized Actor-Critic averages 37.54% cumulative return and a Sharpe ratio of 1.705, compared with 35.01% and 1.651 for the supervised MLP. Actor-Critic trained from scratch averages only 0.18% return. These findings show that oracle-guided supervised learning provides a stable foundation for reward-based policy fine-tuning in a sparse and path-dependent option-exit problem.

## Related

- [ARL-Based Multi-Action Market Making with Hawkes Processes and Variable Volatility](https://www.ml-quant.com/papers/doi/10-1145-3677052-3698695/): The study combines Adversarial Reinforcement Learning, Hawkes Processes, and variable volatility to enhance market-making strategies, showing improved adaptability in high-volatility conditions and better market simulations.
- [Foundation Time-Series AI Model for Realized Volatility Forecasting](https://www.ml-quant.com/papers/arxiv/2505.11163/): The study finds that the TimesFM model, with incremental fine-tuning, is effective for volatility forecasting in financial risk management, outperforming traditional models.
- [Deep Reinforcement Learning Algorithms for Option Hedging](https://www.ml-quant.com/papers/arxiv/2504.05521/): A comparison of eight Deep Reinforcement Learning algorithms for dynamic hedging found that Monte Carlo Policy Gradient and Proximal Policy Optimization performed best, with the former outperforming the Black-Scholes delta hedge baseline.
- [To Hedge or Not to Hedge: Optimal Strategies for Stochastic Trade Flow Management](https://www.ml-quant.com/papers/arxiv/2503.02496/): The paper proposes using reinforcement learning methods to manage stochastic trade flows, offering an alternative to traditional grid-based numerical PDE techniques.
- [A Risk Sensitive Contract-unified Reinforcement Learning Approach for Option Hedging](https://www.ml-quant.com/papers/arxiv/2411.09659/): The paper proposes a risk-sensitive reinforcement learning approach for dynamic hedging of options, reducing tail risk using historical market data.
- [Solving The Dynamic Volatility Fitting Problem: A Deep Reinforcement Learning Approach](https://www.ml-quant.com/papers/arxiv/2410.11789/): The article discusses the use of Deep Reinforcement Learning in solving volatility issues in equity derivatives, showing its effectiveness and adaptability in handling complex functions and online learning.