---
title: Learning to Detect Symbolic Failure: Machine Learning and the Limits of Black-Scholes
url: https://www.ml-quant.com/papers/arxiv/2609.27764/
site: ML-Quant (https://www.ml-quant.com)
updated: 2026-09-26
license: Summaries CC BY 4.0; links go to the original sources
index: https://www.ml-quant.com/llms.txt
identifier: arXiv:2609.27764
source_url: https://arxiv.org/abs/2609.27764
featured: 2026-09-25
citations: 0
topic: Derivatives & Volatility
---


# Learning to Detect Symbolic Failure: Machine Learning and the Limits of Black-Scholes

Tree-based machine learning outperforms neural networks at detecting systematic option-pricing deviations from Black-Scholes using 2.6 million real contracts, with domain-expert features crucial.

- Source: https://arxiv.org/abs/2609.27764
- Identifier: arXiv:2609.27764
- Released: 2026-09-24
- First featured: Quant Letter No. 132 (2026-09-25): https://www.ml-quant.com/issues/2026-09-25/
- Citations (Semantic Scholar): 0
- Published in: not yet
- Topic: Derivatives & Volatility
- Authors: Juli Huang, Jake Cheng, Rupert Lu

## Abstract (arXiv, CC0)

We treat options pricing as a representation problem: can machine learning detect systematic deviations from Black-Scholes using 2.6M real option contracts? We compare three regimes: learned abstract embeddings (Kernel PCA), preserved domain structure (tree-based ensembles), and neural network validation. Tree-based methods outperform kernel dimensionality reduction by 21.5 percentage points (93.8% vs 72.3%), and domain-expert features (Greeks, moneyness) outperform engineered features. NN-based and BS-based deviation labels agree 99.9974% of the time, suggesting deviations reflect market structure rather than model artifact. We conclude that in domains with expert-designed symbolic features, preserving structure beats learning abstractions. We make no claim of exploitable mispricings.

## Related

- [Neural Jumps for Option Pricing](https://www.ml-quant.com/papers/arxiv/2506.05137/): A neural jump stochastic differential equation model is proposed for option pricing, combining neural networks with the traditional jump diffusion model, enhancing pricing accuracy.
- [Applying Informer for Option Pricing: A Transformer-Based Approach](https://www.ml-quant.com/papers/doi/10-5220-0013320900003890/): The research uses the Informer neural network for option pricing in financial markets, showing its improved performance over traditional models and improving financial forecasting.
- [A time-stepping deep gradient flow method for option pricing in (rough) diffusion models](https://www.ml-quant.com/papers/arxiv/2403.00746/): The study introduces a new deep learning method for pricing European options in diffusion models, transforming the option pricing equation into an energy minimization problem and using deep artificial neural networks.
- [No-Arbitrage Deep Calibration for Volatility Smile and Skewness](https://www.ml-quant.com/papers/arxiv/2310.16703/): The introduction of a Derivative-Constrained Neural Network (DCNN) enhances the calibration of implied volatility surface in option prices, aiding in understanding market dynamics and risk management.
- [A deep implicit-explicit minimizing movement method for option pricing in jump-diffusion models](https://www.ml-quant.com/papers/arxiv/2401.06740/): The paper introduces a deep learning method for pricing European basket options using Artificial Neural Networks and two methods for discretizing the integral operator, focusing on assets with jump-diffusion dynamics.
- [Physics Informed Neural Network for Option Pricing](https://www.ml-quant.com/papers/arxiv/2312.06711/): The PINN method, a deep-learning technique, is used to accurately price American and European options using the Black-Scholes equation.