---
title: $L_0$ Feature Selection via Monte Carlo Tree Search in High-Dimensional Financial Regression
url: https://www.ml-quant.com/papers/arxiv/2610.13574/
site: ML-Quant (https://www.ml-quant.com)
updated: 2026-10-16
license: Summaries CC BY 4.0; links go to the original sources
index: https://www.ml-quant.com/llms.txt
identifier: arXiv:2610.13574
source_url: https://arxiv.org/abs/2610.13574
featured: 2026-10-16
citations: unknown
topic: ML & AI Methods
---


# $L_0$ Feature Selection via Monte Carlo Tree Search in High-Dimensional Financial Regression

A Monte Carlo Tree Search framework selects predictive features by out-of-sample validation rather than training error, improving stability and interpretability under multicollinearity.

- Source: https://arxiv.org/abs/2610.13574
- Identifier: arXiv:2610.13574
- Released: 2026-10-12
- First featured: Quant Letter No. 135 (2026-10-16): https://www.ml-quant.com/issues/2026-10-16/
- Citations (Semantic Scholar): not tracked
- Published in: not yet
- Topic: ML & AI Methods
- Authors: Cameron Mouangue, Tristan Cazenave

## Abstract (arXiv, CC0)

Feature selection is a central problem in high-dimensional financial regression, where large numbers of engineered variables and strong correlations among predictors reduce model stability and interpretability. $L_1$ regularization (Lasso) is widely used for sparse regression, but its shrinkage can be restrictive when informative signals are spread across correlated variables. Exact sparse regression avoids this shrinkage but requires solving a combinatorial optimization problem that is computationally difficult and is typically fit to minimize in-sample rather than out-of-sample error. This paper presents a feature selection framework based on Monte Carlo Tree Search with Generalized Nested Rollout Policy Adaptation (GNRPA). Feature selection is formulated as a sequential decision process, and candidate subsets are scored by their out-of-sample validation performance rather than training error. The method also supports a lexicographic objective accounting for subset size and multicollinearity. We study this approach on a contemporaneous explanatory regression task: explaining the weekly return of the NASDAQ-100 index from 1,072 engineered features spanning market, macroeconomic, and factor data. This isolates the value of subset selection under multicollinearity from the separate problem of predictive forecasting. On this task, the proposed method identifies sparse feature subsets with higher out-of-sample explanatory power than an optimized Lasso baseline, reaching an out-of-sample $R^2$ of 0.6961 versus 0.6313 for Lasso. These results suggest that Monte Carlo Tree Search is a practical alternative to convex regularization for sparse explanatory feature selection in financial regression, with potential value for factor attribution and risk decomposition where transparency matters as much as out-of-sample fit.

## Related

- [Banach-Tarski Embeddings and Transformers](https://www.ml-quant.com/papers/arxiv/2311.09387/): Interpretable Transformers: A novel method for embedding recursive data structures into high-dimensional vectors has been developed, offering an interpretable model for transformer's latent state vectors and enabling computations without decoding.
- [Reconstruction vs. Generation: Taming Optimization Dilemma in Latent Diffusion Models](https://www.ml-quant.com/papers/arxiv/2501.01423/): The paper proposes a new model, VA-VAE, that aligns the latent space with pre-trained vision foundation models, enabling faster convergence of Diffusion Transformers in high-dimensional latent spaces and achieving top performance on ImageNet 256x256 generation.
- [Jumping Ahead: Improving Reconstruction Fidelity with JumpReLU Sparse Autoencoders](https://www.ml-quant.com/papers/arxiv/2407.14435/): The paper presents JumpReLU Sparse Autoencoders (SAEs), which provide high-quality reconstruction of language model activations at a specific sparsity level, while maintaining interpretability.
- [Year-over-Year Developments in Financial Fraud Detection via Deep Learning: A Systematic Literature Review](https://www.ml-quant.com/papers/arxiv/2502.00201/): The study examines progress in deep learning methods for detecting financial fraud, reviewing 57 studies from 2019 to 2024, and discusses challenges and opportunities such as data privacy, feature engineering, and model interpretability.
- [Neuro-Symbolic AI in 2024: A Systematic Review](https://www.ml-quant.com/papers/arxiv/2501.05435/): Neuro-Symbolic AI has grown since 2020, focusing on learning and inference, but still lacks in areas like explainability, trustworthiness, and Meta-Cognition.
- [The Impact of Imperfect XAI on Human-AI Decision-Making](https://www.ml-quant.com/papers/doi/10-1145-3641022/): A study shows that incorrect explanations from explainable AI (XAI) can influence human decision-making, with the impact varying based on the level of human expertise and the quality of the AI.