Diversification Across Predictors: Heterogeneous Ensemble Learning for Cross-Sectional Return Prediction

Cross-sectional stock return prediction remains challenging due to extremely low signal-to-noise ratios, high-dimensional factor spaces, and non-stationary predictor effectiveness. Individual model classes exhibit complementary failure modes in this regime: neural networks overfit noise due to high variance, while linear models underfit nonlinear structure due to high bias. We propose a heterogeneous ensemble framework that extends the financial principle of diversification to the predictor level. Through a bagging procedure combining linear predictors with nonlinear predictors, each model functions as a distinct specialist whose prediction errors exhibit low cross-covariance, enabling error cancellation upon aggregation. We formalize this mechanism via bias-variance-covariance decomposition, establishing an exact mathematical correspondence between portfolio diversification and predictor aggregation. On CSI300 daily-frequency Alpha158 factor datasets, the proposed ensemble achieves a Rank IC improvement exceeding 13\% over standalone neural networks and surpasses tree-based state-of-the-art methods including XGBoost and Double Ensemble, as measured by both predictive accuracy and portfolio-based evaluation metrics.

1. 30 May 2025

   Neural Network Logarithm Entropy Estimator

   A new LogDet estimator has been proposed to address the challenges of handling high-dimensional samples in machine learning using entropy estimators.

   SSRNFeatured 2×

   2shares
2. 19 Feb 2025

   Generalized Factor Neural Network Model for High-dimensional Regression

   A novel method combining non-parametric regression, factor models, and neural networks has been introduced, showing effectiveness in predicting equity ETF indices prices and macroeconomic data.

   arXivIn International Journal of Forecasting

   0cites
3. 23 Oct 2024

   IPO Pricing Prediction with Lasso-Neural Networks

   A new model using Lasso neural networks has been developed to predict IPO pricing for Chinese companies, with retained earnings per share being a key factor.

   SSRN

   5shares
4. 5 Jun 2024

   Mamba: Linear-Time Sequence Modeling with Selective State Spaces

   Sequence Modeling: Mamba, a neural network architecture that doesn't use attention or MLP blocks, provides faster inference and better performance in language, audio, and genomics than Transformers.

   Machine learning

   10,243cites
5. 8 Jan 2025

   Reconstruction vs. Generation: Taming Optimization Dilemma in Latent Diffusion Models

   The paper proposes a new model, VA-VAE, that aligns the latent space with pre-trained vision foundation models, enabling faster convergence of Diffusion Transformers in high-dimensional latent spaces and achieving top performance on ImageNet 256x256 generation.

   Machine learningIn 2025 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)

   492cites
6. 21 Feb 2024

   Graph Mamba: Towards Learning on Graphs with State Space Models

   Graph Mamba Networks, a new type of Graph Neural Networks, have been introduced, which achieve excellent performance in various benchmark datasets despite lower computational cost.

   Machine learningIn Proceedings of the 30th ACM SIGKDD Conference on Knowledge Discovery and Data Mining

   183cites