Information Flow and Market Risk: Transformer-Based Evidence on Sentiment and Volatility Dynamics

This study examines whether transformer-based financial news sentiment improves equity volatility forecasts beyond conventional market-based predictors. Using data for eleven US stocks, we compare volatility persistence models with specifications incorporating the VIX, AAII investor sentiment, and news sentiment extracted using ModernFinBERT. The forecasting target is annualized volatility constructed from future averages of trailing 252-session Yang-Zhang estimates, evaluated at horizons of 1, 5, and 22 trading days. Models are assessed through walk-forward testing with expanding and rolling estimation windows, fixed initial hyperparameter selection, and statistical comparisons accounting for multiple testing and serial dependence. Results show that a naive persistence benchmark achieves the lowest average QLIKE loss at all horizons. Although HAR-VIX produces the largest number of individual forecasting wins under expanding windows, it does not achieve the lowest mean loss. Adding text-based sentiment improves HAR forecasts in only two of 33 expanding-window comparisons, and neither improvement remains statistically significant under longer HAC bandwidths. A blinded audit of 2,700 news texts further characterizes the agreement and confidence patterns of ModernFinBERT classifications. The findings do not establish a general incremental forecasting advantage from transformer-based news sentiment. They highlight the importance of strong benchmarks, temporal alignment, robust inference, and careful evaluation of text-derived predictors.

1. 30 Apr 2025

   Bridging Short- and Long-Term Dependencies: A CNN-Transformer Hybrid for Financial Time Series Forecasting

   The paper suggests a hybrid architecture combining Convolutional Neural Networks and Transformers for efficient short- and long-term financial time series data modeling, showing improved performance in intraday stock price prediction.

   arXivFeatured 2×

   8cites
2. 23 Apr 2025

   Cross-Modal Temporal Fusion for Financial Market Forecasting

   The article presents Cross-Modal Temporal Fusion (CMTF), a new transformer-based system that uses diverse financial data to enhance the precision of financial market predictions.

   arXivIn European Conference on Artificial Intelligence

   10cites
3. 1 Jan 2025

   Hidformer: Transformer-Style Neural Network in Stock Price Forecasting

   The research explores the application of the Hidformer model, a Transformer-based neural network, in stock price forecasting, combining technical analysis and advanced machine learning for improved accuracy.

   arXiv

   6cites
4. 18 Dec 2024

   Causal Diffusion Transformers for Generative Modeling

   The article discusses Causal Diffusion, a framework that enhances diffusion models' performance and allows a seamless shift between autoregressive and diffusion generation modes, achieving top results on the ImageNet generation benchmark.

   Machine learning

   37cites
5. 12 Dec 2024

   Systematic comparison of deep generative models applied to multivariate financial time series

   The study contrasts deep generative models (DGMs) and parametric models for creating financial time series, highlighting the advantages of DGMs in an implied volatility trading task.

   arXiv

   1cites
6. 28 Aug 2024

   SST: Multi-Scale Hybrid Mamba-Transformer Experts for Time Series Forecasting

   The paper introduces the State Space Transformer model for time series forecasting, which effectively captures global and local patterns, offering superior performance with less memory and computational cost.

   Machine learningIn Proceedings of the 34th ACM International Conference on Information and Knowledge Management

   43cites