---
title: LENS: Large Pre-trained Transformer for Exploring Financial Time Series Regularities
url: https://www.ml-quant.com/papers/arxiv/2408.10111/
site: ML-Quant (https://www.ml-quant.com)
updated: 2026-09-26
license: Summaries CC BY 4.0; links go to the original sources
index: https://www.ml-quant.com/llms.txt
identifier: arXiv:2408.10111
source_url: https://arxiv.org/abs/2408.10111
featured: 2024-08-21
citations: 3
topic: Econometrics & Forecasting
---


# LENS: Large Pre-trained Transformer for Exploring Financial Time Series Regularities

Financial Regularities: The article introduces PLUTUS, a pre-trained transformer-based model for financial time series modeling, setting a new benchmark in the field with its superior performance.

- Source: https://arxiv.org/abs/2408.10111
- Identifier: arXiv:2408.10111
- Released: 2024-08-19
- First featured: Quant Letter No. 62 (2024-08-21): https://www.ml-quant.com/issues/2024-08-21/
- Citations (Semantic Scholar): 3
- Published in: Proceedings of the 6th ACM International Conference on AI in Finance
- Topic: Econometrics & Forecasting

## Related

- [SST: Multi-Scale Hybrid Mamba-Transformer Experts for Time Series Forecasting](https://www.ml-quant.com/papers/arxiv/2404.14757/): The paper introduces the State Space Transformer model for time series forecasting, which effectively captures global and local patterns, offering superior performance with less memory and computational cost.
- [Causal Diffusion Transformers for Generative Modeling](https://www.ml-quant.com/papers/arxiv/2412.12095/): The article discusses Causal Diffusion, a framework that enhances diffusion models' performance and allows a seamless shift between autoregressive and diffusion generation modes, achieving top results on the ImageNet generation benchmark.
- [Hidformer: Transformer-Style Neural Network in Stock Price Forecasting](https://www.ml-quant.com/papers/arxiv/2412.19932/): The research explores the application of the Hidformer model, a Transformer-based neural network, in stock price forecasting, combining technical analysis and advanced machine learning for improved accuracy.
- [Cross-Modal Temporal Fusion for Financial Market Forecasting](https://www.ml-quant.com/papers/arxiv/2504.13522/): The article presents Cross-Modal Temporal Fusion (CMTF), a new transformer-based system that uses diverse financial data to enhance the precision of financial market predictions.
- [Bridging Short- and Long-Term Dependencies: A CNN-Transformer Hybrid for Financial Time Series Forecasting](https://www.ml-quant.com/papers/arxiv/2504.19309/): The paper suggests a hybrid architecture combining Convolutional Neural Networks and Transformers for efficient short- and long-term financial time series data modeling, showing improved performance in intraday stock price prediction.
- [Transformers for Solar Flare Forecasting](https://www.ml-quant.com/papers/ssrn/4983283/): The paper examines the use of machine learning algorithms, specifically Transformers, to predict solar flares and lessen their impact on Earth.