TailDART: Compute-Efficient Foundation Models for Financial Time-Series Forecasting

Although time-series foundation models (TSFMs) achieve strong zero-shot transferability across high-information-density physical systems, applying overparameterized TSFMs to quantitative finance is fundamentally constrained by low signal-to-noise ratios, non-stationarity, and prohibitive autoregressive decoding latency. To reconcile representation learning with institutional operational constraints, this study presents TailDART, a dense 2.68 million-parameter foundation model engineered for financial time-series forecasting. By integrating grouped-query attention into a lightweight backbone, the architecture drastically reduces Key-Value cache memory bandwidth overhead, achieving major inference acceleration (up to 48.1%) over prevailing state-of-the-art TSFMs to enable low-latency, high-throughput streaming execution. Furthermore, multi-asset benchmarks across varying temporal resolutions show that a compact model can remain competitive for market forecasting: TailDART matches the predictive fidelity of substantially larger baselines while demonstrating superior error resilience in high-volatility regimes.

1. 30 Oct 2026

   Deep Learning Models in Central Bank Forecasting

   Pretrained time-series foundation models match or outperform benchmarks on selected inflation and nowcasting targets but add limited gains for labor-market aggregates or irregular series.

   RePEc

   2fanfare
2. 2 Oct 2026

   KiT: A Foundation Model for Financial Time-Series Forecasting using DiffusionTransformers

   Diffusion transformer foundation model reformulates candlestick prediction as conditional trajectory generation, achieving 0.057 mean return RankIC across markets and timescales.

   arXiv

   0cites
3. 8 Jan 2025

   Reconstruction vs. Generation: Taming Optimization Dilemma in Latent Diffusion Models

   The paper proposes a new model, VA-VAE, that aligns the latent space with pre-trained vision foundation models, enabling faster convergence of Diffusion Transformers in high-dimensional latent spaces and achieving top performance on ImageNet 256x256 generation.

   Machine learningIn 2025 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)

   492cites
4. 13 Nov 2024

   Mixture-of-Transformers: A Sparse and Scalable Architecture for Multi-Modal Foundation Models

   The Mixture-of-Transformers (MoT) is a sparse multi-modal transformer architecture that reduces pretraining costs and allows modality-specific processing with global self-attention.

   Machine learningIn Trans. Mach. Learn. Res.

   230cites
5. 15 Aug 2024

   ECG-FM: An Open Electrocardiogram Foundation Model

   ECG-FM, a transformer-based model for ECG analysis, shows strong performance in predicting cardiac conditions, having been pretrained on 2.5 million samples.

   Machine learning

   141cites
6. 3 Jul 2024

   Fine-tuning can cripple your foundation model; preserving features may be the solution

   Concept forgetting in AI models can be significantly reduced by a new fine-tuning method called LDIFS, which helps retain pre-trained knowledge while working on different tasks.

   Machine learningIn Trans. Mach. Learn. Res.

   109cites