---
title: TailDART: Compute-Efficient Foundation Models for Financial Time-Series Forecasting
url: https://www.ml-quant.com/papers/arxiv/2611.09176/
site: ML-Quant (https://www.ml-quant.com)
updated: 2026-11-14
license: Summaries CC BY 4.0; links go to the original sources
index: https://www.ml-quant.com/llms.txt
identifier: arXiv:2611.09176
source_url: https://arxiv.org/abs/2611.09176
featured: 2026-11-13
citations: unknown
topic: ML & AI Methods
---


# TailDART: Compute-Efficient Foundation Models for Financial Time-Series Forecasting

A 2.68 million-parameter model with grouped-query attention reduces inference latency and matches larger baselines on financial time-series forecasting across multiple assets.

- Source: https://arxiv.org/abs/2611.09176
- Identifier: arXiv:2611.09176
- Released: 2026-11-09
- First featured: Quant Letter No. 139 (2026-11-13): https://www.ml-quant.com/issues/2026-11-13/
- Citations (Semantic Scholar): not tracked
- Published in: not yet
- Topic: ML & AI Methods
- Authors: Chiang Qin Zhi, Ranjan Satapathy, Erik Cambria, Joyjit Chattoraj

## Abstract (arXiv, CC0)

Although time-series foundation models (TSFMs) achieve strong zero-shot transferability across high-information-density physical systems, applying overparameterized TSFMs to quantitative finance is fundamentally constrained by low signal-to-noise ratios, non-stationarity, and prohibitive autoregressive decoding latency. To reconcile representation learning with institutional operational constraints, this study presents TailDART, a dense 2.68 million-parameter foundation model engineered for financial time-series forecasting. By integrating grouped-query attention into a lightweight backbone, the architecture drastically reduces Key-Value cache memory bandwidth overhead, achieving major inference acceleration (up to 48.1%) over prevailing state-of-the-art TSFMs to enable low-latency, high-throughput streaming execution. Furthermore, multi-asset benchmarks across varying temporal resolutions show that a compact model can remain competitive for market forecasting: TailDART matches the predictive fidelity of substantially larger baselines while demonstrating superior error resilience in high-volatility regimes.

## Related

- [Deep Learning Models in Central Bank Forecasting](https://www.ml-quant.com/papers/repec/ptu-wpaper-w202612/): Pretrained time-series foundation models match or outperform benchmarks on selected inflation and nowcasting targets but add limited gains for labor-market aggregates or irregular series.
- [KiT: A Foundation Model for Financial Time-Series Forecasting using DiffusionTransformers](https://www.ml-quant.com/papers/arxiv/2609.34507/): Diffusion transformer foundation model reformulates candlestick prediction as conditional trajectory generation, achieving 0.057 mean return RankIC across markets and timescales.
- [Reconstruction vs. Generation: Taming Optimization Dilemma in Latent Diffusion Models](https://www.ml-quant.com/papers/arxiv/2501.01423/): The paper proposes a new model, VA-VAE, that aligns the latent space with pre-trained vision foundation models, enabling faster convergence of Diffusion Transformers in high-dimensional latent spaces and achieving top performance on ImageNet 256x256 generation.
- [Mixture-of-Transformers: A Sparse and Scalable Architecture for Multi-Modal Foundation Models](https://www.ml-quant.com/papers/arxiv/2411.04996/): The Mixture-of-Transformers (MoT) is a sparse multi-modal transformer architecture that reduces pretraining costs and allows modality-specific processing with global self-attention.
- [ECG-FM: An Open Electrocardiogram Foundation Model](https://www.ml-quant.com/papers/arxiv/2408.05178/): ECG-FM, a transformer-based model for ECG analysis, shows strong performance in predicting cardiac conditions, having been pretrained on 2.5 million samples.
- [Fine-tuning can cripple your foundation model; preserving features may be the solution](https://www.ml-quant.com/papers/arxiv/2308.13320/): Concept forgetting in AI models can be significantly reduced by a new fine-tuning method called LDIFS, which helps retain pre-trained knowledge while working on different tasks.