---
title: Fine-Tuning an Order-Flow Foundation Model for Sub-Second Forecasting
url: https://www.ml-quant.com/papers/arxiv/2611.14117/
site: ML-Quant (https://www.ml-quant.com)
updated: 2026-11-14
license: Summaries CC BY 4.0; links go to the original sources
index: https://www.ml-quant.com/llms.txt
identifier: arXiv:2611.14117
source_url: https://arxiv.org/abs/2611.14117
featured: 2026-11-13
citations: unknown
topic: ML & AI Methods
---


# Fine-Tuning an Order-Flow Foundation Model for Sub-Second Forecasting

A generative model pretrained on crypto order-flow data and fine-tuned for microprice forecasting outperforms gradient boosting and transfers zero-shot to unseen assets.

- Source: https://arxiv.org/abs/2611.14117
- Identifier: arXiv:2611.14117
- Released: 2026-11-11
- First featured: Quant Letter No. 139 (2026-11-13): https://www.ml-quant.com/issues/2026-11-13/
- Citations (Semantic Scholar): not tracked
- Published in: not yet
- Topic: ML & AI Methods
- Authors: Fedor Shabashev

## Abstract (arXiv, CC0)

Generative models have become the standard approach in language and vision. These models are typically pretrained first and then fine-tuned. Recent work demonstrates how to pretrain an autoregressive generative model on Level-3 order-flow data. However, to our knowledge, no one has fine-tuned such a model yet for downstream tasks. Here we first pretrain a 300M-parameter generative model on Level-3 order-flow data collected from two crypto exchanges, Bitstamp and Bitfinex. Then we fine-tune the pretrained model to predict the microprice return and its realized volatility. We show that our fine-tuned model outperforms classical baselines, such as gradient boosting on handcrafted features, in predicting microprice returns over sub-second horizons. Furthermore, the predictive ability of the model transfers zero-shot to assets it was never fine-tuned on. Due to the short-term nature of these forecasts, the predicted microprice moves are smaller than the bid-ask spread plus fees, so the natural applications are in execution and market making. These results indicate that a pretrained generative model can be turned into a competitive short-horizon price forecaster via fine-tuning.

## Related

- [Reconstruction vs. Generation: Taming Optimization Dilemma in Latent Diffusion Models](https://www.ml-quant.com/papers/arxiv/2501.01423/): The paper proposes a new model, VA-VAE, that aligns the latent space with pre-trained vision foundation models, enabling faster convergence of Diffusion Transformers in high-dimensional latent spaces and achieving top performance on ImageNet 256x256 generation.
- [Adjoint Matching: Fine-tuning Flow and Diffusion Generative Models with Memoryless Stochastic Optimal Control](https://www.ml-quant.com/papers/arxiv/2409.08861/): The study presents Adjoint Matching, a new algorithm that enhances dynamical generative models by refining reward fine-tuning, leading to improved consistency, realism, and adaptability to unseen human preference reward models.
- [Fine-tuning can cripple your foundation model; preserving features may be the solution](https://www.ml-quant.com/papers/arxiv/2308.13320/): Concept forgetting in AI models can be significantly reduced by a new fine-tuning method called LDIFS, which helps retain pre-trained knowledge while working on different tasks.
- [DITTO: Diffusion Inference-Time T-Optimization for Music Generation](https://www.ml-quant.com/papers/arxiv/2401.12179/): Music Optimization: The DITTO framework allows control of pre-trained text-to-music diffusion models at inference-time, enabling music generation without fine-tuning.
- [Conditional Diffusion on Web-Scale Image Pairs leads to Diverse Image Variations](https://www.ml-quant.com/papers/arxiv/2405.14857/): Semantica, an image-conditioned diffusion model, can generate new images based on the semantics of a conditioning image, without the need for fine-tuning.
- [CAT3D: Create Anything in 3D with Multi-View Diffusion Models](https://www.ml-quant.com/papers/arxiv/2405.10314/): Multi-View Diffusion Models: CAT3D is a novel technique for generating 3D scenes from any number of images, surpassing existing methods in speed and efficiency.