Fine-Tuning an Order-Flow Foundation Model for Sub-Second Forecasting

Generative models have become the standard approach in language and vision. These models are typically pretrained first and then fine-tuned. Recent work demonstrates how to pretrain an autoregressive generative model on Level-3 order-flow data. However, to our knowledge, no one has fine-tuned such a model yet for downstream tasks. Here we first pretrain a 300M-parameter generative model on Level-3 order-flow data collected from two crypto exchanges, Bitstamp and Bitfinex. Then we fine-tune the pretrained model to predict the microprice return and its realized volatility. We show that our fine-tuned model outperforms classical baselines, such as gradient boosting on handcrafted features, in predicting microprice returns over sub-second horizons. Furthermore, the predictive ability of the model transfers zero-shot to assets it was never fine-tuned on. Due to the short-term nature of these forecasts, the predicted microprice moves are smaller than the bid-ask spread plus fees, so the natural applications are in execution and market making. These results indicate that a pretrained generative model can be turned into a competitive short-horizon price forecaster via fine-tuning.

1. 8 Jan 2025

   Reconstruction vs. Generation: Taming Optimization Dilemma in Latent Diffusion Models

   The paper proposes a new model, VA-VAE, that aligns the latent space with pre-trained vision foundation models, enabling faster convergence of Diffusion Transformers in high-dimensional latent spaces and achieving top performance on ImageNet 256x256 generation.

   Machine learningIn 2025 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)

   492cites
2. 15 Jan 2025

   Adjoint Matching: Fine-tuning Flow and Diffusion Generative Models with Memoryless Stochastic Optimal Control

   The study presents Adjoint Matching, a new algorithm that enhances dynamical generative models by refining reward fine-tuning, leading to improved consistency, realism, and adaptability to unseen human preference reward models.

   Machine learning

   273cites
3. 3 Jul 2024

   Fine-tuning can cripple your foundation model; preserving features may be the solution

   Concept forgetting in AI models can be significantly reduced by a new fine-tuning method called LDIFS, which helps retain pre-trained knowledge while working on different tasks.

   Machine learningIn Trans. Mach. Learn. Res.

   109cites
4. 5 Jun 2024

   DITTO: Diffusion Inference-Time T-Optimization for Music Generation

   Music Optimization: The DITTO framework allows control of pre-trained text-to-music diffusion models at inference-time, enabling music generation without fine-tuning.

   Machine learningIn International Conference on Machine Learning

   103cites
5. 28 May 2024

   Conditional Diffusion on Web-Scale Image Pairs leads to Diverse Image Variations

   Semantica, an image-conditioned diffusion model, can generate new images based on the semantics of a conditioning image, without the need for fine-tuning.

   Machine learning

   0cites
6. 22 May 2024

   CAT3D: Create Anything in 3D with Multi-View Diffusion Models

   Multi-View Diffusion Models: CAT3D is a novel technique for generating 3D scenes from any number of images, surpassing existing methods in speed and efficiency.

   Machine learningIn Neural Information Processing Systems

   515cites