---
title: Adversarial Post-Training of Foundation Models for High-Frequency Trading
url: https://www.ml-quant.com/papers/arxiv/2610.25604/
site: ML-Quant (https://www.ml-quant.com)
updated: 2026-10-23
license: Summaries CC BY 4.0; links go to the original sources
index: https://www.ml-quant.com/llms.txt
identifier: arXiv:2610.25604
source_url: https://arxiv.org/abs/2610.25604
featured: 2026-10-23
citations: unknown
topic: Trading, Microstructure & Execution
---


# Adversarial Post-Training of Foundation Models for High-Frequency Trading

Wasserstein GAN post-training on limit order book foundation models cuts error accumulation and improves realism by 17%, outperforming continued pre-training with far lower compute cost.

- Source: https://arxiv.org/abs/2610.25604
- Identifier: arXiv:2610.25604
- Released: 2026-10-20
- First featured: Quant Letter No. 136 (2026-10-23): https://www.ml-quant.com/issues/2026-10-23/
- Citations (Semantic Scholar): not tracked
- Published in: not yet
- Topic: Trading, Microstructure & Execution
- Authors: Alexandre Bismuth, Kang Li, Aramis Marti-Shahandeh, Valentin Mohl, Jakob Foerster, Anisoara Calinescu

## Abstract (arXiv, CC0)

While autoregressive foundation models trained on limit order book (LOB) data show state-of-the-art performance for market simulation, pre-training with cross-entropy neither penalizes the compounding of sampling errors over free-running rollouts nor targets desired market properties. We introduce a post-training method for LOB foundation models using a Wasserstein generative adversarial network (GAN) objective. A critic, trained online on rollouts through the true, non-differentiable matching engine, guides updates from evolution strategies over rank-4 LoRA perturbations of the pre-trained generator, under a KL trust region. For efficiency, we use EGGROLL (Evolution Guided GeneRal Optimisation via Low-rank Learning), a memory-efficient variant of evolution strategies. On a held-out panel, adversarial post-training improves LOB-Bench realism by 17.6% (WS-21) and 17.0% (Mean-$L_1$), while selection-matched random-perturbation and compute-matched continued-pre-training controls yield no improvement. Post-training is thus a necessary stage that more pre-training does not replace. Per-position divergence measurements show that it slows error accumulation over 500-message rollouts from $3.1\times$ to $2.3\times$. Adversarial post-training is also inexpensive, requiring under 50M training tokens and 12 GPU-hours per seed, three orders of magnitude below the 48B-token pre-training budget. Ablations over critic inputs, optimizers, and the population-rollout trade-off, together with an analysis of reward hacking, yield practical design guidelines for adversarial post-training.

## Related

- [Algorithmic and high-frequency trading problems for Semi-Markov and Hawkes jump-diffusion models](https://www.ml-quant.com/papers/arxiv/2409.12776/): The paper presents jump-diffusion models to understand limit order book data in algorithmic and high-frequency trading, offering optimal solutions for trading issues within a stochastic optimal control framework.
- [Trading Problems with Semi-Markov and Hawkes Models](https://www.ml-quant.com/papers/ssrn/4956752/): The article explores the creation of advanced trading algorithms that replicate Limit Order Book data, with a focus on semi-Markov and Hawkes jump-diffusion models for high-frequency trading.
- [Painting the market: generative diffusion models for financial limit order book simulation and forecasting](https://www.ml-quant.com/papers/arxiv/2509.05107/): A new method for simulating financial market data transforms limit order book data into an image format and uses diffusion models to predict future states, showing top performance on LOB-Bench.
- [Event-Based Limit Order Book Simulation under a Neural Hawkes Process: Application in Market-Making](https://www.ml-quant.com/papers/arxiv/2502.17417/): An event-driven Limit Order Book model using a Neural Hawkes process is proposed to simulate high-frequency dynamics in financial markets, offering a more accurate depiction of trade execution.
- [LOB-Bench: Benchmarking Generative AI for Finance - an Application to Limit Order Book Data](https://www.ml-quant.com/papers/arxiv/2502.09172/): LOB-Bench, a Python benchmark tool, has been launched to assess the quality of generative message-by-order data for limit order books, with the GenAI approach showing superior performance.
- [Improving Deep Learning of Alpha Term Structures from the Order Book](https://www.ml-quant.com/papers/ssrn/4770476/): The article evaluates the efficiency of four deep learning models in predicting high-frequency returns in equities, emphasizing the role of network structure, input choice, and time inclusion.