---
title: Event History Over Scale: Compact Transformers for Low-Latency Limit Order Book Forecasting
url: https://www.ml-quant.com/papers/arxiv/2610.02917/
site: ML-Quant (https://www.ml-quant.com)
updated: 2026-10-09
license: Summaries CC BY 4.0; links go to the original sources
index: https://www.ml-quant.com/llms.txt
identifier: arXiv:2610.02917
source_url: https://arxiv.org/abs/2610.02917
featured: 2026-10-09
citations: unknown
topic: Trading, Microstructure & Execution
---


# Event History Over Scale: Compact Transformers for Low-Latency Limit Order Book Forecasting

MBOFormer and MBOFusion, two causal transformers with under 70 kilobyte serialized state, predict limit order book price trends with sub-millisecond latency across three markets and four prediction horizons.

- Source: https://arxiv.org/abs/2610.02917
- Identifier: arXiv:2610.02917
- Released: 2026-10-05
- First featured: Quant Letter No. 134 (2026-10-09): https://www.ml-quant.com/issues/2026-10-09/
- Citations (Semantic Scholar): not tracked
- Published in: not yet
- Topic: Trading, Microstructure & Execution
- Authors: David Schaurecker, Lasse B. Strand, Kevin O'Sullivan, Robert Jakob

## Abstract (arXiv, CC0)

Short-horizon price-trend prediction from limit order books in equity and intraday electricity markets requires models that combine predictive quality with low single-sample latency and a small serialized model size to keep pace with rapid and continuous market updates. We introduce MBOFormer, a 7,203-parameter causal transformer, and MBOFusion, a 14,371-parameter extension with a slow temporal-context branch. Both models process market-by-order (level-3) histories of individual order submissions, cancellations, and executions. We compare them with level-2-based baselines that process sampled order-book snapshots and simple statistics instead of their underlying messages. Across three markets and four prediction horizons, our models achieve the highest mean macro-F1 in eleven of the twelve settings in a comparison against other benchmark models of varying sizes. Both our models achieve sub-millisecond median inference on a single Apple M2 CPU thread and have serialized state dictionaries below 70 kB. MBOFormer is 5.1x-8.1x faster than the million-parameter baselines at comparable predictive quality. Our results show that fine-grained market event history can reduce the need for model size under tight deployment constraints for short-term equity and electricity price forecasting tasks.

## Related

- [Detecting Multilevel Manipulation from Limit Order Book via Cascaded Contrastive Representation Learning](https://www.ml-quant.com/papers/arxiv/2508.17086/): The study suggests a learning framework to enhance the detection of trade-based manipulation in financial markets, with Transformer-based architectures proving most successful.
- [Simulating and analyzing a sparse order book: an application to intraday electricity markets](https://www.ml-quant.com/papers/arxiv/2410.06839/): The paper presents a new model for simulating sparse limit order books in illiquid markets like the European intraday electricity market, using an inhomogeneous Poisson process for order arrivals and cancellations.
- [Deep attentive survival analysis in limit order books: estimating fill probabilities with convolutional-transformers](https://www.ml-quant.com/papers/arxiv/2306.05479/): A deep learning method outperforms other approaches in estimating filltimes of limit orders.
- [Painting the market: generative diffusion models for financial limit order book simulation and forecasting](https://www.ml-quant.com/papers/arxiv/2509.05107/): A new method for simulating financial market data transforms limit order book data into an image format and uses diffusion models to predict future states, showing top performance on LOB-Bench.
- [Bimodal dynamics of the artificial limit order book stock exchange with autonomous traders](https://www.ml-quant.com/papers/arxiv/2508.17837/): The paper uncovers the inherent bistability and complex dynamics of an artificial stock market exchange, which emerge from micro-level trading rules.
- [Reinforcement learning for trade execution with market and limit orders](https://www.ml-quant.com/papers/arxiv/2507.06345/): The paper presents a reinforcement learning framework for optimal trade execution, using multivariate logistic-normal distributions, which outperforms traditional benchmark strategies.