---
title: AllocFlow: End-to-End Portfolio Trading Action Generation from Raw Market Data
url: https://www.ml-quant.com/papers/arxiv/2611.19937/
site: ML-Quant (https://www.ml-quant.com)
updated: 2026-11-20
license: Summaries CC BY 4.0; links go to the original sources
index: https://www.ml-quant.com/llms.txt
identifier: arXiv:2611.19937
source_url: https://arxiv.org/abs/2611.19937
featured: 2026-11-20
citations: unknown
topic: ML & AI Methods
---


# AllocFlow: End-to-End Portfolio Trading Action Generation from Raw Market Data

An end-to-end flow-matching framework generates joint portfolio allocations directly from market data using a Transformer, trained via imitation learning and reinforcement learning to optimize allocation decisions.

- Source: https://arxiv.org/abs/2611.19937
- Identifier: arXiv:2611.19937
- Released: 2026-11-17
- First featured: Quant Letter No. 140 (2026-11-20): https://www.ml-quant.com/issues/2026-11-20/
- Citations (Semantic Scholar): not tracked
- Published in: not yet
- Topic: ML & AI Methods
- Authors: Annan Wang, Yuchen Xie, Yu Cen, Leon Liangyu Chen, Qianyu Julie Zhu, Xin Li, Tianyi Wei, Weisi Lin

## Abstract (arXiv, CC0)

Real-world portfolio management requires converting noisy market observations into coordinated, simultaneous allocations across multiple assets under shared capital constraints. Advances in forecasting models and alpha discovery help identify opportunities. However, traditional pipelines often decouple signal forecasting from portfolio construction, potentially misaligning learning with allocation and execution objectives. We present AllocFlow, an end-to-end flow-matching framework that directly generates joint portfolio allocations from raw multi-asset market histories. To capture dependencies among portfolio positions, AllocFlow employs a cross-asset flow Transformer conditioned on temporal market representations to generate continuous, signed position weights across all instruments jointly. To address the sample inefficiency and instability of learning continuous allocation policies from scratch, we establish a two-stage training scheme: strategy-supervised imitation shapes a structured distribution of candidate portfolios, followed by group-relative reinforcement learning (RL) that refines joint decisions using portfolio-level financial rewards and a frozen policy reference. On hourly cryptocurrency perpetual futures, RL refinement raises the annualized net return of the imitation policy from $27.79\%$ to $51.38\%$ and its Calmar ratio from $0.955$ to $4.043$, surpassing the teacher strategy on every metric, and AllocFlow reaches a Calmar ratio of $4.90$ on six further months of unseen 2026 data without retraining.

## Related

- [Transformers as Decision Makers: Provable In-Context Reinforcement Learning via Supervised Pretraining](https://www.ml-quant.com/papers/arxiv/2310.08566/): The article presents a theoretical framework for training large transformer models for in-context reinforcement learning, offering the first quantitative analysis of their capabilities.
- [Adaptive Partitioning and Learning for Stochastic Control of Diffusion Processes](https://www.ml-quant.com/papers/arxiv/2512.14991/): An adaptive reinforcement learning algorithm enhances learning in controlled diffusion processes by partitioning state-action spaces, providing theoretical guarantees and effective results in applications like portfolio selection.
- [Reinforcement Learning for Jump-Diffusions](https://www.ml-quant.com/papers/arxiv/2405.16449/): The study shows that continuous-time reinforcement learning can be applied to both pure diffusion and jump-diffusion processes, useful in portfolio selection with stock prices modeled as a jump-diffusion.
- [RL Transformers](https://www.ml-quant.com/papers/ssrn/5064791/): The paper analyzes the integration of Transformer architectures with Reinforcement Learning, offering a mathematical framework, a new taxonomy, and a review of real-world applications.
- [Mamba: Linear-Time Sequence Modeling with Selective State Spaces](https://www.ml-quant.com/papers/arxiv/2312.00752/): Sequence Modeling: Mamba, a neural network architecture that doesn't use attention or MLP blocks, provides faster inference and better performance in language, audio, and genomics than Transformers.
- [Octo: An Open-Source Generalist Robot Policy](https://www.ml-quant.com/papers/arxiv/2405.12213/): Octo is a large transformer-based policy for robotic manipulation, trained on a vast dataset, that can be instructed via language or images and adapted to new domains.
