---
title: Lumina-T2X: Transforming Text into Any Modality, Resolution, and Duration via Flow-based Large Diffusion Transformers
url: https://www.ml-quant.com/papers/arxiv/2405.05945/
site: ML-Quant (https://www.ml-quant.com)
updated: 2026-09-26
license: Summaries CC BY 4.0; links go to the original sources
index: https://www.ml-quant.com/llms.txt
identifier: arXiv:2405.05945
source_url: https://arxiv.org/abs/2405.05945
featured: 2024-05-15
citations: 146
topic: ML & AI Methods
---


# Lumina-T2X: Transforming Text into Any Modality, Resolution, and Duration via Flow-based Large Diffusion Transformers

Text Transformation: The Lumina-T2X family, a series of Large Diffusion Transformers, is introduced as a unified framework for transforming noise into various forms of media based on text instructions, allowing for training across different modalities and flexible multimodal data generation.

- Source: https://arxiv.org/abs/2405.05945
- Identifier: arXiv:2405.05945
- Released: 2024-05-09
- First featured: Quant Letter No. 49 (2024-05-15): https://www.ml-quant.com/issues/2024-05-15/
- Citations (Semantic Scholar): 146
- Published in: not yet
- Topic: ML & AI Methods

## Related

- [Mamba: Linear-Time Sequence Modeling with Selective State Spaces](https://www.ml-quant.com/papers/arxiv/2312.00752/): Sequence Modeling: Mamba, a neural network architecture that doesn't use attention or MLP blocks, provides faster inference and better performance in language, audio, and genomics than Transformers.
- [Transformers are SSMs: Generalized Models and Efficient Algorithms Through Structured State Space Duality](https://www.ml-quant.com/papers/arxiv/2405.21060/): The research identifies a link between state-space models and Transformers in deep learning, leading to the creation of a faster language modeling architecture, Mamba-2.
- [Octo: An Open-Source Generalist Robot Policy](https://www.ml-quant.com/papers/arxiv/2405.12213/): Octo is a large transformer-based policy for robotic manipulation, trained on a vast dataset, that can be instructed via language or images and adapted to new domains.
- [Visual Autoregressive Modeling: Scalable Image Generation via Next-Scale Prediction](https://www.ml-quant.com/papers/arxiv/2404.02905/): The article discusses Visual AutoRegressive modeling (VAR), a new image learning method that outperforms diffusion transformers in terms of speed, image quality, and scalability.
- [PixArt-α: Fast Training of Diffusion Transformer for Photorealistic Text-to-Image Synthesis](https://www.ml-quant.com/papers/arxiv/2310.00426/): PIXART-$\alpha$, a Transformer-based text-to-image model, generates high-quality images at a low cost, reducing CO2 emissions and offering a cost-effective solution for the AIGC community.
- [Gated Linear Attention Transformers with Hardware-Efficient Training](https://www.ml-quant.com/papers/arxiv/2312.06635/): Efficient Training of Gated Linear Attention Transformers: The research introduces a more hardware-efficient version of gated linear attention Transformers that performs well against other models, especially in training on longer sequences.