Grounding Long Financial Text with Semantically-Enriched Tables via Multimodal Learning

We propose a multimodal transformer framework for efficiently modeling long1 financial documents that combine structured tabular data with noisy, unstructured2 textual disclosures. The framework represents financial tables as semantically3 enriched token sequences and integrates them with long-form text through a cross-4 attention mechanism that explicitly captures cross-modal dependencies. In par-5 ticular, we augment each numerical variable with a semantic embedding derived6 from its textual definition, enabling the model to encode both numerical magnitude7 and economic meaning. This design yields a more expressive and parameter-8 efficient representation of tabular data compared to value-only embeddings. Using9 a large-scale dataset of financial statements and MD&A disclosures, we show that10 structured numerical features remain the dominant source of predictive signal;11 however, textual information provides consistent incremental gains when incor-12 porated via cross-attention rather than simple concatenation. Our results further13 demonstrate that noisy textual disclosures are most useful when conditioned on a14 stable, semantically structured tabular representation. In particular, using frozen15 variable-level tabular representations as cross-attention queries enables the model16 to weight MD&A chunks differently for each financial variable and observation.17 These findings suggest that cross-attention provides an efficient mechanism for18 table-conditioned aggregation of long-form narrative evidence.

1. 30 Jan 2024

   SliceGPT: Compress Large Language Models by Deleting Rows and Columns

   Compressing Language Models: The paper introduces SliceGPT, a post-training sparsification scheme for large language models that reduces the network's embedding dimension, maintains high performance, reduces inference computation, and reveals computational invariance in transformer networks.

   Machine learningIn International Conference on Learning Representations

   518cites
2. 2 Oct 2026

   Transformer-based CoVaR: Systemic Risk in Textual Information

   Integrating financial news embeddings from large language models with market data, the study improves systemic risk forecasts using conditional value-at-risk without requiring large datasets.

   RePEc

   3fanfare
3. 6 Nov 2024

   Efficient Adversarial Training in LLMs with Continuous Attacks

   CAdvUL, a new adversarial training algorithm, enhances the resilience of large language models against adversarial attacks by efficiently calculating attacks in the continuous embedding space.

   Machine learningIn Neural Information Processing Systems

   157cites
4. 15 May 2024

   You Only Cache Once: Decoder-Decoder Architectures for Language Models

   YOCO architecture improves large language models by reducing GPU memory usage and speeding up the prefill stage, outperforming the Transformer model.

   Machine learningIn Neural Information Processing Systems

   178cites
5. 3 Apr 2024

   Gecko: Versatile Text Embeddings Distilled from Large Language Models

   Compact Text Embeddings: Gecko is a new text embedding model that improves knowledge extraction from large language models, surpassing other models in the Massive Text Embedding Benchmark.

   Machine learning

   97cites
6. 9 Oct 2025

   From News to Returns: A Granger-Causal Hypergraph Transformer on the Sphere

   The research suggests the CSHT, a new architecture for financial time-series forecasting that considers the impact of financial news and sentiment on asset returns, providing robust generalisation across market regimes and clear attribution pathways.

   arXivIn Proceedings of the 6th ACM International Conference on AI in Finance

   4cites