---
title: Point-in-Time Encoders for Earnings Calls
url: https://www.ml-quant.com/papers/arxiv/2611.14325/
site: ML-Quant (https://www.ml-quant.com)
updated: 2026-11-14
license: Summaries CC BY 4.0; links go to the original sources
index: https://www.ml-quant.com/llms.txt
identifier: arXiv:2611.14325
source_url: https://arxiv.org/abs/2611.14325
featured: 2026-11-13
citations: unknown
topic: LLMs & Text
---


# Point-in-Time Encoders for Earnings Calls

Encoders trained on earnings calls with yearly cutoffs raise rank correlation of return forecasts by about half and improve earnings-surprise prediction.

- Source: https://arxiv.org/abs/2611.14325
- Identifier: arXiv:2611.14325
- Released: 2026-11-11
- First featured: Quant Letter No. 139 (2026-11-13): https://www.ml-quant.com/issues/2026-11-13/
- Citations (Semantic Scholar): not tracked
- Published in: not yet
- Topic: LLMs & Text
- Authors: Alessio Brini

## Abstract (arXiv, CC0)

Text encoders turn earnings calls into vectors for search, for language models that answer from retrieved passages, and for forecasting models. A live retriever can use an encoder trained once on all available text, as finance retrievers are, but a backtest needs an encoder that read no text written after the date of each vector. To address this look-ahead bias, from 412,248 calls we train vintages under four pretraining recipes, with yearly cutoffs from 2010 to 2024, and each vintage reads only text dated on or before its cutoff. We then fine-tune each vintage on the question-answer pairs of the calls themselves. The vintages we train on calls alone, with 33.8M parameters, retrieve answers on held-out calls better than the general retrievers we tested in every test quarter. Their vectors also raise by about half the rank correlation between next-day returns and forecasts built from past returns and firm size. When each vintage continues the previous one, a later vintage retrieves better on earlier quarters than the vintage available at the time, and a point-in-time language model that answers from the passages the later vintage retrieves inherits the gain. The 2024 vintage of our families also forecasts earnings surprises better, although the interval of this gain includes zero on calls that no vintage read. It forecasts returns no better, so point-in-time vintages matter most for retrieval and little for forecasts of returns.

## Related

- [RAG-IT: Retrieval-Augmented Instruction Tuning for Automated Financial Analysis - A Case Study for the Semiconductor Sector](https://www.ml-quant.com/papers/arxiv/2412.08179/): The study introduces a new method for automating earnings reports analysis using Large Language Models, with promising initial findings.
- [Llemma: An Open Language Model For Mathematics](https://www.ml-quant.com/papers/arxiv/2310.10631/): Open Math Language Model: The article discusses Llemma, a superior language model for mathematics that can prove theorems without additional fine-tuning.
- [Does Fine-Tuning LLMs on New Knowledge Encourage Hallucinations?](https://www.ml-quant.com/papers/arxiv/2405.05904/): Research shows that large language models have difficulty acquiring new factual knowledge through fine-tuning, learning new information slower than consistent knowledge, and are more likely to hallucinate, indicating the risks of introducing new facts through fine-tuning.
- [TableLlama: Towards Open Large Generalist Models for Tables](https://www.ml-quant.com/papers/arxiv/2311.09206/): The paper presents TableLlama, an open-source large language model fine-tuned for table-based tasks, and introduces a new dataset, TableInstruct, which improves the performance and generalizability of these models.
- [AgentGen: Enhancing Planning Abilities for Large Language Model based Agent via Environment and Task Generation](https://www.ml-quant.com/papers/arxiv/2408.00764/): Enhancing LLM Planning: The study improves the planning abilities of Large Language Models (LLMs) using instruction tuning and a framework called AgentGen, which generates diverse environments and planning tasks.
- [Designing Heterogeneous LLM Agents for Financial Sentiment Analysis](https://www.ml-quant.com/papers/arxiv/2401.05799/): A study suggests using large language models without fine-tuning for financial sentiment analysis, offering a design framework that enhances accuracy.