---
title: THEATRON: A Benchmark for Evaluating Persona Persistence in Long-Horizon LLM Decision-Making
url: https://www.ml-quant.com/papers/arxiv/2611.11487/
site: ML-Quant (https://www.ml-quant.com)
updated: 2026-11-14
license: Summaries CC BY 4.0; links go to the original sources
index: https://www.ml-quant.com/llms.txt
identifier: arXiv:2611.11487
source_url: https://arxiv.org/abs/2611.11487
featured: 2026-11-13
citations: unknown
topic: ML & AI Methods
---


# THEATRON: A Benchmark for Evaluating Persona Persistence in Long-Horizon LLM Decision-Making

A financial-replay benchmark reveals that persona conditioning shifts LLM behavior but does not reliably produce stable, coherent persona-specific policies.

- Source: https://arxiv.org/abs/2611.11487
- Identifier: arXiv:2611.11487
- Released: 2026-11-10
- First featured: Quant Letter No. 139 (2026-11-13): https://www.ml-quant.com/issues/2026-11-13/
- Citations (Semantic Scholar): not tracked
- Published in: not yet
- Topic: ML & AI Methods
- Authors: Yuyan Wang, Yuechen Jiang, Zhiwei Liu, Jimin Huang, Sophia Ananiadou

## Abstract (arXiv, CC0)

Existing evaluations often test persona expression rather than whether persona information persists in extended decision-making. We introduce THEATRON, a controlled benchmark that uses financial replay to evaluate persona persistence in long-horizon sequential decision-making. In these environments, models conditioned on fixed behavioral-finance personas observe shared daily market evidence and trajectory-specific account-state feedback and make sequential decisions over multi-month trajectories. We evaluate Zero-Shot, One-Shot, and Chain-of-Thought persona injection across four LLMs, using cumulative-return and action trajectories to diagnose within-persona stability, cross-persona separability, and action collapse. Persona conditioning produces systematic behavioral shifts beyond a no-persona baseline, and persona-level separation generally exceeds the variation induced by semantically equivalent descriptions. Nevertheless, these shifts do not reliably form coherent persona-specific policies: apparently stable separation can arise from stereotyped action collapse, while diverse policies can exhibit noisy trajectory switching. These findings expose a gap between observable persona-induced behavior and persistent, context-sensitive persona-conditioned decision policies. Code and benchmark data are publicly available at: https://github.com/yuyan12138/theatron

## Related

- [AgentClinic: a multimodal agent benchmark to evaluate AI in simulated clinical environments](https://www.ml-quant.com/papers/arxiv/2405.07960/): AI Evaluation in Clinical Environments: The paper introduces AgentClinic, a benchmark for assessing large language models in simulated clinical environments, highlighting the significant impact of biases on diagnostic accuracy and patient interactions.
- [Learning Performance-Improving Code Edits](https://www.ml-quant.com/papers/arxiv/2302.07867/): The research presents a framework for optimizing programs using large language models, achieving a mean speedup of 6.86, outperforming average individual programmers.
- [Generative agent-based modeling with actions grounded in physical, social, or digital space using Concordia](https://www.ml-quant.com/papers/arxiv/2312.03664/): Concordia is a library designed to help build and operate Generative Agent-Based Models (GABMs), using Large Language Models (LLMs) to simulate physical or digital environments.
- [Jamba-1.5: Hybrid Transformer-Mamba Models at Scale](https://www.ml-quant.com/papers/arxiv/2408.12570/): Transformer-Mamba Models: Jamba-1.5 is a new large language model with enhanced conversational and instruction-following capabilities, featuring a unique quantization technique for cost-effective inference.
- [MindSearch: Mimicking Human Minds Elicits Deep AI Searcher](https://www.ml-quant.com/papers/arxiv/2407.20183/): Mimicking Human Minds for Search: MindSearch is a Large Language Model-based framework that simulates human cognitive processes for web information seeking, greatly enhancing response quality.
- [What Do Foundation Models for Market Microstructure Learn? A Controlled Study with Synthetic Limit Order Books](https://www.ml-quant.com/papers/arxiv/2610.20104/): Autoregressive transformers trained on limit-order-book message streams learn amortized Bayesian inference over market regimes, matching optimal prediction and enabling accurate parameter calibration.