---
title: ETH-TraceBench: A Large-Scale Event-Stream Benchmark for Ethereum DeFi under Temporal, Protocol, and Contract Shift
url: https://www.ml-quant.com/papers/arxiv/2609.23659/
site: ML-Quant (https://www.ml-quant.com)
updated: 2026-09-26
license: Summaries CC BY 4.0; links go to the original sources
index: https://www.ml-quant.com/llms.txt
identifier: arXiv:2609.23659
source_url: https://arxiv.org/abs/2609.23659
featured: 2026-09-25
citations: 0
topic: Crypto & DeFi
---


# ETH-TraceBench: A Large-Scale Event-Stream Benchmark for Ethereum DeFi under Temporal, Protocol, and Contract Shift

Introduces a large-scale benchmark on 1.35 billion Ethereum transactions to evaluate DeFi representations under temporal, protocol, and contract drift, revealing model degradation on unseen pools.

- Source: https://arxiv.org/abs/2609.23659
- Identifier: arXiv:2609.23659
- Released: 2026-09-22
- First featured: Quant Letter No. 132 (2026-09-25): https://www.ml-quant.com/issues/2026-09-25/
- Citations (Semantic Scholar): 0
- Published in: not yet
- Topic: Crypto & DeFi
- Authors: Kemal Kirtac, Carsten Maple

## Abstract (arXiv, CC0)

Ethereum decentralized finance (DeFi) provides a public, time-stamped record of transaction-level event streams, but the same public symbols can create strong machine-learning shortcuts. We introduce ETH-TraceBench, a benchmark for evaluating Ethereum DeFi representations under temporal, protocol, pool/infrastructure, and symbolic shift. The raw event universe covers January 2021-December 2025 and contains 1.35 billion transactions with logs and 5.01 billion raw log rows. Model evaluation uses a fixed 911,267-instance supervised sample, training on 2021-2024, selecting models on 2025H1, and testing on 2025H2. Simple models perform strongly on the aggregate temporal test: TraceStats-GB reaches 0.953 macro-F1 and TopicEmitterHashMLP 0.959 on the canonical DEX test set. Performance drops sharply under protocol novelty, with macro-F1 of 0.794, 0.743, and 0.766 for TraceStats-GB, TopicEmitterTrace-SGD, and TopicEmitterHashMLP, while strict unseen-pool scores remain 0.927, 0.897, and 0.935. Uniswap v4 and Ekubo v1, both absent from supervised training, are materially harder than the full test. Jointly masking emitter and topic identity reduces DEX macro-F1 to 0.916 and liquidation macro-F1 to 0.774 for TopicEmitterTrace-SGD. A standard Transformer over log-index-ordered events provides no consistent advantage over a deterministic shuffle of the same events, indicating that high aggregate scores can arise without sophisticated chronological modeling. A natural-prevalence audit estimates 2025H2 DEX prevalence among logged Ethereum transactions at about 22.5%, and a deterministic 400-transaction audit finds complete agreement with task label sources and independently re-queried raw-log counts. ETH-TraceBench therefore treats difficult transfer and controlled-input conditions, rather than a single aggregate score, as the main evaluation target.

## Related

- [Price Discovery in Cryptocurrency Markets](https://www.ml-quant.com/papers/arxiv/2506.08718/): Centralized markets typically lead in Ethereum price discovery compared to decentralized exchanges, affecting liquidity, arbitrage, and market efficiency.
- [Private MEV Protection RPCs: Benchmark Stud](https://www.ml-quant.com/papers/arxiv/2505.19708/): OFA Implications: The Ethereum DeFi sector has seen a shift with 80% of transactions now using private RPCs, emphasizing the impact of Order Flow Auctions on transaction efficiency and quality.
- [Price manipulation schemes of new crypto-tokens in decentralized exchanges](https://www.ml-quant.com/papers/arxiv/2502.10512/): An analysis of decentralized exchanges (DEXs) shows high risks in investing in new tokens due to liquidity traps and fraud, emphasizing the importance of understanding the financial dynamics and risks of decentralized markets.
- [Trust Dynamics in Cryptocurrency Markets: Centralized vs. Decentralized Exchanges](https://www.ml-quant.com/papers/arxiv/2404.17227/): The study investigates the impact of incidents on trust and trading behaviors in centralized and decentralized cryptocurrency exchanges.
- [Deep Learning for Dynamic NFT Valuation](https://www.ml-quant.com/papers/arxiv/2312.05346/): The research suggests a deep learning model to predict non-fungible tokens (NFTs) prices using Ethereum blockchain and OpenSea data, which could be useful in decentralized finance (DeFi).
- [Cash vs. Crypto in DeFi](https://www.ml-quant.com/papers/ssrn/4478395/): The article discusses how cryptocurrencies can improve societal functions compared to traditional currencies and emphasizes the innovations needed to build confidence in decentralized finance.