arXivLLMs & Text

EDINET-Bench: Evaluating LLMs on Complex Financial Tasks using Japanese Financial Statements

EDINET-Bench, a new open-source Japanese financial benchmark, is introduced to assess large language models' performance in financial tasks, showing these models' limitations in real-world financial applications.