PulseExploreJournal ClubDebatesTrendingResearchersJournals
Instagram
HomeExploreJournal ClubTrending
Synapse
⌘+K
Synapse
September 10, 20250 citationsOpen Access

Large language models accurately identify decision reasons in verbal reports

View Full Paper
KFKamil FuławkaRHRalph HertwigDWDirk U. Wulff

Key Points

  • The validated large language model identifies decision reasons in over 92% of trials based on verbal reports.
  • Reason usage varies by the structure of the choice problem rather than individual differences, highlighting the model's effectiveness.
  • A predictive model based on problem-specific reason profiles surpasses prospect theory in out-of-sample prediction accuracy.
  • This work illustrates the potential of verbal reports as a data source for better understanding human decision-making.

Abstract

Understanding the reasons behind human choices under risk is a central goal of the decision sciences, yet traditional methods relying on behavioral data are limited by strict invariance assumptions. Here, we introduce a scalable method using large language models (LLMs) to analyze verbal reports and identify the articulated reasons for choices between monetary lotteries. We show that a validated LLM accurately identifies predefined decision reasons in participants' free-text reports, aligning with their actual choices in over 92\% of trials. Our analysis reveals that reason usage varies systematically and is driven more by the choice problem's structure than by individual differences. A predictive model based on these problem-specific reason profiles outperforms prospect theory in out-of-sample prediction. This work demonstrates that verbal reports are a rich data source and that LLMs can unlock their potential, challenging foundational invariance assumptions and paving the way for more context-aware models of human decision-making.

Ask AI
Helpful
Bookmark
Share
View Full Paper

Cite This Study

Fuławka et al. (2025) studied this question.

synapsesocial.com/papers/68c1d5fe54b1d3bfb60f94b6https://doi.org/10.31234/osf.io/yuzmw_v1
Ask AI
Helpful
Bookmark
Share
View Full Paper

Also Consider

Synapse has enriched 5 closely related papers on similar clinical questions. Consider them for comparative context:

  1. 1Exploring variability in risk taking with large language models.2024 · 10 citations
  2. 2Bayesian Statistical Modeling with Predictors from LLMs2024
  3. 3Predicting and Understanding Human Action Decisions: Insights from Large Language Models and Cognitive Instance-Based Learning2024
  4. 4Can large language models capture human risk preferences? A cross-cultural study2026
  5. 5Evaluating Large Language Models as Post Hoc Explainability Interfaces for Credit Risk Models2026 · 1 citations