PulseExploreJournal ClubDebatesTrendingResearchersJournals
Instagram
HomeExploreJournal ClubTrending
Synapse
⌘+K
Synapse
May 7, 2026Computers and Education Artificial Intelligence0 citationsOpen Access

Same AI, Different Pathways: Unpacking Mechanisms of AI-Mediated Learning across Discipline-Institution Contexts

View Full Paper
QSQinjie Shen

Key Points

  • This research aims to uncover how AI literacy affects learning behaviors across different educational contexts.
  • Conducted a mixed-methods study involving surveys and interviews with Design (n=221) and Business students (n=222) in Thailand.
  • Analyzed data using multigroup structural equation modeling and thematic analysis of semi-structured interviews.
  • AI literacy significantly improves prompting proficiency and verification behavior (p < .001).
  • Trust calibration enhances coursework outcomes in Business, while verification behavior impacts task quality in Design.
  • Findings highlight the need for context-specific teaching strategies focusing on AI literacy.

Abstract

Large language models (LLMs) are transforming higher education, yet their learning benefits likely depend on students’ AI literacy and how they prompt and verify AI outputs. This mixed-methods study investigates how AI literacy relates to prompting proficiency and verification behavior, and how these behaviors operate through two mechanisms, trust calibration and extraneous cognitive load, to predict coursework performance across two discipline–institution contexts in Thailand. The author surveyed Design students (n = 221) and Business students (n = 222) and analyzed the data using multigroup structural equation modeling, complemented by thematic analysis of semi-structured interviews. Results indicated that AI literacy significantly predicted both prompting proficiency and verification behavior (p < .001). Prompting proficiency was positively associated with trust calibration, whereas verification behavior was negatively associated with extraneous cognitive load, and the corresponding indirect effects were supported. Context-specific patterns also emerged: in the Design context, verification behavior showed a stronger direct association with task quality, while in the Business context, trust calibration was the stronger predictor of assignment quality. Interview evidence helped explain these differences. Design students used ChatGPT primarily to accelerate ideation and refinement, whereas Business students used it to support structured analysis and to make their work more auditable. Across both contexts, verification functioned as a metacognitive safeguard that reduced overload and stabilized accuracy. These findings suggest that teaching AI literacy in higher education should emphasize rubric-guided prompting, verification routines, and calibrated trust to balance efficiency with deeper engagement, with attention to context-specific pedagogical demands. • Mixed-methods study examining AI-mediated learning in Design and Business education • AI literacy enhances prompting proficiency and verification behavior across contexts • Prompting and verification jointly calibrate trust and reduce extraneous cognitive load • Trust calibration predicts outcomes in Business, verification behavior in Design • Proposes AI literacy as a holistic competence integrating cognition and ethics

Ask AI
Helpful
Bookmark
Share
View Full Paper

Cite This Study

Qinjie Shen (2026) studied this question.

synapsesocial.com/papers/69fbef86164b5133a91a36fchttps://doi.org/10.1016/j.caeai.2026.100601
Ask AI
Helpful
Bookmark
Share
View Full Paper

Also Consider

Synapse has enriched 5 closely related papers on similar clinical questions. Consider them for comparative context:

  1. 1Cognitive ease at a cost: LLMs reduce mental effort but compromise depth in student scientific inquiry2024 · 206 citations
  2. 2Detecting hallucinations in large language models using semantic entropy2024 · 794 citations
  3. 3Humans and Automation: Use, Misuse, Disuse, Abuse1997 · 4,336 citations
  4. 4ChatGPT as a Stable and Fair Tool for Automated Essay Scoring2025 · 20 citations
  5. 5Intraclass correlations: Uses in assessing rater reliability.1979 · 23,299 citations