PulseExploreJournal ClubDebatesTrendingResearchersJournals
Instagram
HomeExploreJournal ClubTrending
Synapse
⌘+K
Synapse
November 12, 2024Journal of Computer Assisted Learning31 citations

A systematic review and meta‐analysis of AI‐enabled assessment in language learning: Design, implementation, and effectiveness

View Full Paper
ACAngxuan ChenYZYuyue ZhangJJJiyou Jia

Key Points

Key points are not available for this paper at this time.

Abstract

Abstract Background Language assessment plays a pivotal role in language education, serving as a bridge between students' understanding and educators' instructional approaches. Recently, advancements in Artificial Intelligence (AI) technologies have introduced transformative possibilities for automating and personalising language assessments. Objectives This article aims to explore the design and implementation of AI‐enabled assessment tools in language education, filling the research gaps regarding the impact of assessment type, intervention duration, education level, and first language learner/second language learner (L1/L2) on the effectiveness of AI‐enabled assessment tools in enhancing students' language learning outcome. Methods This study conducted a systematic review and meta‐analysis to examine 25 empirical studies from January 2012 to March 2024 from six databases (including EBSCO, ProQuest, Scopus, Web of Science, ACM Digital Library and CNKI). Results The predominant design in AI‐driven assessment tools is the structural AI architecture. These tools are most frequently deployed in classroom settings for upper primary students within a short duration. A subsequent meta‐analysis showed a medium overall effect size (Hedges's g = 0.390, p < 0.001) for the application of AI‐enabled assessment tools in enhancing students' language learning, underscoring their significant impact on language learning outcomes. This evidence robustly supports the practical utility of these tools in educational contexts. Conclusions The analysis of several moderator variables (i.e., assessment type, intervention duration, educational level and L1/L2 learners) and potential impacts on language learning performance indicates that AI‐enabled assessment could be more useful in language education with a proper implementation design. Future research could investigate diverse instructional designs for integrating AI‐based assessment tools in language education.

Ask AI
Helpful
Bookmark
Share
View Full Paper

Cite This Study

Chen et al. (2024) studied this question.

synapsesocial.com/papers/69d97f668988aeabbe685833https://doi.org/10.1111/jcal.13064
Ask AI
Helpful
Bookmark
Share
View Full Paper

Also Consider

Synapse has enriched 5 closely related papers on similar clinical questions. Consider them for comparative context:

  1. 1End-to-End Transformer-Based Models in Textual-Based NLP2023 · 161 citations
  2. 2A Social Robot System for Modeling Children's Word Pronunciation: Socially Interactive Agents Track2018 · 18 citations
  3. 3The file drawer problem and tolerance for null results.1979 · 8,718 citations
  4. 4Automated essay evaluation with semantic analysis2017 · 102 citations
  5. 5Opportunities and obstacles to consider when using peer- and self-assessment to improve student learning: Case studies into teachers' implementation2013 · 192 citations