PulseExploreJournal ClubDebatesTrendingResearchersJournals
Instagram
HomeExploreJournal ClubTrending
Synapse
⌘+K
Synapse
July 1, 2023264 citations

Can Large Language Models Provide Feedback to Students? A Case Study on ChatGPT

View Full Paper
WDWei DaiJLJionghao LinHJHua Jin

Key Points

  • This research aims to assess the effectiveness of ChatGPT in generating educational feedback to improve student learning outcomes.
  • Investigation of ChatGPT's feedback capabilities compared to human instructors.
  • Assessment of agreement between ChatGPT and instructors on students' assignment topics.
  • Evaluation of the feedback on the learning process from ChatGPT.
  • ChatGPT generated more detailed feedback than human instructors.
  • High agreement observed between ChatGPT and instructors in assessing assignment topics.
  • ChatGPT provided valuable feedback on task completion processes, potentially aiding in skill development.

Abstract

Educational feedback has been widely acknowledged as an effective approach to improving student learning. However, scaling effective practices can be laborious and costly, which motivated researchers to work on automated feedback systems (AFS). Inspired by the recent advancements in the pre-trained language models (e.g., ChatGPT), we posit that such models might advance the existing knowledge of textual feedback generation in AFS because of their capability to offer natural-sounding and detailed responses. Therefore, we aimed to investigate the feasibility of using ChatGPT to provide students with feedback to help them learn better. Our results show that i) ChatGPT is capable of generating more detailed feedback that fluently and coherently summarizes students' performance than human instructors; ii) ChatGPT achieved high agreement with the instructor when assessing the topic of students' assignments; and iii) ChatGPT could provide feedback on the process of students completing the task, which might benefit students developing learning skills.

Ask AI
Helpful
Bookmark
Share
View Full Paper

Cite This Study

Dai et al. (2023) studied this question.

synapsesocial.com/papers/6a032ea3bc3ffe278e654fb9https://doi.org/10.1109/icalt58122.2023.00100
Ask AI
Helpful
Bookmark
Share
View Full Paper