Exploring the Efficacy of ChatGPT in Analyzing Student Teamwork Feedback with an Existing Taxonomy

05/09/2023
by   Andrew Katz, et al.
0

Teamwork is a critical component of many academic and professional settings. In those contexts, feedback between team members is an important element to facilitate successful and sustainable teamwork. However, in the classroom, as the number of teams and team members and frequency of evaluation increase, the volume of comments can become overwhelming for an instructor to read and track, making it difficult to identify patterns and areas for student improvement. To address this challenge, we explored the use of generative AI models, specifically ChatGPT, to analyze student comments in team based learning contexts. Our study aimed to evaluate ChatGPT's ability to accurately identify topics in student comments based on an existing framework consisting of positive and negative comments. Our results suggest that ChatGPT can achieve over 90% accuracy in labeling student comments, providing a potentially valuable tool for analyzing feedback in team projects. This study contributes to the growing body of research on the use of AI models in educational contexts and highlights the potential of ChatGPT for facilitating analysis of student comments.

READ FULL TEXT
research
08/04/2021

The Potential of Using Vision Videos for CrowdRE: Video Comments as a Source of Feedback

Vision videos are established for soliciting feedback and stimulating di...
research
10/31/2021

Classifying YouTube Comments Based on Sentiment and Type of Sentence

As a YouTube channel grows, each video can potentially collect enormous ...
research
01/23/2021

Are Top School Students More Critical of Their Professors? Mining Comments on RateMyProfessor.com

Student reviews and comments on RateMyProfessor.com reflect realistic le...
research
06/12/2023

The BEA 2023 Shared Task on Generating AI Teacher Responses in Educational Dialogues

This paper describes the results of the first shared task on the generat...
research
03/24/2023

'Team-in-the-loop' organisational oversight of high-stakes AI

Oversight is rightly recognised as vital within high-stakes public secto...
research
05/23/2019

Generative Grading: Neural Approximate Parsing for Automated Student Feedback

Open access to high-quality education is limited by the difficulty of pr...

Please sign up or login with your details

Forgot password? Click here to reset