Exploring AI-Generated Text in Student Writing: How Does AI Help?

03/10/2023
by   David James Woo, et al.
0

English as foreign language_EFL_students' use of text generated from artificial intelligence_AI_natural language generation_NLG_tools may improve their writing quality. However, it remains unclear to what extent AI-generated text in these students' writing might lead to higher-quality writing. We explored 23 Hong Kong secondary school students' attempts to write stories comprising their own words and AI-generated text. Human experts scored the stories for dimensions of content, language and organization. We analyzed the basic organization and structure and syntactic complexity of the stories' AI-generated text and performed multiple linear regression and cluster analyses. The results show the number of human words and the number of AI-generated words contribute significantly to scores. Besides, students can be grouped into competent and less competent writers who use more AI-generated text or less AI-generated text compared to their peers. Comparisons of clusters reveal some benefit of AI-generated text in improving the quality of both high-scoring students' and low-scoring students' writing. The findings can inform pedagogical strategies to use AI-generated text for EFL students' writing and to address digital divides. This study contributes designs of NLG tools and writing activities to implement AI-generated text in schools.

READ FULL TEXT
research
06/04/2022

Student-AI Creative Writing: Pedagogical Strategies for Applying Natural Language Generation in Schools

AI natural language generation (NLG) is a process where computer systems...
research
02/09/2023

Better by you, better than me, chatgpt3 as writing assistance in students essays

Aim: To compare students' essay writing performance with or without empl...
research
03/28/2023

ChatGPT or academic scientist? Distinguishing authorship with over 99 accuracy using off-the-shelf machine learning tools

ChatGPT has enabled access to AI-generated writing for the masses, and w...
research
03/09/2023

Seeing ChatGPT Through Students' Eyes: An Analysis of TikTok Data

Advanced large language models like ChatGPT have gained considerable att...
research
08/07/2023

Storyfier: Exploring Vocabulary Learning Support with Text Generation Models

Vocabulary learning support tools have widely exploited existing materia...
research
08/06/2019

Word Embedding for Response-To-Text Assessment of Evidence

Manually grading the Response to Text Assessment (RTA) is labor intensiv...
research
01/25/2021

Writers Gonna Wait: The Effectiveness of Notifications to Initiate Aversive Action in Writing Procrastination

This paper evaluates the use of notifications to reduce aversive-task-pr...

Please sign up or login with your details

Forgot password? Click here to reset