Robosourcing Educational Resources – Leveraging Large Language Models for Learnersourcing

11/09/2022
by   Paul Denny, et al.
0

In this article, we introduce and evaluate the concept of robosourcing for creating educational content. Robosourcing lies in the intersection of crowdsourcing and large language models, where instead of a crowd of humans, requests to large language models replace some of the work traditionally performed by the crowd. Robosourcing includes a human-in-the-loop to provide priming (input) as well as to evaluate and potentially adjust the generated artefacts; these evaluations could also be used to improve the large language models. We propose a system to outline the robosourcing process. We further study the feasibility of robosourcing in the context of education by conducting an evaluation of robosourced and programming exercises, generated using OpenAI Codex. Our results suggest that robosourcing could significantly reduce human effort in creating diverse educational content while maintaining quality similar to human-created content.

READ FULL TEXT
research
06/03/2022

Automatic Generation of Programming Exercises and Code Explanations using Large Language Models

This article explores the natural language generation capabilities of la...
research
02/14/2023

Learning gain differences between ChatGPT and human tutor generated algebra hints

Large Language Models (LLMs), such as ChatGPT, are quickly advancing AI ...
research
05/31/2023

Scaling Evidence-based Instructional Design Expertise through Large Language Models

This paper presents a comprehensive exploration of leveraging Large Lang...
research
05/19/2023

HaluEval: A Large-Scale Hallucination Evaluation Benchmark for Large Language Models

Large language models (LLMs), such as ChatGPT, are prone to generate hal...
research
05/22/2023

ChatGPT to Replace Crowdsourcing of Paraphrases for Intent Classification: Higher Diversity and Comparable Model Robustness

The emergence of generative large language models (LLMs) raises the ques...
research
08/25/2023

Prompting a Large Language Model to Generate Diverse Motivational Messages: A Comparison with Human-Written Messages

Large language models (LLMs) are increasingly capable and prevalent, and...
research
07/06/2023

Style Over Substance: Evaluation Biases for Large Language Models

As large language models (LLMs) continue to advance, accurately and comp...

Please sign up or login with your details

Forgot password? Click here to reset