A Systematic Review on Reproducibility in Child-Robot Interaction

09/04/2023
by   Micol Spitale, et al.
0

Research reproducibility - i.e., rerunning analyses on original data to replicate the results - is paramount for guaranteeing scientific validity. However, reproducibility is often very challenging, especially in research fields where multi-disciplinary teams are involved, such as child-robot interaction (CRI). This paper presents a systematic review of the last three years (2020-2022) of research in CRI under the lens of reproducibility, by analysing the field for transparency in reporting. Across a total of 325 studies, we found deficiencies in reporting demographics (e.g. age of participants), study design and implementation (e.g. length of interactions), and open data (e.g. maintaining an active code repository). From this analysis, we distill a set of guidelines and provide a checklist to systematically report CRI studies to help and guide research to improve reproducibility in CRI and beyond.

READ FULL TEXT
research
01/22/2022

What and How Are We Reporting in HRI? A Review and Recommendations for Reporting Recruitment, Compensation, and Gender

Study reproducibility and generalizability of results to broadly inclusi...
research
03/14/2021

A Systematic Review of Reproducibility Research in Natural Language Processing

Against the background of what has been termed a reproducibility crisis ...
research
02/09/2018

Don't Repeat Yourself: Seamless Execution and Analysis of Extensive Network Experiments

This paper presents MACI, the first bespoke framework for the management...
research
07/16/2019

Evaluating the Reproducibility of Research in Obstetrics and Gynecology

Objective: Reproducibility is a core tenet of scientific research. A rep...
research
04/14/2020

Fidelity of Statistical Reporting in 10 Years of Cyber Security User Studies

Studies in socio-technical aspects of security often rely on user studie...
research
04/12/2017

Lago Distributed Network Of Data Repositories

We describe a set of tools, services and strategies of the Latin America...
research
07/16/2018

Use Factorial Design To Improve Experimental Reproducibility

Systematic differences in experimental materials, methods, measurements,...

Please sign up or login with your details

Forgot password? Click here to reset