Terms in journal articles associating with high quality: Can qualitative research be world-leading?

12/11/2022
by   Mike Thelwall, et al.
0

Purpose: Scholars often aim to conduct high quality research and their success is judged primarily by peer reviewers. Research quality is difficult for either group to identify, however, and misunderstandings can reduce the efficiency of the scientific enterprise. In response, we use a novel term association strategy to seek quantitative evidence of aspects of research that associate with high or low quality. Design/methodology/approach: We extracted the words and 2-5-word phrases most strongly associating with different quality scores in each of 34 Units of Assessment (UoAs) in the Research Excellence Framework (REF) 2021. We extracted the terms from 122,331 journal articles 2014-2020 with individual REF2021 quality scores. Findings: The terms associating with high- or low-quality scores vary between fields but relate to writing styles, methods, and topics. We show that the first-person writing style strongly associates with higher quality research in many areas because it is the norm for a set of large prestigious journals. We found methods and topics that associate with both high- and low-quality scores. Worryingly, terms associating with educational and qualitative research attract lower quality scores in multiple areas. REF experts may rarely give high scores to qualitative or educational research because the authors tend to be less competent, because it is harder to make world leading research with these themes, or because they do not value them. Originality: This is the first investigation of journal article terms associating with research quality.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
12/11/2022

Are internationally co-authored journal articles better quality? The UK case 2014-2020

International collaboration is sometimes encouraged in the belief that i...
research
12/11/2022

Do bibliometrics introduce gender, institutional or interdisciplinary biases into research evaluations?

Systematic evaluations of publicly funded research typically employ a co...
research
12/11/2022

Why are co-authored academic articles more cited: Higher quality or larger audience?

Co-authored articles tend to be more cited in many academic fields, but ...
research
12/11/2022

Is Research Funding Always Beneficial? A Cross-Disciplinary Analysis of UK Research 2014-20

The search for and management of external funding now occupies much valu...
research
03/22/2022

Bibliometric Profile of an Emerging Journal: Participatory Educational Research

Participatory Educational Research journal is one of the journals that c...
research
07/12/2021

Tortured phrases: A dubious writing style emerging in science. Evidence of critical issues affecting established journals

Probabilistic text generators have been used to produce fake scientific ...
research
06/23/2023

Judging a book by its cover: how much of REF `research quality' is really `journal prestige'?

The Research Excellence Framework (REF) is a periodic UK-wide assessment...

Please sign up or login with your details

Forgot password? Click here to reset