Semantic tone of research ‘environment’ submissions in the UK’s Research Evaluation Framework 2014
Thorpe,Andy Craig,Russell Hadikin,Glenn Batistič,S.
Thorpe,Andy
Craig,Russell
Hadikin,Glenn
Batistič,S.
Abstract
This article applies DICTION computer-assisted text analysis software to evaluate the tone of research ‘Environment’ submissions by Business and Management Studies schools in the UK’s 2014 Research Evaluation Framework. We find that submissions contain distinctive differences in semantic tone between high-ranked and low-ranked universities, particularly in terms of DICTION’s master variable, ACTIVITY. The language of high-ranked institutions has a tone of low ACTIVITY, whereas the language of low-ranked institutions has a tone of high ACTIVITY. More adjectives are used than expected: by high-ranked universities to bolster strong public reputations, and by low-ranked universities to atone for weaknesses. High-ranked universities are advantaged because they are more likely to be represented on assessing panels and be better-attuned to reader expectations. The results suggest that low-ranked universities could have achieved higher scores by reflecting on particular areas of word choice and the potential effects of those choices on assessors.
Description
Date
2018
Journal Title
Journal ISSN
Volume Title
Publisher
Research Projects
Organizational Units
Journal Issue
Keywords
RESEARCH QUALITY, UNIVERSITY, environment, evaluation, research, submissions, text analysis, tone
Citation
Thorpe, A, Craig, R, Hadikin, G & Batistič, S 2018, 'Semantic tone of research ‘environment’ submissions in the UK’s Research Evaluation Framework 2014', Research Evaluation, vol. 27, no. 2, pp. 53–62. https://doi.org/10.1093/reseval/rvx039