RSS West Midlands: Judging a book by its cover: How much of REF 'research quality' is really 'journal reputation'?

Share Download as iCal file
Click the icons above to Share, Tweet or add this event to your calendar (iCal)
Featured events, RSS local group meetings

Wednesday 30 October 2019, 05:00pm - 06:30pm

Location MS.05 Zeeman Building, University of Warwick, Coventry, CV4 7AL

Speakers: David Selby and Professor David Firth, University of Warwick

The Research Excellence Framework (REF) is a periodic UK-wide assessment of the quality of published research in universities. The most recent REF was in 2014, and the next will be in 2021. The published results of REF2014 include a categorical 'quality profile' for each unit of assessment (typically a university department), reporting what percentage of the unit's REF-submitted research outputs were assessed as being at each of four quality levels (labelled 4*, 3*, 2* and 1*). Also in the public domain are the original submissions made to REF2014, which include — for each unit of assessment — publication details of the REF-submitted research outputs.
In this study we address the question: to what extent can a REF quality profile for research outputs be attributed to the journals in which (most of) those outputs were published?

The data are the published submissions and results from REF2014. The main statistical challenge comes from the fact that REF quality profiles are available only at the aggregated level of whole units of assessment: the REF panel's assessment of each individual research output is not made public. Our research question is thus an 'ecological inference' problem, which demands special care in model formulation and methodology. The analysis is based on logit models in which journal-specific parameters are regularized via prior 'pseudo-data'. We develop a lack-of-fit measure for the extent to which REF scores appear to depend on publication venues rather than research quality or institution-level differences. Results are presented for several research fields.

Organiser Name Ian Hamilton

Email Address This email address is being protected from spambots. You need JavaScript enabled to view it.

Organising Group(s) RSS West Midlands local group





Join the RSS

Join the RSS

Become part of an organisation which works to advance statistics and support statisticians

Copyright 2019 Royal Statistical Society. All Rights Reserved.
12 Errol Street, London, EC1Y 8LX. UK registered charity in England and Wales. No.306096

Twitter Facebook YouTube RSS feed RSS feed RSS newsletter

We use cookies to understand how you use our site and to improve your experience. By continuing to use our site, you accept our use of cookies and Terms of Use.