Research assessment and the activity hypothesis

Purpose – Analyses of the results of research assessment exercises (RAEs) carried out in the UK in 1996 and 2001 supported a simple hypothesis, that the grade awarded to a university department can be related to its level of activity in terms of, for example, number of research students, research studentships secured, research degrees awarded, research funded from external sources, and the profile of publications. The purpose of this paper is to consider the extent to which these relationships prevailed for the most recent RAE in 2008. Design/methodology/approach – Information from 157 departments from five subject areas was subjected to extensive correlation analysis and regression modelling, informed by the findings from analyses of previous RAEs. Findings – Although the information submitted by universities to RAE 2008 was the same as for previous RAEs, a different methodology was employed for assessing their performance. Establishing a relationship between the assessments of research quality of departments and measures of activity was more challenging than previously. Differences between subject areas were large and it was not possible to develop a single model applicable to the five subject areas. Practical implications – Despite the relationship with performance being much less obvious than for previous RAEs, activity levels are important to success, but in different ways in different subject areas. Originality/value – The paper indicates the extent to which expectations about the importance of key research-related activities, expressed as simple quantitative measures, are reflected in qualitative assessments of performance, given the increasing complexity and subtlety of the assessment process.