Loading presentation...

Present Remotely

Send the link below via email or IM


Present to your audience

Start remote presentation

  • Invited audience members will follow you as you navigate and present
  • People invited to a presentation do not need a Prezi account
  • This link expires 10 minutes after you close the presentation
  • A maximum of 30 users can follow your presentation
  • Learn more about this feature in our knowledge base article

Do you really want to delete this prezi?

Neither you, nor the coeditors you shared it with will be able to recover it again.


ALPSP talk


Claire Donovan

on 15 September 2016

Comments (0)

Please log in to add your comment.

Report abuse

Transcript of ALPSP talk

text crisis
For ethical impactology
'The Metric Tide' (Wilsdon
et al.
, 2015), Leiden Manifesto (Hicks,
et al.
, 2015) recommend a balanced approach to assessing impact:
narratives and available robust metrics

Responsible use of metrics
Committing metricide
For an ethical impactology
UK Research Councils
£3 billion per year

'Pathways to Impact'

Impact defined as ‘fostering global economic performance, and specifically the economic competitiveness of the United Kingdom, increasing the effectiveness of public services and policy, and enhancing quality of life, health and creative output’ (RCUK, 2016)
Research Excellence Framework (REF)
£1.5 billion 2015/16

Impact criterion first introduced in 2014
Quality = 65%
Environment = 15%
Impact = 20%

Impact defined as ‘an effect on, change or benefit to the economy, society, culture, public policy or services, health, the environment or quality of life, beyond academia’ (HEFCE, 2015)

Next REF no later than 2021; Impact = 25%?
…there will no doubt be widespread criticism of the “simple-minded” approach adopted, and work will start to “improve” the assessment of impact in the following REF. REF 2 will consequently be more elaborate, more burdensome and more time-consuming. It will also encourage more sophisticated game-playing.
(Martin, 2016, 17)
The rise of 'impactology'
the practice of assessing wider impacts, and the study of the practice of assessing wider impacts

impactologists - management, consultants, software, training

pressures to save time & money

metrics at the expense of more nuance and detail
REF2014 Impact: a world first but 'grudging support' for narrative approach (Oancea, 2016)

Perception of high opportunity costs

Academics weary of REF burden making metrics more attractive

Committing metricide?
(I + IF = M): Impactology + Impact Fatigue = Metricide
Best assessment practice = narratives & robust metrics

Metrics underdeveloped

Promise of altmetrics and social media data

Narratives a craft industry; metrics for mass production (Martin, 2011)

Australia's RQF development: complex narratives replaced by:
plant breeders' rights
registered designs
registered commercialization income
Impact aware culture
Innovation gone wrong?
Open definitions
Less regulation?
Responsible metrics
Full transcript