Skip to main content

Responsible research assessment

We are committed to assessing the quality of our research fairly and transparently.

The San Francisco Declaration on Research Assessment (DORA)

As a signatory of the San Francisco Declaration on Research Assessment (DORA), we support and promote the responsible use of metrics and quantitative indicators of research.

The Declaration recognises the need to improve the ways in which research is assessed. Since its development in 2012, it has become a worldwide initiative covering all scholarly disciplines and all key stakeholders including funders, publishers, professional societies, academic institutions and researchers.

DORA commits us to assessing research in all its forms through a process of qualitative review rather than using proxy measures of quality, such as publication in journals with a high impact factor.

By signing the San Francisco Declaration on Research Assessment (DORA), we confirm our commitment to ensuring that research outcomes are assessed based on their own merit, avoiding use of journal-based metrics. It also confirms our commitment to recognising the diverse suite of research outcomes generated by our research community when making funding, recruitment and promotion decisions. Our commitment to DORA reflects the importance we place on inclusive research and team science, aligned to our wish to support and enhance the career opportunities of all our staff, at all stages in their careers.

Professor Kim Graham Pro Vice-Chancellor Research, Innovation and Enterprise

Our commitments

As a University

  • We will not use journal-based metrics (e.g., journal impact factors) as surrogate measures of the quality of individual research articles when assessing an individual researcher’s contributions, including in recruitment, promotion or funding decisions.
  • We will be explicit about the criteria we use to reach recruitment, tenure, and promotion decisions, highlighting that the scientific content of a paper is more important than publication metrics or the reputation of the journal.
  • We will consider the value and impact of all research outputs (including datasets and software) and be attentive to a broad range of impact measures, including qualitative indicators of research impact, such as influence on policy and practice.

As individual researchers and decision-makers

  • We will make assessments based on scholarly content rather than publication metrics in decision-making (e.g., internal funding, recruitment, tenure, or promotion).
  • We will, wherever appropriate, cite primary literature in which observations and research findings are first reported rather than reviews, thereby giving credit where credit is due.
  • We will use a diverse range of article metrics and indicators on personal and supporting statements as evidence of the impact of individual published articles and other research outputs.
  • We will challenge research assessment practices that rely on journal impact factors and promote best practice that focuses on the value and influence of a diversity of research outputs.

Key progress

Since Cardiff University signed DORA in November 2019, we have made significant progress towards implementing its recommendations. To ensure that we do not consider journal-based metrics in assessing an individual researcher’s contributions, we have reviewed and revised existing processes and documentation that relied (either explicitly or implicitly) on journal impact factors. We have:

  • updated probation guidance for academic staff, specifically citing DORA
  • created a set of recommended responsible research assessment interview questions
  • revised generic job descriptions for teaching and research staff to place the emphasis on the content of the research rather than its outlet
  • incorporated responsible research assessment into recruitment and promotions panel training.

Colleagues on the University Academic Promotions Committee have discussed their engagement with DORA, noting its positive impact on promotions assessment practices:

The University has made it very clear that our commitment to DORA means that we will evaluate applicants on the quality of their research, not publication metrics or the identity of the journal in which the research is published. This has had a positive impact on the quality of the external assessments and has enabled the Academic Promotions Committee to reach fair decisions based on excellence.

Professor Karen Holford Professor

We have also created a Policy Statement on Responsible Research Assessment to inform research staff and decision-makers on the responsible use of research metrics directing research evaluation and assessment undertaken at the University.

The University has established a DORA Working Group comprising academic and Professional Services staff across a range of career stages. The Working Group is chaired by the Dean of Research Environment and Culture, Professor Karin Wahl-Jorgensen.

More information

For queries or further information about DORA, please contact:

Dr Karen Desborough

Responsible Research Assessment Officer