Research Guides: Measuring Research Impact 1: Responsible Use of Metrics

Responsible Use of Metrics

Metrics are valuable and straightforward tools for measuring the quality and impact of research output. They offer a convenient means of comparing research by examining citations, online attention scores, or other numerical indicators. Metrics are widely utilized in recruitment, performance evaluation, promotion, and other decision-making processes to assess research groups, academic units, and universities. However, relying solely on metrics is insufficient for fair research assessment. The impact of research can manifest in diverse ways that are challenging to quantify.

Recommended Practice for Responsible Use of Metrics

Employ both quantitative (e.g. metrics) and qualitative (e.g. expert assessment) methods to evaluate research.
Leverage a variety of metrics from multiple databases to evaluate research impact, extending beyond publications to include datasets, software, etc. for a holistic assessment.
Exercise caution when interpreting citation counts, as high citation numbers are not solely indicative of supporting citing documents. They can also stem from documents presenting contrasting viewpoints or the author's self-citations.
Utilize normalized metrics for a fair comparison to offset variations and biases due to field of study, publication type, researchers' career stage, etc.
Avoid using journal-level metrics to evaluate article quality.
Stay updated on evolving research assessment trends and regularly review and update indicators to align with shifting research missions and goals.

San Francisco Declaration on Research Assessment (DORA) and Leiden Manifesto for Research Metrics are two prominent international frameworks advocating for responsible use of metrics. Watch the videos for more information.


Balanced, Broad, Responsible: A Practical Guide for Research Evaluators from FNR & DORA on YouTube.	The Leiden Manifesto for Research Metrics from Diana Hicks on Vimeo.