{"id":861,"date":"2026-02-10T08:08:15","date_gmt":"2026-02-10T08:08:15","guid":{"rendered":"https:\/\/sites.utu.fi\/openutu\/?p=861"},"modified":"2026-02-10T08:47:30","modified_gmt":"2026-02-10T08:47:30","slug":"rethinking-research-assessment-and-impact","status":"publish","type":"post","link":"https:\/\/sites.utu.fi\/openutu\/2026\/02\/10\/rethinking-research-assessment-and-impact\/","title":{"rendered":"Rethinking Research Assessment and Impact"},"content":{"rendered":"\n<p><em>A special episode of our \u201cWow, What an Impact!\u201d podcast (Vau, mik\u00e4 vaikutus!) \u201cHow to build a successful impact strategy?\u201d was aired on 19.1.2026. In the episode we talked about how research quality and impact can be assessed with our guest, Dr Giovanna Lima, Programme Manager of DORA. Listen the episode <a href=\"https:\/\/soundcloud.com\/turun-yliopisto\/vau-mika-vaikutus-how-to-build-a-succesful-impact-strategy-special-episode-in-english\" data-type=\"link\" data-id=\"https:\/\/soundcloud.com\/turun-yliopisto\/vau-mika-vaikutus-how-to-build-a-succesful-impact-strategy-special-episode-in-english\" rel=\"noopener\">here<\/a>.<\/em><\/p>\n\n\n\n<p>Research impact is not just about ticking boxes or counting outputs. Instead, it is about connecting scientific knowledge with societal knowledge, recognising that different forms of knowledge complement each other and can jointly benefit society. This perspective challenges many traditional academic practices. While universities increasingly emphasise societal impact in their mission statements, evaluation systems often continue to reward narrow indicators, such as publication counts or journal-based metrics. As Giovanna points out in the episode, this misalignment sends mixed signals to researchers: impact is encouraged rhetorically, but rarely recognised in practice.<\/p>\n\n\n\n<p><strong>What is DORA \u2013 and why does it matter?<\/strong><\/p>\n\n\n\n<p><a href=\"https:\/\/sfdora.org\/\" rel=\"noopener\">DORA<\/a>, the Declaration on Research Assessment, was launched in 2012 during the Annual Meeting of the American Society for Cell Biology in San Francisco to address long-standing problems in how research and researchers are evaluated. It has become a worldwide initiative covering all scholarly disciplines and all key stakeholders including funders, publishers, professional societies, institutions, and researchers.<\/p>\n\n\n\n<p>Research assessment influences many everyday decisions in academia \u2013 from hiring and promotion to funding and publishing. DORA argues that these decisions should be based on the quality and relevance of research, rather than on simplistic proxies such as journal impact factors. Today, thousands of organisations worldwide have signed DORA, and its principles have inspired broader initiatives. For example, building on momentum created by DORA and others, and seeing the need for a community of research organizations engaged in assessment reform, a group came together to develop the <a href=\"https:\/\/zenodo.org\/records\/13480728\" target=\"_blank\" rel=\"noreferrer noopener\">Agreement on Reforming Research Assessment (ARRA)<\/a> and formed the <a href=\"https:\/\/www.coara.org\/\" rel=\"noopener\">CoARA<\/a>, the Coalition for Advancing Research Assessment, in 2022.&nbsp;<\/p>\n\n\n\n<p><strong>Implementation is the real challenge<\/strong><\/p>\n\n\n\n<p>Signing DORA is an important symbolic step, but real change happens during implementation. As Giovanna notes, institutions start from very different points: some are already experimenting with new assessment approaches, while others are at the beginning of the conversation.<\/p>\n\n\n\n<p>DORA supports implementation by:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>convening networks and peer learning spaces<\/li>\n\n\n\n<li>developing practical tools and case studies<\/li>\n\n\n\n<li>offering small community grants<\/li>\n\n\n\n<li>acting as a \u201clighthouse\u201d by showcasing diverse pathways forward<\/li>\n<\/ul>\n\n\n\n<p>Crucially, DORA avoids one-size-fits-all solutions. What works in a small technical university may look very different from what works in a large, comprehensive institution.<\/p>\n\n\n\n<p><strong>Can research impact be assessed responsibly?<\/strong><\/p>\n\n\n\n<p>Assessing societal impact remains one of the most contested issues in research evaluation. Giovanna raises a fundamental question: should impact primarily be assessed, or should it be enabled, recognised, and communicated?<\/p>\n\n\n\n<p>If impact is assessed, key questions follow:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>At what level (individual, project, department, institution)?<\/li>\n\n\n\n<li>What exactly is being assessed (outputs, processes, skills, relationships)?<\/li>\n\n\n\n<li>Over what time frame?<\/li>\n<\/ul>\n\n\n\n<p>Currently, the most widely accepted approach is evidence-based narrative assessment. Narratives make it possible to reflect the complexity, temporality, and context-dependence of impact \u2013 while still grounding claims in concrete evidence. This helps avoid reducing impact to PR exercises or misleading numerical indicators.<\/p>\n\n\n\n<p>At the same time, Giovanna warns against new \u201cflashy\u201d tools that promise easy impact measurement solutions. Without a clear value base and careful design, they risk repeating the same mistakes made in traditional research assessment.<\/p>\n\n\n\n<p>Rather than starting with indicators, universities should first focus on impact strategies. Successful strategies are:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Co-created with internal and external communities<\/li>\n\n\n\n<li>Context-sensitive, reflecting the institution\u2019s maturity and mission<\/li>\n\n\n\n<li>Coherent, aligned with assessment, communication, teaching, and leadership<\/li>\n\n\n\n<li>Adequately resourced, recognising institutional responsibility rather than placing the burden solely on researchers<\/li>\n<\/ul>\n\n\n\n<p>Above all, responsible impact work requires reflection, dialogue, and humility \u2013 qualities that align closely with the core values of open science.<\/p>\n\n\n\n<p>Read more:<br><a href=\"https:\/\/sfdora.org\/read\/\" rel=\"noopener\">https:\/\/sfdora.org\/read\/<\/a><br><a href=\"https:\/\/researchimpact.ca\/resources\/\" rel=\"noopener\">https:\/\/researchimpact.ca\/resources\/<\/a><br><a href=\"https:\/\/impact.enlight-eu.org\/toolkit\/web\/en\" rel=\"noopener\">https:\/\/impact.enlight-eu.org\/toolkit\/web\/en<\/a><br><a href=\"https:\/\/bpb-eu-w2.wpmucdn.com\/blogs.lincoln.ac.uk\/dist\/9\/8563\/files\/2022\/12\/NIHR-Rapid-Review-Impact-Toolkits.pdf\" data-type=\"link\" data-id=\"https:\/\/bpb-eu-w2.wpmucdn.com\/blogs.lincoln.ac.uk\/dist\/9\/8563\/files\/2022\/12\/NIHR-Rapid-Review-Impact-Toolkits.pdf\" rel=\"noopener\">Impact Toolkits<\/a><br><a href=\"https:\/\/inorms.net\/scope-framework-for-research-evaluation\/\" rel=\"noopener\">https:\/\/inorms.net\/scope-framework-for-research-evaluation\/<\/a><\/p>\n\n\n\n<figure class=\"wp-block-image size-large is-resized\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"683\" src=\"https:\/\/sites.utu.fi\/openutu\/wp-content\/uploads\/sites\/1363\/2026\/02\/Vau-mika-vaikutus-podcast-Kookossphoto-2022-31-1024x683.jpg\" alt=\"\" class=\"wp-image-863\" style=\"width:500px\" srcset=\"https:\/\/sites.utu.fi\/openutu\/wp-content\/uploads\/sites\/1363\/2026\/02\/Vau-mika-vaikutus-podcast-Kookossphoto-2022-31-1024x683.jpg 1024w, https:\/\/sites.utu.fi\/openutu\/wp-content\/uploads\/sites\/1363\/2026\/02\/Vau-mika-vaikutus-podcast-Kookossphoto-2022-31-300x200.jpg 300w, https:\/\/sites.utu.fi\/openutu\/wp-content\/uploads\/sites\/1363\/2026\/02\/Vau-mika-vaikutus-podcast-Kookossphoto-2022-31-768x512.jpg 768w, https:\/\/sites.utu.fi\/openutu\/wp-content\/uploads\/sites\/1363\/2026\/02\/Vau-mika-vaikutus-podcast-Kookossphoto-2022-31-1536x1024.jpg 1536w, https:\/\/sites.utu.fi\/openutu\/wp-content\/uploads\/sites\/1363\/2026\/02\/Vau-mika-vaikutus-podcast-Kookossphoto-2022-31-scaled.jpg 2048w, https:\/\/sites.utu.fi\/openutu\/wp-content\/uploads\/sites\/1363\/2026\/02\/Vau-mika-vaikutus-podcast-Kookossphoto-2022-31-168x112.jpg 168w, https:\/\/sites.utu.fi\/openutu\/wp-content\/uploads\/sites\/1363\/2026\/02\/Vau-mika-vaikutus-podcast-Kookossphoto-2022-31-190x127.jpg 190w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><\/figure>\n\n\n\n<p>Laura Niemi ja Outi Nurmela<\/p>\n\n\n\n<p><em>Kirjoittajat ty\u00f6skentelev\u00e4t kehitt\u00e4misasiantuntijoina Turun yliopiston Tutkimusedellytykset \u2013yksik\u00f6ss\u00e4.<\/em><\/p>\n\n\n\n<p>Julkaisun tiedot: 1\/2026, Open Up!-blogi, ISSN 2814-8967<\/p>\n","protected":false},"excerpt":{"rendered":"<p>A special episode of our \u201cWow, What an Impact!\u201d podcast (Vau, mik\u00e4 vaikutus!) \u201cHow to build a successful impact strategy?\u201d was aired on 19.1.2026. In the episode we talked about how research quality and impact can be assessed with our&#8230;<\/p>\n","protected":false},"author":3600,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"_kad_blocks_custom_css":"","_kad_blocks_head_custom_js":"","_kad_blocks_body_custom_js":"","_kad_blocks_footer_custom_js":"","_kad_post_transparent":"","_kad_post_title":"","_kad_post_layout":"","_kad_post_sidebar_id":"","_kad_post_content_style":"","_kad_post_vertical_padding":"","_kad_post_feature":"","_kad_post_feature_position":"","_kad_post_header":false,"_kad_post_footer":false,"_kad_post_classname":"","wds_primary_category":13,"footnotes":""},"categories":[7,13],"tags":[],"class_list":["post-861","post","type-post","status-publish","format-standard","hentry","category-vaikuttavuus","category-blogi"],"acf":[],"lang":"fi","translations":{"fi":861},"taxonomy_info":{"category":[{"value":7,"label":"Vaikuttavuus"},{"value":13,"label":"Blogi"}]},"featured_image_src_large":false,"author_info":{"display_name":"Laura Niemi ja Outi Nurmela","author_link":"https:\/\/sites.utu.fi\/openutu\/author\/lakrnuutufi\/"},"comment_info":0,"category_info":[{"term_id":7,"name":"Vaikuttavuus","slug":"vaikuttavuus","term_group":0,"term_taxonomy_id":7,"taxonomy":"category","description":"","parent":0,"count":27,"filter":"raw","cat_ID":7,"category_count":27,"category_description":"","cat_name":"Vaikuttavuus","category_nicename":"vaikuttavuus","category_parent":0},{"term_id":13,"name":"Blogi","slug":"blogi","term_group":0,"term_taxonomy_id":13,"taxonomy":"category","description":"","parent":0,"count":33,"filter":"raw","cat_ID":13,"category_count":33,"category_description":"","cat_name":"Blogi","category_nicename":"blogi","category_parent":0}],"tag_info":false,"pll_sync_post":[],"_links":{"self":[{"href":"https:\/\/sites.utu.fi\/openutu\/wp-json\/wp\/v2\/posts\/861","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/sites.utu.fi\/openutu\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/sites.utu.fi\/openutu\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/sites.utu.fi\/openutu\/wp-json\/wp\/v2\/users\/3600"}],"replies":[{"embeddable":true,"href":"https:\/\/sites.utu.fi\/openutu\/wp-json\/wp\/v2\/comments?post=861"}],"version-history":[{"count":2,"href":"https:\/\/sites.utu.fi\/openutu\/wp-json\/wp\/v2\/posts\/861\/revisions"}],"predecessor-version":[{"id":865,"href":"https:\/\/sites.utu.fi\/openutu\/wp-json\/wp\/v2\/posts\/861\/revisions\/865"}],"wp:attachment":[{"href":"https:\/\/sites.utu.fi\/openutu\/wp-json\/wp\/v2\/media?parent=861"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/sites.utu.fi\/openutu\/wp-json\/wp\/v2\/categories?post=861"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/sites.utu.fi\/openutu\/wp-json\/wp\/v2\/tags?post=861"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}