Research assessment under debate: disentangling the interest around the DORA declaration on Twitter

[EN] Much debate has been around the misapplication of metrics in research assessment. As a result of this concern, the Declaration on Research Assessment (DORA) was launched, an initiative that caused opposing viewpoints. However, the discussion topics about DORA have not been formally identified,...

Descripción completa

Detalles Bibliográficos
Autores: Orduña-Malea, Enrique|||0000-0002-1989-8477; Bautista-Puig, Núria
Tipo de documento: Artículo
Fecha de publicación:2024
País:España
Institución:Universitat Politècnica de València (UPV)
Repositorio:RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
Lenguaje:Inglés
OAI Identifier:oai:riunet.upv.es:10251/219984
Acceso en línea:https://riunet.upv.es/handle/10251/219984
Nivel de acceso:Acceso abierto
Palabra clave:DORA declaration
Scientometrics
Social media metrics
Twitter
Research evaluation
_version_ 1878729518859943936
author Orduña-Malea, Enrique|||0000-0002-1989-8477
author2 Bautista-Puig, Núria
author2_role author
author_browse Bautista-Puig, Núria
Orduña-Malea, Enrique|||0000-0002-1989-8477
author_facet Orduña-Malea, Enrique|||0000-0002-1989-8477
Bautista-Puig, Núria
author_role author
collection RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
description [EN] Much debate has been around the misapplication of metrics in research assessment. As a result of this concern, the Declaration on Research Assessment (DORA) was launched, an initiative that caused opposing viewpoints. However, the discussion topics about DORA have not been formally identified, especially in participatory environments outside the scholarly communication process, such as social networks. This paper contributes to that end by analyzing 20,717 DORA-related tweets published from 2015 to 2022. The results show an increasing volume of tweets, mainly promotional and informative, but with limited participation of users, either commenting or engaging with the tweets, generating a scarcely polarized conversation driven primarily by a few DORA promoters. While a varied list of discussion topics is found (especially "Open science and research assessment," "Academics career assessment & innovation," and "Journal Impact Factor"), the DORA debate appears as part of broader conversations (research evaluation, open science). Further studies are needed to check whether these results are restricted to Twitter or reveal more general patterns. The findings might interest the different evaluators and evaluated agents regarding their interests and concerns around the reforms in the research evaluation.
eu_rights_str_mv openAccess
format article
id ES_098bb83d208fa1eabdc3b5ebaeff7e71
institution Universitat Politècnica de València (UPV)
instname_str Universitat Politècnica de València (UPV)
language eng
network_acronym_str ES
network_name_str España
oai_identifier_str oai:riunet.upv.es:10251/219984
publishDate 2024
publishDateSort 2024
publisher Springer-Verlag
publisherStr Springer-Verlag
reponame_str RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
spelling Research assessment under debate: disentangling the interest around the DORA declaration on Twitter Orduña-Malea, Enrique|||0000-0002-1989-8477 Bautista-Puig, Núria DORA declaration Scientometrics Social media metrics Twitter Research evaluation [EN] Much debate has been around the misapplication of metrics in research assessment. As a result of this concern, the Declaration on Research Assessment (DORA) was launched, an initiative that caused opposing viewpoints. However, the discussion topics about DORA have not been formally identified, especially in participatory environments outside the scholarly communication process, such as social networks. This paper contributes to that end by analyzing 20,717 DORA-related tweets published from 2015 to 2022. The results show an increasing volume of tweets, mainly promotional and informative, but with limited participation of users, either commenting or engaging with the tweets, generating a scarcely polarized conversation driven primarily by a few DORA promoters. While a varied list of discussion topics is found (especially "Open science and research assessment," "Academics career assessment & innovation," and "Journal Impact Factor"), the DORA debate appears as part of broader conversations (research evaluation, open science). Further studies are needed to check whether these results are restricted to Twitter or reveal more general patterns. The findings might interest the different evaluators and evaluated agents regarding their interests and concerns around the reforms in the research evaluation. Conselleria de Innovacion, Universidades, Ciencia y Sociedad Digital, Generalitat Valenciana, GV/2021/141, Enrique Orduna-Malea. Springer-Verlag https://riunet.upv.es/handle/10251/219984
spellingShingle Research assessment under debate: disentangling the interest around the DORA declaration on Twitter
Orduña-Malea, Enrique|||0000-0002-1989-8477
DORA declaration
Scientometrics
Social media metrics
Twitter
Research evaluation
title Research assessment under debate: disentangling the interest around the DORA declaration on Twitter
title_full Research assessment under debate: disentangling the interest around the DORA declaration on Twitter
title_fullStr Research assessment under debate: disentangling the interest around the DORA declaration on Twitter
title_full_unstemmed Research assessment under debate: disentangling the interest around the DORA declaration on Twitter
title_short Research assessment under debate: disentangling the interest around the DORA declaration on Twitter
title_sort Research assessment under debate: disentangling the interest around the DORA declaration on Twitter
topic DORA declaration
Scientometrics
Social media metrics
Twitter
Research evaluation
topic_facet DORA declaration
Scientometrics
Social media metrics
Twitter
Research evaluation
url https://riunet.upv.es/handle/10251/219984