Metrics out of Control: The Case of Engineering in Colombia
DOI:
https://doi.org/10.18046/recs.i40.5778Keywords:
Bibliometrics, Audit Culture, Engineering, Scientific PolityAbstract
This text proposes an approach to the use of metrics and bibliometrics in research management scenarios as an instrument to control the audit culture in Colombian higher education institutions. For this purpose, the article analyzed the scientific production on engineering between 2000 and 2019 and obtained a context that connects additional criteria such as collaborations, institutional affiliations, and topics to citation. These elements enabled to determine the limitations of using only bibliometric indicators to measure scientific work, since it significantly reduces the framework in which knowledge production occurs in Colombia.
Downloads
References
Aguilera-Prado, Marco; Aguirre, Carolina; Salcedo, Octavio (2017). Approach to Citation Determinants of Articles from Colombian Engineering Journals in Scopus. Contemporary Engineering Sciences, 10(26), 1279-1286. https://doi.org/10.12988/ces.2017.710150
Annalingam, Anupama; Damayanthi, Hasitha; Jayawardena, Ranil; Ranasinghe, Priyanga (2014). Determinants of the citation rate of medical research publications from a developing country. SpringerPlus, 3(140), 1-8. https://doi.org/10.1186/2193-1801-3-140
Arnold, Tom; Butler, Alexander W.; Crack, Timothy Falcon; Altintig, Ayca (2003). Impact: What Influences Finance Research? Journal of Business, 76(2), 343-361. https://doi.org/10.1086/367753
Ayres, Ian; Vars, Fredrick E. (2000). Determinants of Citations to Articles in Elite Law Reviews. The Journal of Legal Studies, 29(S1), 427-450. https://doi.org/10.1086/468081
Bosquet, Clément; Combes, Pierre-Philippe (2013). Are academics who publish more also more cited? Individual determinants of publication and citation records. Scientometrics, 97(3), 831-857. https://doi.org/10.1007/s11192-013-0996-6
Confraria, Hugo; Mira, Manuel; Wang, Lili (2016). Determinants of citation impact: A comparative analysis of the Global South versus Global North. Maastrich, The Netherlands: Mastricht Economic and Social Research on Innovation and Technology.
Departamento Administrativo de Ciencia, Tecnología e Innovación (2016). Convocatoria para Indexación de Revistas Científicas Colombianas Especializadas - Publindex. Recuperado de https://minciencias.gov.co/convocatorias/investigacion/convocatoria-para-indexacion-revistas-cientificas-colombianas
Didegah, Fereshteh; Thelwall, Mike (2013). Determinants of Research Citation Impact in Nanoscience and Nanotechnology. Journal of the American Society for Information and Technology, 64(5), 1055-1064. https://doi.org/10.1002/asi.22806
Frederiksen, Frode (2004). Disciplinary determinants of bibliometric impact in Danish industrial research: Collaboration and visibility. Scientometrics, 61(2), 253-270. https://doi.org/10.1023/B:SCIE.0000041651.26664.14
Gómez-Morales, Yuri Jack (2005). Política científica colombiana y bibliometría: usos. Nómadas, 22, 241–54. Recuperado de http://nomadas.ucentral.edu.co/index.php/inicio/27-medio-ambiente-historia-y-politica-nomadas-22/389-politica-cientifica-y-bibliometria-usos
Gómez-Morales, Yuri Jack (2015). Usos y abusos de la bibliometría. Revista Colombiana de Antropología, 5(1), 291-307. https://doi.org/10.22380/2539472X36
Ibáñez, Alfonso; Armañanzas, Rubén; Bielza, Concha; Larrañaga, Pedro (2016). Genetic Algorithms and Gaussian Bayesian Networks to Uncover the Predictive Core Set of Bibliometric Indices. Journal of the Association for Information Science and Technoloy, 67(7), 1703-1721. https://doi.org/10.1002/asi.23467
Ibáñez, Alfonso; Larrañaga, Pedro; Bielza, Concha (2009). Predicting citation count of Bioinformatics papers within four years of publication. Bioinformatics, 25(4), 3303-3309. https://doi.org/10.1093/bioinformatics/btp585
Latour, Bruno (1992). Ciencia en Acción. Barcelona: Labor.
Latour, Bruno (2010). The Making of Law. An Ethnographyn of the Conseil D’etat. Cambridge: Polity Press.
Lokker, Cynthia; McKibbon, Ann K.; McKinlay, R. James; Wilczynski, Nancy L.; Haynes, Brian R. (2008). Prediction of Citation Counts for Clinical Articles at Two Years Using Data Available within Three Weeks of Publication: Retrospective Cohort Study. British Medical Journal, 336(7645), 655-657. https://doi.org/10.1136/bmj.39482.526713.BE
Long, Rebecc; Crawford, Aleta; White, Michael; Davis, Kimberly (2009). Determinants of faculty research productivity in information systems: An empirical analysis of the impact of academic origin and academic affiliation. Scientometrics, 78(2), 231-260. https://doi.org/10.1007/s11192-007-1990-7
Maz-Machado, Alexander; Jiménez-Fanjul, Noelia Noemí; Villarraga, Miguel Ernesto (2016). La producción científica colombiana en SciELO: un análisis bibliométrico. Revista Interamericana de Bibliotecología, 39(2), 111-119. https://doi.org/10.17533/udea.rib.v39n2a03
Merton, Robert King (1973). The Sociology of Science. Theoretical and Empirical Investigations, editado por Norman. W. Storer E. Chicago: The University of Chicago Press.
Mingers, John; Leysderdoff, Loet (2015). A review of theory and practice in scientometrics. European Journal of Operational Research, 246, 1-19. https://doi.org/10.1016/j.ejor.2015.04.002
Ministerio de Ciencia, Tecnología e Innovación (2021). Modelo de medición de grupos de investigación, desarrollo tecnológico o de innovación y de reconocimiento de investigadores del Sistema Nacional de Ciencia, Tecnología e Innovación, año 2021 [documento PDF]. Recuperado de https://minciencias.gov.co/sistemas-informacion/modelo-medicion-grupos
Padial, André Andrian; Nabout, João Carlos; Siqueira, Tadeu; Bini, Luis Mauricio; Felizola, José (2010). Weak evidence for determinants of citation frequency in ecological articles. Scientometrics, 85(1), 1-12. https://doi.org/10.1007/s11192-010-0231-7
Ramírez-Ajiaco, Catalina (2020). Sin cita: la construcción del plagio como delito en el sistema penal colombiano [Tesis de maestría]. Universidad Nacional de Colombia, Bogotá, Colombia. Recuperado de https://repositorio.unal.edu.co/handle/unal/78176
Rojas-Sola, José Ignacio; De San-Antonio-Gómez, Carlos (2010). Análisis bibliométrico de las publicaciones científicas colombiana en la categoría engineering, multidisciplinary de la base de datos Web of Science (1997-2009). DYNA, 77(164), 9-17. Recuperado de https://revistas.unal.edu.co/index.php/dyna/article/view/25571
Schore, Cris; Wright, Susan (2000). Coercive Accountability. The Rise of Audit Culture in Higher Education. Audit Cultures. Anthropological Studies in Accountability, Ethics and the Academy (pp. 57-89), editado por Marilyn Strathern. London: Routledge.
Schwarz, Carlo (2018). Ldagibbs: A command for Topic Modeling in Stata using Latent Dirichlet Allocation. The Stata Journal, 18(1), 101-117. https://doi.org/10.1177/1536867X1801800107
Strathern, Marilyn (ed.) (2000). Audit Cultures: Anthropological Studies in Accountability, Ethics and the Academy. London: Routledge.
Tahamtan, Iman; Safipour-Afshar, Askar; Ahamdzadeh, Khadijeh (2016). Factors affecting number of citations: a comprehensive review of the literature. Scientometrics, 107, 1195-1225. https://doi.org/10.1007/s11192-016-1889-2
Tandilashvili, Nino; Tandilashvili, Anna (2022). Academics’ Perception of Identity (Re)Construction: A Value Conflict Created by Performance Orientation. Journal of Management and Governance, 26(2), 389-416. https://doi.org/10.1007/s10997-022-09627-8
Downloads
Published
Issue
Section
License
Copyright (c) 2023 Catalina Ramirez Ajiaco, Marco Aguilera-Prado
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
© Reserved Copyright
Material in this publication may be reproduced without authorization, provided the title, author and institutional source is acknowledged.
The content published in Revista CS is distributed under the Creative Commons BY-NC 4.0 Attribution/Recognition-NonCommercial 4.0 International license.
You are free to:
Share — copy and redistribute the material in any medium or format.
Adapt — remix, transform, and build upon the material.
Under the following terms:
Attribution — You must give appropriate credit , provide a link to the license, and indicate if changes were made . You may do so in any reasonable manner, but not in any way that suggests the licensor endorses you or your use.
NonCommercial — You may not use the material for commercial purposes.
How to Cite
