{"id":447,"date":"2019-01-07T17:00:41","date_gmt":"2019-01-07T19:00:41","guid":{"rendered":"https:\/\/humanas.blog.scielo.org\/en\/?p=447"},"modified":"2023-04-27T13:48:00","modified_gmt":"2023-04-27T16:48:00","slug":"methodology-for-development-of-in-house-indicators-for-scholarly-journals-in-consolidation","status":"publish","type":"post","link":"https:\/\/humanas.blog.scielo.org\/en\/2019\/01\/07\/methodology-for-development-of-in-house-indicators-for-scholarly-journals-in-consolidation\/","title":{"rendered":"Methodology for development of &#8220;in-house indicators&#8221; for scholarly journals in consolidation"},"content":{"rendered":"<p><strong>Patr\u00edcia Zeni Marchiori, Full Professor (retired) of the Federal University of Paran\u00e1\/SCSA\/Department of Information Science and Management, Curitiba, PR, Brazil<br \/>\n<\/strong><\/p>\n<p><strong>Eduardo Michelotti Bettoni, Collaborator &#8211; Methodologies in Information Management Research Group, Curitiba, PR, Brazil<\/strong><\/p>\n<p><strong>Andre Luiz Appel, PhD student in the Post-Graduate Program in Information Science\/School of Communication of the Federal University of Rio de Janeiro (in cooperation with the IBICT), Rio de Janeiro, RJ, Brazil<\/strong><\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignright wp-image-81 size-medium\" src=\"https:\/\/humanas.blog.scielo.org\/en\/wp-content\/uploads\/sites\/2\/2017\/03\/tinf_logo-300x73.gif\" alt=\"\" width=\"300\" height=\"73\" \/>A research team from the Universidade Federal do Paran\u00e1, Brazil, named Methodologies in Information Management, worked on the development of indicators, namely \u201cin-house indicators\u201d, to measure performance of scholarly journals in consolidation, <em>i.e<\/em>., those not yet indexed by highly recognized databases, throughout the use of publicly available data regarding such journals.<\/p>\n<p>The results of the study, recently published by the Journal Transinforma\u00e7\u00e3o (Vol. 30, No. 3) in the article named \u201cBringing out indicators for open scientific journals\u201d, present a set of criteria to evaluate journals (listed on the literature or by indexing agencies) (SCIENTIFIC ELECTRONIC LIBRARY ONLINE, 2014), followed by a detailing of the selected indicators which were tested and validated in the context of the journal \u201c<em>AtoZ<\/em>: <em>novas pr\u00e1ticas em informa\u00e7\u00e3o e conhecimento<\/em>\u201d.<\/p>\n<p>The research team explored open source software (ZEARIN, 2016; THE R FOUNDATION, 2017) to extract data, and to generate relationships between citations available on the journal\u2019s articles (an APA\/BibTeX database) and a metadata set structured according to OJS\/OAI-PHM. Another sort of open source software was used to perform consistency tests, and variable handling, as well as to calculate the indicators and generate data visualizations. Seven out of ten indicators were generated from OJS metadata only, and five of them are described on the article (namely, authors per article, international collaboration, most cited authors, bibliometric statistics, and citation-based graphs).<\/p>\n<p>The results highlighted some issues to be considered by the editors of the journal selected for the study, such as: to diminish endogeny, to attract authors\/submissions from a broader geographical range, as well as to foment submissions from authors\/coauthors with doctoral degrees, among other aspects.<\/p>\n<div id=\"attachment_451\" style=\"width: 650px\" class=\"wp-caption aligncenter\"><img loading=\"lazy\" decoding=\"async\" aria-describedby=\"caption-attachment-451\" class=\"wp-image-451 size-large\" src=\"https:\/\/humanas.blog.scielo.org\/en\/wp-content\/uploads\/sites\/2\/2019\/01\/tinf-fig-1-976x1024.jpg\" alt=\"\" width=\"640\" height=\"671\" srcset=\"https:\/\/humanas.blog.scielo.org\/en\/wp-content\/uploads\/sites\/2\/2019\/01\/tinf-fig-1-976x1024.jpg 976w, https:\/\/humanas.blog.scielo.org\/en\/wp-content\/uploads\/sites\/2\/2019\/01\/tinf-fig-1-286x300.jpg 286w, https:\/\/humanas.blog.scielo.org\/en\/wp-content\/uploads\/sites\/2\/2019\/01\/tinf-fig-1-768x806.jpg 768w, https:\/\/humanas.blog.scielo.org\/en\/wp-content\/uploads\/sites\/2\/2019\/01\/tinf-fig-1-150x157.jpg 150w, https:\/\/humanas.blog.scielo.org\/en\/wp-content\/uploads\/sites\/2\/2019\/01\/tinf-fig-1.jpg 1051w\" sizes=\"auto, (max-width: 640px) 100vw, 640px\" \/><p id=\"caption-attachment-451\" class=\"wp-caption-text\">Figure 1. Representation of cited journals, according to macro areas of knowledge of the citing articles \u2013 AtoZ Journal (2011- 2016). Source: The authors &#8211; based on AtoZ Journal metadata and BibTeX files (2011-2016), May 2017.<\/p><\/div>\n<p>Based on the premise that the monitoring of indicators could increase the power of an editorial team to adapt current practices, to project and achieve goals, and to refine decision making processes, the researchers pointed out that data selection and procedures should be performed in semi-automated basis and non-pending of special access permissions (which is suited by the use of the Open Journal Systems (OJS) platform). The study was designed in a way to allow further replication by other journals\u2019 teams who can harvest their own data organically available through OJS, whether or not combined with complimentary data sets.<\/p>\n<p>The study was funded by the Edital de <em>Apoio \u00e0 Editora\u00e7\u00e3o e Publica\u00e7\u00e3o de Peri\u00f3dicos Cient\u00edficos<\/em>, 2016 (UFPR\/PRPPG\/SIBI).<\/p>\n<h3>References<\/h3>\n<p>SCIENTIFIC ELECTRONIC LIBRARY ONLINE. <em>Crit\u00e9rios SciELO Brasil<\/em>: crit\u00e9rios, pol\u00edticas e procedimentos para a admiss\u00e3o e a perman\u00eancia de peri\u00f3dicos cient\u00edficos na Cole\u00e7\u00e3o SciELO Brasil. 2014. Available from: <a href=\"http:\/\/www.scielo.br\/avaliacao\/20141003NovosCriterios_SciELO_Brasil.pdf\" target=\"_blank\" rel=\"noopener noreferrer\">http:\/\/www.scielo.br\/avaliacao\/20141003NovosCriterios_SciELO_Brasil.pdf<\/a><\/p>\n<p>THE R FOUNDATION. <em>The R Project for Statistical Computing<\/em>. 2017. Available from: <a href=\"https:\/\/www.r-project.org\/\" target=\"_blank\" rel=\"noopener noreferrer\">https:\/\/www.r-project.org\/<\/a><\/p>\n<p>ZEARIN. <em>BibTeXML<\/em>. San Francisco: GitHub Repository, 2016. Available from: <a href=\"https:\/\/github.com\/Zearin\/BibTeXML\" target=\"_blank\" rel=\"noopener noreferrer\">https:\/\/github.com\/Zearin\/BibTeXML<\/a><\/p>\n<h3>To read the article, access<\/h3>\n<p>MARCHIORI, P. Z., BETTONI, E. M. and APPEL, A. L.<span class=\"article-title\"> Gera\u00e7\u00e3o de indicadores para peri\u00f3dicos cient\u00edficos abertos.<\/span><i>Transinforma\u00e7\u00e3o<\/i>\u00a0[online]. 2018, vol.30, n.3, pp.324-335. ISSN 0103-3786. [viewed 7 January 2019]. DOI:\u00a0<a href=\"http:\/\/dx.doi.org\/10.1590\/2318-08892018000300005\" target=\"_blank\" rel=\"noopener noreferrer\">0.1590\/2318-08892018000300005<\/a>. Available from:\u00a0<a href=\"http:\/\/ref.scielo.org\/sm4zbc\" target=\"_blank\" rel=\"noopener noreferrer\">http:\/\/ref.scielo.org\/sm4zbc <\/a><\/p>\n<h3>External links<\/h3>\n<p>Transinforma\u00e7\u00e3o &#8211; TINF: <a href=\"http:\/\/www.scielo.br\/tinf\">www.scielo.br\/tinf<\/a><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Adherence to quality criteria required by indexing agencies is an essential condition for managers in order to achieve performance success of scientific journals under their responsibility. In a recent study researchers verified and tested &#8220;household indicators&#8221; for journals still under consolidation, based on data sources under the grasp or domain of such managers. <span class=\"ellipsis\">&hellip;<\/span> <span class=\"more-link-wrap\"><a href=\"https:\/\/humanas.blog.scielo.org\/en\/2019\/01\/07\/methodology-for-development-of-in-house-indicators-for-scholarly-journals-in-consolidation\/\" class=\"more-link\"><span>Read More &rarr;<\/span><\/a><\/span><\/p>\n","protected":false},"author":139,"featured_media":82,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_monsterinsights_skip_tracking":false,"_monsterinsights_sitenote_active":false,"_monsterinsights_sitenote_note":"","_monsterinsights_sitenote_category":0,"footnotes":"","_links_to":"","_links_to_target":""},"categories":[7,87],"tags":[149,88],"class_list":["post-447","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-press-release","category-tinf","tag-communication-and-information-sciences","tag-transinformacao"],"aioseo_notices":[],"_links":{"self":[{"href":"https:\/\/humanas.blog.scielo.org\/en\/wp-json\/wp\/v2\/posts\/447","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/humanas.blog.scielo.org\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/humanas.blog.scielo.org\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/humanas.blog.scielo.org\/en\/wp-json\/wp\/v2\/users\/139"}],"replies":[{"embeddable":true,"href":"https:\/\/humanas.blog.scielo.org\/en\/wp-json\/wp\/v2\/comments?post=447"}],"version-history":[{"count":3,"href":"https:\/\/humanas.blog.scielo.org\/en\/wp-json\/wp\/v2\/posts\/447\/revisions"}],"predecessor-version":[{"id":1029,"href":"https:\/\/humanas.blog.scielo.org\/en\/wp-json\/wp\/v2\/posts\/447\/revisions\/1029"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/humanas.blog.scielo.org\/en\/wp-json\/wp\/v2\/media\/82"}],"wp:attachment":[{"href":"https:\/\/humanas.blog.scielo.org\/en\/wp-json\/wp\/v2\/media?parent=447"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/humanas.blog.scielo.org\/en\/wp-json\/wp\/v2\/categories?post=447"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/humanas.blog.scielo.org\/en\/wp-json\/wp\/v2\/tags?post=447"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}