Scientometrics originate from the analysis of scientific publications, the most popular ways for disseminating scientific information within the scientific community. With the increasing use of... Show moreScientometrics originate from the analysis of scientific publications, the most popular ways for disseminating scientific information within the scientific community. With the increasing use of scientometric data in research management and research evaluation, various analyses can be conducted to better understand different aspects of scientific activities. On the one hand, the analysis of scientific publications from the Middle East and North Africa region opens up a range of possibilities to characterize its science systems. Large scale analyses of bibliographic metadata capture the stories of how the scientific workforce is connected, funded and mobile within diverse science systems. On the other hand, scientometric data is also used as a guide to transform the science systems. The main objective of this dissertation is to better understand recent science systems changes in the Middle East and North Africa by examining several of their facets and their recent evolution. Show less
Ermolayeva, A.; Birukou, A.; Matyushenko, S.; Kochetkov, D. 2023
Artificial Intelligence (AI) is a rapidly developing field of research that attracts significant funding from both the state and industry players. Such interest is driven by a wide range of AI... Show moreArtificial Intelligence (AI) is a rapidly developing field of research that attracts significant funding from both the state and industry players. Such interest is driven by a wide range of AI technology applications in many fields. Since many AI research topics relate to computer science, where a significant share of research results are published in conference proceedings, the same applies to AI. The world leaders in artificial intelligence research are China and the United States. The authors conducted a comparative analysis of the bibliometric indicators of AI conference papers from these two countries based on Scopus data. The analysis aimed to identify conferences that receive above-average citation rates and suggest publication strategies for authors from these countries to participate in conferences that are likely to provide better dissemination of their research results. The results showed that, although Chinese researchers publish more AI papers than those from the United States, US conference papers are cited more frequently. The authors also conducted a correlation analysis of the MNCS index, which revealed no high correlation between MNCS USA vs. MNCS China, MNCS China/MNCS USA vs. MSAR, and MNCS China/MNCS USA vs. CORE ranking indicators. Show less
The Arabic Citation Index (ARCI) was launched in 2020. This article provides an overview of the scientific literature contained in this new database and explores its possible usage in research... Show moreThe Arabic Citation Index (ARCI) was launched in 2020. This article provides an overview of the scientific literature contained in this new database and explores its possible usage in research evaluation. As of May 2022, ARCI had indexed 138,283 scientific publications published between 2015 and 2020. ARCI’s coverage is characterised by using the metadata available in scientific publications. First, I investigate the distributions of the indexed literature at various levels (research domains, countries, languages, open access). Articles make up nearly all the documents indexed with a share of 99% of ARCI. The Arts & Humanities and Social Sciences fields have the highest concentration of publications. Most indexed journals are published in Egypt, Algeria, Iraq, Jordan, and Saudi Arabia. About 8% of publications in ARCI are published in languages other than Arabic. Second, I use an unsupervised machine learning model, LDA (Latent Dirichlet Allocation), and the text mining algorithm of VOSviewer to uncover the main topics in ARCI. These methods provide a better understanding of ARCI’s thematic structure. Next, I discuss how ARCI can complement global standards in the context of a more inclusive research evaluation. Finally, I suggest a few research opportunities after discussing the findings of this study. Show less
The article studies the issues related to the compilation of the Russian Journal Whitelist, which is intended to be used in research evaluation. Currently, this list has been approved and posted on... Show moreThe article studies the issues related to the compilation of the Russian Journal Whitelist, which is intended to be used in research evaluation. Currently, this list has been approved and posted on the website of the Russian Center for Scientific Information. Building a hierarchy of journals within this list is still under discussion. A number of questions have been raised in the academic community about the composition and principle of compiling the whitelist, and an answer is required. In addition, there are a number of broader questions, in particular, to what extent journal publications are the best way to evaluate research and researchers. I have formulated a number of such questions, inviting readers to reflection and discussion. Despite the difficult situation that has now developed in international scientific communication, one should look at it not only as a crisis, but also as an opportunity to create one of the best systems for research assessment at the moment, free from accumulated bias. Show less
Conferences are an essential tool for scientific communication. In disciplines such as Computer Science the majority of original research results are published in conference proceedings. In this... Show moreConferences are an essential tool for scientific communication. In disciplines such as Computer Science the majority of original research results are published in conference proceedings. In this study, we have analyzed the role of conference proceedings in various disciplines and propose an alternative approach to research evaluation based on conference proceedings sources indexed in Scopus and Scimago Journal Rank (SJR). This allows one to categorize conference proceedings in quartiles Q1–Q4 by analogy with SJR journal quartiles. Out of 171 conference proceedings sources analyzed, 38 conference proceedings in Engineering (45% of the list) and 23 in Computer Science (32% of the list) have an SJR level corresponding to the first quartile journals in these areas, which emphasizes the exceptional importance of conferences in these disciplines The comparison of this bibliometric-driven ranking with the expert-driven CORE ranking in Computer Science showed a 62% overlap, as well as a significant average rank correlation of the category distribution. Show less
The availability of indicators based on social media has opened the possibility to track the online interactions between social media users and scholarly entities. Indicators derived from these... Show moreThe availability of indicators based on social media has opened the possibility to track the online interactions between social media users and scholarly entities. Indicators derived from these online interactions reflect aspects such as how often, by whom, and when are scholarly publications mentioned and discussed on social media platforms. These new indicators, popularly known as altmetrics and more technically referred as social media metrics are usually proposed as potential alternatives to citation-based indicators to inform research evaluation. The research presented in this book provides the state of the art in the possibilities of social media metrics for informing research evaluation. The main ambition is to increase the knowledge and understanding of the limitations, challenges, and actual possibilities of social media metrics for research evaluation. This thesis describes the presence and distribution of different social media metrics across scientific publications and their relationship with traditional impact indicators. It further describes the main characteristics of publications mentioned in Mendeley as one of the main social media metrics platforms. Moreover, critical challenges regarding data quality issues of social media data are thoroughly described and discussed. Finally, some possibilities and applications of social media metrics for informing research evaluation are presented. Show less
