Citation outcomes are often used as a proxy to measure research excellence. Accordingly, clarifying the drivers of citation outcomes is valuable information for research policy, both to inform... Show moreCitation outcomes are often used as a proxy to measure research excellence. Accordingly, clarifying the drivers of citation outcomes is valuable information for research policy, both to inform interventions that contribute to excellence and to establish fair normalization practices when measuring the relative excellence of a body of work compared a given benchmark. Previous research has shown that open access, international collaboration and the gender composition of research teams each have an influence on citation outcomes and that they are interconnected with one another. The present work replicates a small-scale study that disentangles their influence, expands the analysis to a much wider scope, and drills down into subsets of data, applying this analytical approach sequentially to extract valuable contextual information to situate interpretation of more localized findings. However, this study can only inform a discussion about the policy relevance of and appropriate policy responses to the present findings; it cannot replace that discussion. Some questions that it raises pertain to the difference between a strategy to improve research and a strategy to improve citations, what counts as a fair expectation against which to measure performance for various groups, and what exactly it is that we are aiming to promote when using citation-based measures for research evaluation. Show less
Cobo, M.J.; Dehdarirad, T.; García-Sánchez, P.; Moral-Munoz, J.A. 2018
Reproducibility of scientific articles and their findings has gained importance in the last years. Although most efforts have been made in biomedicine, health and psychology science,... Show moreReproducibility of scientific articles and their findings has gained importance in the last years. Although most efforts have been made in biomedicine, health and psychology science, reproducibility is important and necessary in all the research fields. Thus, in this contribution an empirical evaluation of the reproducibility of scientometric studies was carried out. To do so, 285 articles published in the journal of Scientometrics in 2017 were examined in term of the following reproducibility artifacts: workflow, search strategy, database, software, the availability of the source code (where applicable) and the availability of the dataset. Our findings showed that whilst workflow and search strategy were well described in the majority of articles, the dataset used was shared by very few studies. The data was usually retrieved from the WoS and Scopus databases. Finally, a few articles shared the source code where ad-hoc software was used. Show less
Radó-Trilla, N.; Solans-Domènech, M.; Adam, P. 2018
As the Catalan research assessment agency, we designed and implemented an ongoing, ex-post and impact assessment system in the area of health system (SARIS), which includes a crucial pillar:... Show moreAs the Catalan research assessment agency, we designed and implemented an ongoing, ex-post and impact assessment system in the area of health system (SARIS), which includes a crucial pillar: engagement. We developed an approach that combines the co-creation with the stakeholders in order to define topics of interests, with the formulation of preliminary indicators to assess the impact of nursing research. Therefore, a 2-phase approach was developed. First, discussion groups with the main purpose of identifying topics of interest in relations to the impact of nursing research were developed. Nurses from different settings, territories and disciplines made emerge four topics of interest: ‘advancement of knowledge’, ‘results dissemination’, ‘nurse training and networks’ and ‘results application’. Second, the suggested ideas from the focus groups were analysed and discussed in order to elaborate 30 preliminary indicators. Next steps will include a consensus in order to assess the relevance of these indicators. In the current context, where research in nursery care has not been measured before, co-creation with stakeholders might be a win-win strategy to reach three objectives: 1) obtaining a meaningful and measurable set of indicators, 2) raising awareness on the transformative potential of nursery care research, and 3) in motivating researchers in nursery care to maximize the impact. Show less
This analysis examines trade journals as an example of the less observed publication types in bibliometric databases. It is shown that they appear in considerable numbers both in Scopus and the Web... Show moreThis analysis examines trade journals as an example of the less observed publication types in bibliometric databases. It is shown that they appear in considerable numbers both in Scopus and the Web of Science and that their bibliometric properties (citation behavior, document type distribution, field differences) differ significantly from academic journals. An example of how trade journals influence bibliometric indicator calculations on a field level is also provided. Lastly, German institutions and sectors are identified that publish most in trade journals. Hereby, a target audience is inferred, leading to the conclusion that bibliometric databases provide not only insights in intra-scientific communication but also about knowledge transfer. Some remarks regarding how bibliometricians should handle different publication types to increase construct validity complement this analysis. Show less
The Second National Enterprise Innovation Survey was conducted in China in 2017, targeting industry, construction and service sectors. This survey used to a large extent the Oslo Manual as... Show moreThe Second National Enterprise Innovation Survey was conducted in China in 2017, targeting industry, construction and service sectors. This survey used to a large extent the Oslo Manual as reference in terms of norms and standards and drew on lessons and experiences from innovation survey practices in EU countries. However, there were additional contents to it, such as, survey of entrepreneurial groups. According to the results of the 2017 survey, approximately 40% of the enterprises surveyed had innovation activity and around 8% of them achieved 4 kinds of innovation; the innovation success rate of the manufacturing industry was relatively high and the innovation activeness of large-sized enterprises was the highest; cooperative innovation was conducive to enhancing market competitiveness; insufficient cognition of innovation, relatively high costs of innovation and lack of elements for innovation were believed to be the major obstacles to corporate innovation; and finally, the outcome of implementation of innovation policies was widely approved among the entrepreneurial groups. Show less
