Conferences are an essential tool for scientific communication. In disciplines such as Computer Science the majority of original research results are published in conference proceedings. In this... Show moreConferences are an essential tool for scientific communication. In disciplines such as Computer Science the majority of original research results are published in conference proceedings. In this study, we have analyzed the role of conference proceedings in various disciplines and propose an alternative approach to research evaluation based on conference proceedings sources indexed in Scopus and Scimago Journal Rank (SJR). This allows one to categorize conference proceedings in quartiles Q1–Q4 by analogy with SJR journal quartiles. Out of 171 conference proceedings sources analyzed, 38 conference proceedings in Engineering (45% of the list) and 23 in Computer Science (32% of the list) have an SJR level corresponding to the first quartile journals in these areas, which emphasizes the exceptional importance of conferences in these disciplines The comparison of this bibliometric-driven ranking with the expert-driven CORE ranking in Computer Science showed a 62% overlap, as well as a significant average rank correlation of the category distribution. Show less
Kaltenbrunner, W.; Rijcke, S. de; Müller, R.; Burner-Fritsch, I. 2022
The use of indicators is generally associated with a reduction of perspectival diversity in evaluation that often facilitates making decisions along dominant framings – effectively closing down... Show moreThe use of indicators is generally associated with a reduction of perspectival diversity in evaluation that often facilitates making decisions along dominant framings – effectively closing down debate. In this chapter we will argue that while this is indeed often the case, indicators can also be used to help support more plural evaluation and foster more productively critical debate. In order to achieve this shift, it is necessary equally to change understandings, forms and uses of indicators in decision making. These shifts involve, first, broadening out the range of ‘inputs’ taken into account; and second, opening up the ‘outputs’, in the sense of developing methodologies for indicator-based analyses to help in considering plural perspectives. In practice, this means a move towards more situated and participatory use of quantitative evidence in evaluation, a shift from universal indicators to contextualized indicating. Show less
In this chapter we present a short overview of the application of bibliometric methods for the assessment of research performance and the mapping of scientific fields. The first method concerns the... Show moreIn this chapter we present a short overview of the application of bibliometric methods for the assessment of research performance and the mapping of scientific fields. The first method concerns the detailed analysis of the impact of research in an international perspective. These analyses can be used at different aggregation levels and in different contexts such as university research groups, institutes, R&D departments of companies, scientific organizations, research programs of charities, framework programs of the EC, or the research of an entire university or country. These bibliometric performance analyses are an indispensable element in evaluation procedures next to peer review. The second method focuses on the creation of science maps on the basis of word or citation similarity of publications. These science maps are unique tools to discover patterns in the structure of fields, the emergence of new research themes, and research related to important socio-economic issues. We describe these bibliometric methods with ‘real life' examples and discuss in brief current issues such as the h-index, the journal impact factor, webometrics and university rankings. Show less
