Home > Services > Monitoring

Monitoring

The data processed and hosted by KB have been and continue to be used as the basis for a number of evaluation and monitoring projects of siginificance for the German science system. These include:

  Project DEAL 

On behalf of the Alliance of German Science Organisations and under the auspices of the German Rectors' Conference, Project DEAL negotiates transformative "publish and read" agreements for scientific journals with the largest commercial publishers for German scientific institutions. The aim is to make all publications by authors from German institutions automatically available in Open Access, to provide DEAL participant institutions with permanent full-text access to the entire portfolio of e-journals from the selected publishers, and to achieve appropriate pricing according to a simple, forward-looking calculation model based on the volume of publications by DEAL participant institutions ("publish and read model"). So far, DEAL contracts have been concluded with the publishers Wiley and Springer Nature. The agreement with Springer Nature is considered the world's largest OA transformation contract to date. In order to be able to determine the expected publication volume under the DEAL contracts and to develop the "publish and read model", the quality-assured data infrastructure operated by the Competence Centre for Bibliometrics was used in the run-up to the contract negotiations.

  Open Access Monitor 

With the "OAM – Open Access Monitoring" project (FKZ 16OAMO001), the Federal Ministry of Education and Research (BMBF) is funding the further development and operation of the Open Access Monitor for Germany (OAM) by the Central Library of Forschungszentrum Jülich from 1 September 2020 until 31 August 2023. The Open Access Monitor was initially established and funded within the scope of a BMBF ideas competition in support of the free flow of information within the scientific community in the "Synergies for open access – open access monitoring – SynOA" project (FKZ 16OA018).

The Open Access Monitor records the publication output of German academic institutions in scientific journals. Through analyses of subscription fees and (open access) publication fees, the transition of the publishing system towards an open access system is monitored and supported. For this purpose, data from existing projects are collated within expanded databases, made available to users in a hierarchical interface, and disseminated by means of scientific publications. OAM is freely accessible under https://open-access-monitor.de/ (user interface in English language will be implemented in 2021).

OAM contains publication data from Clarivate (Web of Science), among others. Although the data are held locally, the legal and financial basis for this is the membership of Forschungszentrum Jülich in the Competence Centre for Bibliometrics.

  Use of KB-data for CHE university ranking 

Centrum für Hochschulentwicklung (Center for Higher Education Development) regularly conducts a wide range of studies on disciplines of German universities for the newspaper Die ZEIT. The resulting university ranking provides prospective students with a wealth of characteristics about the subjects and universities they want to study, which can help them to choose a subject and place to study.

The characteristics include, among others, the scientific output and its perception, i.e. publications of the disciplines and the citations received on them. The Central library of Forschungszentrum Jülich collects this data on the basis of the KB database infrastructure for the following disciplines (status 2020): electrical engineering and information technology, geography, earth sciences, medicine, dentistry and psychology. The basis for determining the respective university publications is the institution coding of the Competence Centre for Bibliometrics, which is available for the publications of German institutions from the Web of Science and Scopus databases.

The publications of the universities are assigned to the disciplines to be examined in a manual procedure with the help of the author addresses. The result in the CHE ranking contains figures relative to the number of scientists (or professors) and is presented in three groups (cf. https://methodik.che-ranking.de/datenerhebung/bibliometrische-analyse/).

  Monitoring the Asian-Pacific Research Area (APRA) 

Alongside Europe and North America, the Asia-Pacific area is the third leading world region in knowledge production and innovation. For years, we have been observing an increasing regional integration of research among these countries. The growing cooperation within the Asia-Pacific region reduces the importance of cooperation with the USA or European countries. It is therefore crucial for the German knowledge-based economy to be well informed about research and innovation trends in other parts of the world.
To this end, the German Federal Ministry of Education and Research (BMBF) has commissioned a monitoring of the Asia-Pacific Research Area with a focus on China. After the release of a first report in May 2019, this new publication offers a second comprehensive inventory. The editors are the DLR Project Management Agency, the Fraunhofer Institute for Systems and Innovation Research ISI, the Leibniz Institute for Global and Regional Studies (GIGA) and the German Academic Exchange Service (DAAD). In addition to the document, the DLR Project Management Agency provides an extensive bibliometric and patentometric data set.
The publication contains evaluations of various research and education indicators – including expenditure, (co-)publications and (co-)patents – in selected countries that are relevant for research and innovation cooperation with Germany. The focus of this year's report is on life sciences, materials research and tertiary education hubs. In this year's report on the development of the Chinese research and education system, the focus is on Chinese-European cooperation.
A follow-up report with a particular focus on India, international Kooperation and the China's regions is in the process of being completed and will soon be published.
Current publication: https://www.kooperation-international.de/dokumente/berichte-und-studien/detail/info/monitoring-des-asiatisch-pazifischen-forschungsraums-apra-2-bericht-2020/.

  Study series Wissenschaft Weltoffen 

Internationalisation is necessary for the successful development of teaching and research at universities. Therefore, empirical surveys are regularly carried out to assess the international nature of the German higher education system and keep policymakers and society fully informed. In this context, the Wissenschaft Weltoffen (Science Open to the World) is a joint study series conducted annually since 2014 by the German Academic Exchange Service (DAAD) and German Centre for Higher Education Research and Science Studies (DZHW) using the Competence Centre's database infrastructure. The central topic of the study each year is statistical indicators of international mobility of students, academics, and researchers, with a special spotlight on a prominent topic. The Wissenschaft Weltoffen series has established itself as a central source of information on student and researcher mobility.

The reports are available in English and German at: http://www.wissenschaftweltoffen.de/.
Current publication: http://www.wissenschaftweltoffen.de/kompakt/wwo2021_kompakt_de.pdf.

  Monitoring of the Pact for Research and Innovation (PFI) 

"Pakt für Forschung und Innovation" (PFI) was launched in 2005 by the federal and state governments to make the German science system more dynamic and competitive. It was last updated in June 2019 for the years 2021 to 2030. The pact is valid for the German Research Foundation (DFG) as well as for the four large non-university research organizations Fraunhofer Society (FHG), Helmholtz Association of German Research Centers (HGF), Max Planck Society (MPG) and Leibniz Association (WGL). Commissioned by the German Federal Ministry of Education and Research (BMBF), Central Library of Forschungszentrum Jülich in cooperation with KU Leuven has been collecting a set of bibliometric indicators since 2016 to document the development of scientific activity in Germany, by describing and analysing the development of publication activity in universities and research organizations, and enabling comparison with other countries. In this context, the database infrastructure of the Competence Centre for Bibliometrics has been used to produce the analyses for the Bibliometrics Report. Above all, the institution coding of the database is significant for the analyses and is essential in narrowing down the publications of the research organizations in the PFI. The reports can be viewed at this address: https://www.bmbf.de/de/pakt-fuer-forschung-und-innovation-546.html.
Current publication: https://www.bmbf.de/files/Acrobat-Dokument.pdf.

  Studies for the Commission of Experts for Research and Innovation 

Since 2019, the German Centre for Higher Education Research and Science Studies (DZHW) has utilised the Competence Centre's database infrastructure to produce an annual study for the Commission of Experts for Research and Innovation (Expertenkommission Forschung und Innovation, EFI). The studies analyse the performance and structures of the German science system in an international comparison with 22 countries over a time-series. Each study presents bibliometric indicators of productivity, scientific impact, and collaboration, with a changing focus each year on a bibliometric theme, such as analysing the effect of the data source on indicators or examining the influence of China's rapid growth on the international science system. These studies contribute to the annual report produced by EFI to advise the German Federal Government on research, innovation, and technical performance in Germany.

The studies are available in English at: https://www.e-fi.de/publikationen/studien.
Current publication: https://www.bundesbericht-forschung-innovation.de/files/BMBF_BuFI-2020_Hauptband.pdf.

  Research Ratings Chemistry and Electrical/Information Engineering 

The Research Rating of the Council of Science and Humanities was the most ambitious evaluation exercise of research organizations on a nationwide scale in Germany to date. The exercises, designed as discipline-specific pilot studies that experimentally tested different modes of evaluation, assessed research units in four disciplines by expert committees on the basis of customized standards and procedures. In two exercises the committees decided to use bibliometric data and expertise in an "informed peer review" model of evaluation, provided by KB partner organizations and using KB infrastructure and data. The Research Rating Chemistry charged the IWT of Bielefeld University with supplying a publication and citation analysis of some 42,000 documents. The Electrical/Information Engineering exercise was supported by bibliometric indicators and data for some 3300 documents by iFQ.

  Federal Report on Research and Innovation / BMBF Data Portal 

The Fraunhofer Institute for Systems and Innovation Research ISI annually creates tables on the number of scientific publications per million inhabitants for about 30 countries for the BMBF Data Portal and biannually for the Federal Report on Research and Innovation.