The Observatory will review the conduct of "academic ranking" and expressions of "academic excellence" for the benefit of higher education, its stake-holders and the general public. This objective will be achieved by way of:
improving the standards, theory and practice in line with recommendations formulated in the Berlin Principles on Ranking of Higher Education Institutions
initiating research and training related to ranking excellence;
analyzing the impact of ranking on access, recruitment trends and practices;
analyzing the role of ranking on institutional behavior;
enhancing public awareness and understanding of academic work.
The robustness or breakdown of Lotka's law about the frequency distribution of scientific productivity depends on scientific cooperation, counting methods, interdisciplinary publishing and selection methods for sample collections. We have chosen to analyse the relationship using Mandelbrot's equivalent distribution model because this model is sensitive and uses the original data (scores). Five sets of authors and publications, the two sets used by Lotka, a set from High Energy Physics, a set from Microbiology and a set based on applicants to a research programme promoting young researchers have been used. It is shown that even for a sample of authors in High-Energy Physics with extremely strong co-authorship, Mandelbrot's distribution law is robust when complete-normalized (fractional) counting is used whereas complete counting results in a breakdown. In the field of Microbiology with much weaker cooperation, both counting methods result in a breakdown of Mandelbrot's law. Today a field like Microbiology with the corresponding set of journals, probably has a large content of interdisciplinary publishing and therefore no more fulfills the precondition of Lotka's law, that the total production of the authors (sources) is considered. For a set of applicants for the Emmy Noether Programme of the German Research Foundation. Mandelbrot's law breaks down despite the fact that all publications co-authored by the applicants are taken into account. In agreement with Bayes' theorem of conditional probabilities these results lead to the conjecture that any selection process of authors and/or publications causes a breakdown of Mandelbrot's law and, as a consequence Lotka's law.
A survey cutting across all departments found at U.S. business schools was conducted to assess the readerships of 130 journals. The survey results can help researchers both in their understanding of the composition of potential readers at given journals and in the process of selecting journals for a desirable target audience. Survey respondents also reported the degree to which articles published in various journals have stimulated their thinking and in how far publications in particular journals are believed to help in increasing the researcher’s academic reputation.
Bericht über die Einrichtung eines Forschungsinformationssystems für Medizin in Bayern und Nordrhein-Westfalen.
Die Personen sollen ihre Daten selber eingeben, aber Schnittstellen zu Medline und ISI vereinfachen die Arbeit
This toolkit, first assembled in 2009, is an effort to give a variety of people interested in understanding ways of measuring the impacts that their online scholarly resources are having.
The Centre for Science and Technology Studies (CWTS), Leiden University, has developed a new ranking system entirely based on its own bibliometric indicators. This web-publication is the first in a series of rankings. The work focuses on all universities worldwide with more than 700 Web of Science indexed publications per year. This implies that the about 1000 largest (in terms of number of publications) universities in the world are covered, and that our bibliometric analysis is based on the scientific output of many hundreds of active researchers in each of these universities.
Eine der wesentlichen Zielsetzungen des DFG - Förder-Rankings ist es, Material bereitzustellen, das in differenzierter und den Vergleich unterstützender Form Auskunft über die fachlichen Schwerpunktsetzungen deutscher Hochschulen im Spiegel öffentlich finanzierter Forschung gibt. Damit leistet die DFG einen Beitrag zur Diskussion um die Profilbildung von Hochschulen.
Citation analysis needs an in-depth transformation. Current systems have been long criticized due to shortcomings such as lack of coverage of publications and low accuracy of the citation data. Surprisingly, incomplete or incorrect data are used to make important decisions about researchers' careers. We argue that a new approach based on the collection of citation data at the time the papers are created can overcome current limitations, and we propose a new framework in which the research community is the owner of a Global Citation Registry characterized by high quality citation data handled automatically. We envision a registry that will be accessible by all the interested parties and will be the source from which the different impact models can be applied.
Eine Zusammenstellung verschiedener Artikel, die sich kritisch mit Bibliometrie als Evaluationsinstrument auseinander setzen. Besonders interessant: Artikel von S. Hanard, der peer review und stat. Methoden miteinander vergleicht.
Abstract:
Research productivity is not constant over the lifetime of a researcher but fluctuates substantially and often seems to follow a typical pattern. But despite stable aggregate patterns there is substantial variation of research output across individuals. Our paper aims at explaining systematic differences in lifecycle productivity patterns with differences in career incentives. We develop a theoretical model in which lifecycle research productivity is driven by a combination of incentives to invest in skills and/or to produce output. Both incentives depend on career characteristics which are set by within national university systems. From our model we derive testable hypotheses on variations in individual research productivity profiles within and across countries. We test our implications based on a unique data set which we collected for 112 (business) economists in the US and 189 in Germany. We find that promotion tournaments in the US as well as in Germany provide very effective incentives. In general this leads to elevated publication outputs in time periods preceding a major promotion and to reduced publication productivity afterwards. But we also find striking differences between US and German researchers. Skill acquisition is more important for German researchers in the screening period since the first promotion decision is strongly influenced by a qualification requirement, the so-called Habilitation. Also, German researchers lack a second major career step in comparison to US researchers, for whom a promotion to full professor is almost as important as the promotion to associate professor. Re-appointments in the German university system offer comparatively low gains and are thereby not attractive enough to induce a significant increase in research output. Therefore, incentives and publication productivity are highest early in the career of German researchers levelling off on a lower but decent level afterwards. For US researchers the situation is different. Their research output is not only significantly higher prior to their first appointment but also prior to a promotion to full professor, indicating that this promotion provides a second effective incentive to foster research output over a longer period of time. However, after promotion to full professor research output also levels off at a significantly lower level.
Die Seite beschreibt, wie Bibliometrie an der KI genutzt werden muß von den Forschern zur Evaluation ihres Outputs.
Interessante Texte sind in der Website enthalten.
Post-publication journals
- wie in der Masse die Artikel finden, die für einen wichtig sind: Netzwerk von Empfehlungen
- Idee eines neuen Bewertungssystems , basierend auf der Zahl der click von oa Zss und dann Weiterleitung an nächst wichtigere Zeitschrift (check)