Přístupnostní navigace
E-application
Search Search Close
Brno University of Technology conducted a two-phase internal evaluation of its scientific and creative activities over the past two years. In the first phase, the university evaluated its performance in key research and development areas and then invited international experts to review faculty institutes and doctoral studies at BUT. The entire process provided a comprehensive view of the quality and efficiency of research from various perspectives and, above all, prepared the university for this year’s evaluation of Czech higher education institution segment.
Evaluators at the Faculty of Architecture, BUT. | Author: Václav KoníčekThe new phase of research organization evaluation in the Czech Republic began in 2017 with the creation of the Methodology 17+, which replaced the previously criticized system known as the “coffee grinder.” Based on this methodology, a comprehensive evaluation of research organizations in the higher education sector is prepared every five years. This evaluation awaits Czech universities this year, and its results will influence their funding for the next five years.
A unique two-phase internal evaluation of scientific and creative activities at BUT in 2023 and 2024 served as preparation. The first phase took place in 2023 and focused on a comprehensive evaluation of research according to the key FORD (Fields of Research and Development) areas, both through benchmarking with other European universities and through self-assessment by faculties. The second phase in 2024 was conducted as a peer review of faculty institutes with the participation of more than 50 international reviewers and members of the BUT International Scientific Advisory Board.
Welcoming the evaluators at the Rectorate of BUT - Martin Weiter, Vice-rector of BUT for Research and Knowledge Transfer. | Author: Václav Koníček"This demanding but highly beneficial process allowed us to evaluate the quality and efficiency of research from various perspectives and identify our strengths, including opportunities for further development," said Martin Weiter, Vice-Rector for Research and Knowledge Transfer at BUT.
The evaluation of research and doctoral programs at BUT was not a one-off act, but has now become part of the university’s research environment quality management and control system. It is planned to be repeated in five-year intervals. In 2022, BUT became a member of the CoARA coalition and thus committed itself to all the principles outlined in the Agreement on reforming research assessment. The core principle of research assessment, of researchers and research organizations, is above all recognition of the diversity of outputs, approaches, and activities that maximize the quality and impact of research. This requires assessments to be based primarily on qualitative evaluation, with peer review at its heart, supported by responsible use of quantitative indicators. More information about activities focused on responsible evaluation of scientific and artistic activities can be found in the BUT CoARA Action Plan.
"First, we took a bird’s-eye view – we assessed how our faculties perform in a European comparison in our key FORD fields and how well they are able to reflect on their own research and artistic activities," explained Vice-Rector Weiter of the first phase.
Evaluators at the Energy Institute of the Faculty of Mechanical Engineering, BUT. | Author: Václav KoníčekThe result showed that in terms of citations and international collaboration, BUT ranks among the European elite, for example in chemical sciences, earth sciences, as well as related environmental sciences, environmental engineering, and nanotechnology. According to the assessed criteria, it is thus comparable with universities such as ETH Zurich, Imperial College London, or the Royal Institute of Technology (KTH).
The second phase then provided a detailed expert perspective. International experts assessed individual institutes or clusters of institutes. "The combination of both perspectives allowed us to identify strong fields and top research units, as well as areas with room for improvement," Weiter explained.
"The 2024 evaluation was, in my view, a key moment for institutional self-assessment and international comparison. I appreciate the constructive approach of the international reviewers. A notable highlight was the repeated recognition of the technical equipment of laboratories across various research fields by many renowned international experts – this is a strong affirmation of the quality of the infrastructure for scientific work. I consider it a valuable experience to have taken part in this process. The evaluation once again convinced me that our institution maintains a high standard even in an international context," said David Nečas, secretary of the evaluation panel of the BUT Faculty of Mechanical Engineering.
A total of 45 international reviewers and 4 female and 5 male members of the BUT International Scientific Advisory Board took part in the evaluation, which focused on the period 2019–2023. They included representatives from institutions in 25 countries, including the USA and Japan. Given the predominance of technical fields, it is noteworthy that the organizers from BUT achieved one-third female representation in the evaluation panels.Each evaluated institute at BUT was reviewed by at least three international reviewers, and each evaluation panel had its own lead expert with relevant expertise.
In their work, the reviewers drew on detailed self-assessment reports provided by the faculty institutes of BUT, supplemented by bibliometric and other analyses. Their interaction with BUT representatives included two online meetings to clarify the materials, followed by a three-day meeting at BUT. This included meetings with the university and faculty leadership, detailed interviews with representatives of the evaluated institutes, and laboratory visits.Meeting with the evaluation team at the Faculty of Electrical Engineering and Communication, BUT. | Author: Václav Koníček
"During our visit to the Faculty of Chemistry, we were deeply impressed by the exceptionally friendly, collaborative, and creative atmosphere fostered by the faculty's staff and students. This collegial environment undoubtedly provides a solid foundation for excellence in research, teaching, and innovation. We believe our recommendations will help further strengthen the faculty’s advantages and address areas needing improvement so that it continues to fulfill its mission as a leader in chemical education and research."
From the evaluation panel members of the Faculty of Chemistry (Prof. Iza Radecka, Prof. Dr. Marija Bešter Rogač, Prof. Giuseppe Lazzara, and Prof. Dr. Hab. Ewa Bulska)
To ensure that the entire evaluation process was transparent and objective (e.g., to avoid conflicts of interest among reviewers), the process needed to be carefully planned. One of the contributors to this was the involvement of the International Scientific Advisory Board (ISAB) of BUT in the evaluation process.
Welcome at the Faculty of Mechanical Engineering BUT. | Author: Václav KoníčekISAB is composed of respected foreign experts (e.g., Sabine Seidler – former rector of TU Wien, Detlef Günther – former vice-president of ETH Zurich, or Jarmo Takala – vice-president of Tampere University) with extensive experience in managing prestigious universities, enabling them to provide the university with valuable strategic recommendations for managing research support activities.
In the first evaluation phase, ISAB provided feedback on the evaluation methodology and made recommendations for the second phase. It then oversaw the entire evaluation process, ensuring its transparency and especially consistency across panels and faculties.
"The panel recommended focusing on long-term support for research primarily through prestigious grants, which we will strive for. Both the evaluation process and its outcomes are instructive for us. We especially appreciated the subject-specific relevance of the evaluation. For example, publications at top-tier computer science conferences, which are practically invisible in national evaluations, were well received by the panel," shared reviewer feedback Lukáš Sekanina, Head of the Department of Computer Systems at the Faculty of Information Technology at BUT.
The evaluation covered a total of 43 scientific and artistic departments. Most institutes were rated as above standard to excellent at an international level:
The following units received the A1 excellent rating:
Department of Telecommunications at the Faculty of Electrical Engineering and Communication, Department of Computer Graphics and Multimedia, and Department of Computer Systems, both at the Faculty of Information Technology. Additionally, three research groups at CEITEC BUT had already been similarly rated earlier – Fabrication and Characterization of Nanostructures; Bioelectronics Materials and Devices; Future Energy and Innovation. (CEITEC BUT, which undergoes regular evaluation within the CEITEC consortium, was assessed a year earlier, editor’s note.)
In addition to scientific departments, 28 doctoral study programs were also evaluated. Here, reviewers did not assign ratings but provided recommendations for improving the quality of teaching, doctoral support, and international engagement.Evaluators at the Faculty of Architecture, BUT. | Author: Václav Koníček
The evaluation provided valuable insights into the quality of research and creative activities at BUT in an international context. It identified strengths as well as areas with potential for improvement. The data and recommendations obtained are key foundations for the strategic development of the university and its faculties.
The evaluation report is accessible after logging in to the BUT employee repository (document in Czech language).
“Evaluations 2023 and 2024 have provided our faculty with valuable insights and allowed us to better understand our strengths and areas that require further development. The results have thus become an important analytical basis for the newly formulated strategy of creative activities. The specific recommendations from the evaluators regarding the thematic focus of the faculty's creative activities, as well as the management and organization of creative activities, are very valuable to us. We are implementing the measures and believe that the evaluation process has increased our readiness for this year's national evaluation,” offered her perspective Marie Pavláková Dočekalová, Vice-Dean for Science, Research, and Creative Activities at the Faculty of Business and Management BUT.
Among the key recommendations is strengthening interdisciplinary cooperation and better coordination of research activities between faculties. The university has already taken steps to achieve this goal – five strategic areas with more than twenty themes of interfaculty cooperation have been defined. Each theme will have its own guarantor and coordinator, who will ensure effective connection across faculties and coordination of cooperation in the given areas.
{{photo|VUT_BR_ISAB-Evaluace_2024-11-06_Konicek_152.JPG|800}}Another recommendation is, for example, more efficient sharing of research instruments. BUT has already started working on preparing a platform where it would be possible to share instruments not only of large research infrastructures but also other instruments that are found at individual workplaces across BUT and possibly share them with other research workplaces, for example within the European university EULiST, of which the university is a member.