Detail projektu

Multimodal Human-Machine Interfaces for Morphing Computerized Mats with Embodied Sensing and Artificial Intelligence

Období řešení: 1.5.2024 — 30.9.2026

Zdroje financování

Evropská unie - HORIZON EUROPE

O projektu

The MOZART project aims to advance the state of the art in robotic handling and manipulation of soft and heterogeneous objects. Its
approach is a radical departure from existing technologies as it develops a new concept based on deformable manipulation surfaces
supported by AI-powered control and learning tools. While the running project primarily addresses the development of hardware and
control algorithms, human-machine interaction is less explored. The role of the new partner - Brno University of Technology, Czechia
(BUT), in the proposed project extension is mainly to research the field of Human-Machine Interaction (HMI), explicitly identifying user
roles, needs, and necessary interface types, iteratively developing prototypes, and performing evaluation. Usability testing will be
carried out in multiple stages of development, including aspects of the social science perspective (with the help of SSH research
experts from partner TCD), to assess the system's natural fit with diverse operators. Various input and output modalities and their
combinations will be evaluated, including the manipulation surface itself and augmented and virtual reality. Machine learning may be
used to achieve the adaptivity of the interface. Various types of interfaces that will be developed will be backed up by a cloudenabled
server, acting as a data platform, enabling data sharing between users and offloading computationally intensive tasks. BUT
aims to contribute to MOZART's goal of automating the food industry by designing effective user interfaces that enhance system
acceptance, leveraging the team's extensive experience in this field.

Klíčová slova
Human-machine interaction, multimodal processing, novel manipulation, usability test

Označení

101159156

Originální jazyk

angličtina

Řešitelé

Smrž Pavel, doc. RNDr., Ph.D. - hlavní řešitel
Bambušek Daniel, Ing. - spoluřešitel
Bařina David, Ing., Ph.D. - spoluřešitel
Dobeš Petr, Ing. - spoluřešitel
Dočekal Martin, Ing. - spoluřešitel
Dytrych Jaroslav, Ing., Ph.D. - spoluřešitel
Juránek Roman, Ing., Ph.D. - spoluřešitel
Juránková Markéta, Ing., Ph.D. - spoluřešitel
Kapinus Michal, Ing., Ph.D. - spoluřešitel
Klíma Ondřej, Ing., Ph.D. - spoluřešitel
Materna Zdeněk, Ing., Ph.D. - spoluřešitel
Matýšek Michal, Ing. - spoluřešitel
Musil Petr, Ing., Ph.D. - spoluřešitel
Otrusina Lubomír, Ing. - spoluřešitel
Páleník Martin, Mgr. - spoluřešitel
Starka Tomáš, Ing. - spoluřešitel
Strýček Šimon, Ing. - spoluřešitel
Šolony Marek, Ing., Ph.D. - spoluřešitel
Vlnas Michal, Ing. - spoluřešitel
Zemčík Pavel, prof. Dr. Ing., dr. h. c. - spoluřešitel

Útvary

Ústav počítačové grafiky a multimédií
- odpovědné pracoviště (27.9.2023 - nezadáno)
Ústav počítačové grafiky a multimédií
- příjemce (1.5.2024 - 30.9.2026)

Výsledky

MATERNA, Z.; KAPINUS, M.; BAMBUŠEK, D.; BERAN, V.; SMRŽ, P. Exploring Co-located Collaborative Visual Programming of Industrial Robotic Workplaces in Handheld AR. Proceedings of the 2026 CHI Conference on Human Factors in Computing Systems. New York, NY, USA: Association for Computing Machinery, 2026. 11 p. ISBN: 979-8-4007-2278-3.
Detail