Přístupnostní navigace
E-application
Search Search Close
Master's Thesis
Author of thesis: Ing. José Manuel Melero Anaya
Acad. year: 2025/2026
Supervisor: prof. Ing. Aleš Prokeš, Ph.D.
Reviewer: Ing. Jan Král, Ph.D.
This master’s thesis presents a multimodal perception framework for autonomous vehicles operating in challenging terrain, focusing on the integration of radar and camera sensors into a unified semantic embedding space for navigation and localization. The proposed approach introduces an intermodal fusion architecture based on convolutional encoders, cross-attention mechanisms, and feature integration with a gate. The system is trained using contrastive learning (InfoNCE), which aligns radar and visual representations in a shared latent space. To enhance robustness and spatial consistency, a GPS-constrained batch sampling strategy is introduced, ensuring geographically diverse training batches. Additionally, a modality dropout mechanism is employed to simulate sensor degradation and missing modalities. The system is evaluated on a multimodal dataset containing synchronized camera images, radar scans, and GPS trajectories. Experimental results show that the proposed fusion model consistently outperforms monomodal baseline models in search-based localization tasks. Furthermore, the radar modality significantly improves robustness under adverse visual conditions, such as noise, blurring, and lighting changes. The learned embedding space exhibits strong intermodal alignment and meaningful geometric structure, confirming the effectiveness of the proposed approach for learning multimodal semantic representations.
Radar-Camera Fusion, Unmanned Ground Vehicles, Autonomous Driving, Multimodal Learning, Contrastive Learning, InfoNCE loss, Cross-Attention, Semantic Embeddings, Localization, Off-Road Navigation, Sensor Fusion
Date of defence
10.06.2026
Result of the defence
Defended (thesis was successfully defended)
Grading
A
Process of defence
At first, the student presented the results of his diploma thesis. The opinions were then read and student agreed with both of opinions without any comments. Then came the questions: 1) Student presented his answers for 2 questions from oppononet opinion. 2) prof. Prokes: what you expect when you use more comprehensive dataset include building, people, more cars etc.? -student answered and then explained that he used only simple dataset on one road without the traffic
Language of thesis
English
Faculty
Fakulta elektrotechniky a komunikačních technologií
Department
Department of Radio Electronics
Study programme
Automotive Electronics and Electromobility (MPA-AEE)
Composition of Committee
prof. Ing. Aleš Prokeš, Ph.D. (předseda) doc. Ing. Jaroslav Láčík, Ph.D. (místopředseda) Ing. Michal Kubíček, Ph.D. (člen) doc. Ing. Pavel Vorel, Ph.D. (člen) Ing. Zdeněk Kincl, Ph.D. (člen)
Supervisor’s reportprof. Ing. Aleš Prokeš, Ph.D.
Grade proposed by supervisor: A
Reviewer’s reportIng. Jan Král, Ph.D.
Grade proposed by reviewer: B
Responsibility: Mgr. et Mgr. Hana Odstrčilová