Synergy of Eye and Hand: Multimodal Biomarkers for Cognitive Assessment

Synergy of Eye and Hand: Multimodal Biomarkers for Cognitive Assessment

Stať ve sborníku v databázi WoS či Scopus

Traditional handwriting analysis for neurological assessment captures motor output but largely misses the guiding cognitive processes like visuospatial planning and attention. This study introduces a multimodal approach, combining online handwriting kinematics with concurrent eye-tracking data from 48 older adults performing the Pentagon Copy Test (PCT). We extracted novel feature sets, including Hand-Eye Coupling (HEC) and Fractional Derivative (FD) biomarkers, and used an XGBoost classifier with Recursive Feature Elimination (RFE) to predict a binarized PCT performance score. Our final model, integrating all features, achieved a Balanced Accuracy (BACC) of 90%, significantly outperforming a model trained on baseline features alone (79% BACC). The findings demonstrate that integrating eye-tracking data with advanced handwriting analysis provides a powerful and holistic tool for objectively assessing cognitive-motor performance, highlighting its potential as a sensitive digital biomarker.

Traditional handwriting analysis for neurological assessment captures motor output but largely misses the guiding cognitive processes like visuospatial planning and attention. This study introduces a multimodal approach, combining online handwriting kinematics with concurrent eye-tracking data from 48 older adults performing the Pentagon Copy Test (PCT). We extracted novel feature sets, including Hand-Eye Coupling (HEC) and Fractional Derivative (FD) biomarkers, and used an XGBoost classifier with Recursive Feature Elimination (RFE) to predict a binarized PCT performance score. Our final model, integrating all features, achieved a Balanced Accuracy (BACC) of 90%, significantly outperforming a model trained on baseline features alone (79% BACC). The findings demonstrate that integrating eye-tracking data with advanced handwriting analysis provides a powerful and holistic tool for objectively assessing cognitive-motor performance, highlighting its potential as a sensitive digital biomarker.

Digital Biomarkers, Eyetracking, Fractional Calculus, Handwriting, Pentagon Copy Test

Digital Biomarkers, Eyetracking, Fractional Calculus, Handwriting, Pentagon Copy Test

GAVENČIAK, M.; MUCHA, J.; MEKYSKA, J.; FAÚNDEZ ZANUY, M.; FERRER-RAMOS, P.

2026

03.11.2025

IEEE

Florence, Italy

979-8-3315-7675-2

2025 17th International Congress on Ultra Modern Telecommunications and Control Systems and Workshops (ICUMT)

278

283

5

https://ieeexplore.ieee.org/document/11268615

http://hdl.handle.net/11012/255775