What question did this study set out to answer?

The aim is to develop a robust framework for accurate gait speed analysis using multimodal data and deep learning techniques.

March 1, 2026PLoS ONE0 citationsOpen Access

Explainable AI for gait speed analysis from multimodal data fusion

View Full Paper

AAAbdullah Alharthi AAAbdulrahman Al Ayidh AAAhmed Alqurashi

Key Points

The aim is to develop a robust framework for accurate gait speed analysis using multimodal data and deep learning techniques.
Developed a hybrid model combining CNN and LSTM.
Benchmarked against various neural network architectures and statistical classifiers.
Employed three distinct cross-validation strategies for training and validation.
Applied Layer-wise Relevance Propagation for feature relevance evaluation.
Achieved highest F1 scores with the Multi-stream Quads CNN (up to 98% accuracy).
Outperformed traditional gait analysis methods across all experiments.
Demonstrated robustness through comprehensive performance evaluations including ROC curves and perturbation analyses.

Abstract

Gait speed analysis is vital for applications in healthcare, rehabilitation, human-robot interaction, and autonomous systems, necessitating robust methods to address its complexity. This study introduces an advanced framework for gait speed classification through multimodal data fusion and deep learning, optimized using Layer-wise Relevance Propagation (LRP). Utilizing a publicly available 4 datasets of 50 injury-free adults walking at varying speeds, we integrate data from full-body motion capture, electromyography (EMG), and force plates to capture detailed gait dynamics. We propose two novel architectures: a hybrid Convolutional Neural Network with Long Short-Term Memory (CNN+LSTM) and a Multi-stream CNN, benchmarked against Temporal Convolutional Networks (TCNs), Transformer neural networks, Gated Recurrent Units (GRU) and statistical classifiers (e.g., Linear Discriminant Analysis, Quadratic Discriminant Analysis, Support Vector Machines). All models in this study were trained, validated and tested using three distinct strategies: experiment 1 (sample-based splitting – 10-fold cross-validation), experiment 2 (10-fold cross-validation, subject-based splitting – 5 subjects for testing), and experiment 3 (5-fold cross-validation, subject-based splitting – 10 subjects for testing). Multi-stream Quads CNN is the best-performing model, achieving the highest F1 scores across all experiments (96.6% ± 1.4% experiment 1, 96.2% ± 1.6% experiment 2, 95.9% ± 0.9% experiment 3 with top performance for all experiments 98% ± 0.6%, outperforming traditional approaches. LRP is applied to evaluate feature relevance within the model, enabling the removal of critical features to verify robustness. Comprehensive assessments, including ROC curves, confusion matrices, t-test, and perturbation analyses, validate the model’s enhanced performance and durability. By combining multimodal fusion to overcome single-sensor constraints with LRP-driven feature optimization, this work provides a highly accurate and resilient tool for gait analysis, with significant potentials.

KI fragen

Bookmark

View Full Paper

Cite This Study

Alharthi et al. (Fri,) studied this question.

synapsesocial.com/papers/69a3d887ec16d51705d2f850 https://doi.org/https://doi.org/10.1371/journal.pone.0341067

KI fragen

Bookmark

View Full Paper