A Full-Process, Fine-Grained, and Quantitative Rehabilitation Assessment Platform Enabled by On-Skin Sensors and Multi-Task Gait Transformer Model

Rehabilitation of patients with lower limb movement disorders is a gradual process, which requires full-process assessments to guide the implementation of rehabilitation plans. However, the current methods can only complete the assessment in one stage and lack objective and quantitative assessment strategies. Here, a full-process, fine-grained, and quantitative rehabilitation assessments platform (RAP) supported by on-skin sensors and a multi-task gait transformer (MG-former) model for patients with lower limb movement disorders is developed. The signal quality and sensitivity of on-skin sensor is improved by the synthesis of high-performance triboelectric material and structure design. The MG-former model can simultaneously perform multiple tasks including binary classification, multiclassification, and regression, corresponding to assessment of fall risk, walking ability, and rehabilitation progress, covering the whole rehabilitation cycle. The RAP can assess the walking ability of 23 hemiplegic patients, which has highly consistent results with the scores by the experienced physician. Furthermore, the MG-former model outputs fine-grained assessment results when performing regression task to track slight progress of patients that cannot be captured by conventional scales, facilitating adjustment of rehabilitation plans. This work provides an objective and quantitative platform, which is instructive for physicians and patients to implement effective strategy throughout the whole rehabilitation process.