Human Activity Recognition from Smartphone Sensor Data for Clinical Trials

We developed a ResNet-based human activity recognition (HAR) model with minimal overhead to detect gait versus non-gait activities and everyday activities (walking, running, stairs, standing, sitting, lying, sit-to-stand transitions). The model was trained and evaluated using smartphone sensor data from adult healthy controls (HC) and people with multiple sclerosis (PwMS) with Expanded Disability Status Scale (EDSS) scores between 0.0-6.5. Datasets included the GaitLab study (ISRCTN15993728), an internal Roche dataset, and publicly available data sources (training only). Data from 34 HC and 68 PwMS (mean [SD] EDSS: 4.7 [1.5]) were included in the evaluation. The HAR model showed 98.4% and 99.6% accuracy in detecting gait versus non-gait activities in the GaitLab and Roche datasets, respectively, similar to a comparative state-of-the-art ResNet model (99.3% and 99.4%). For everyday activities, the proposed model not only demonstrated higher accuracy than the state-of-the-art model (96.2% vs 91.9%; internal Roche dataset) but also maintained high performance across 9 smartphone wear locations (handbag, shopping bag, crossbody bag, backpack, hoodie pocket, coat/jacket pocket, hand, neck, belt), outperforming the state-of-the-art model by 2.8% - 9.0%. In conclusion, the proposed HAR model accurately detects everyday activities and shows high robustness to various smartphone wear locations, demonstrating its practical applicability.

Annotation and synchronization of smartphone inertial measurement unit and motion capture data collected in a laboratory setting to study gait and balance

Validating smartphone sensor-based tests to study gait and balance against reference measurement systems in a laboratory setting poses several technical challenges related to data quality and data processing. One challenge is to guarantee the correct annotation of the data, which is required to ensure that only data collected during the same test execution are compared across measurement systems in subsequent analyses. A second challenge is to accurately synchronize the data across the different systems. Here, we propose innovative solutions for both challenges and illustrate their use in the example of comparing smartphone sensor data collected with the Floodlight technology with data collected with a motion capture system. These solutions form important tools for guaranteeing the data quality and data integrity required for the validation of gait and balance characteristics measured by digital health technology tools such as the Floodlight technology.