HMI design in the context of DMS and automation: emerging themes from an expert workshop

This paper consolidates insights from an expert workshop and presents overarching design concepts on how to effectively integrate driver monitoring systems (DMS) into vehicle interfaces. The safety potential of DMS hinges on effective integration with a vehicle’s human–machine interface (HMI), enabling a broader range of response options offered by increasing vehicle autonomy. Integration design significantly influences user experience, acceptance, and consequently, driver safety. Different driver impairment states may require different HMI approaches due to varying physical and behavioural features of driver states, requiring a HMI strategy that is more nuanced and customised than what is typically seen in automotive HMI. Workshop attendees at the 2023 Automotive-UI conference engaged in structured brainstorming, identifying ideal HMI system responses, implementation strategies, and associated risks for the detection of impaired drivers. Brainstorming occurred for two use cases (either distracted or drowsy); first in the context of manual driving, followed by highly automated driving (SAE L3+). Concepts included generic and state-specific responses, and level-of-automation-specific and -agnostic intervention strategies. Notably, DMS-HMI integration extended beyond simple alerts, with concepts addressing short-term risk-mitigation and long-term behaviour-change as intended outcomes. These principles represent contemporary thinking which must be tested and refined as the available technology develops, in turn enabling additional adverse driver states to be addressed. Design norms around DMS-HMI integration are yet to be established. DMS-HMI integration will be critical to the user acceptance and safety benefits of DMS, requiring a nuanced and considered approach.