Workload Estimation for a Military Ground Vehicle Crew using Supervised Machine Learning of FACS Action Unit Intensity Data U.S. Army DEVCOM GVSC

Format:

Book

Conference/Event

Author/Creator:

Mikulski, Christopher, author.

Contributor:

Riegner, Kayla

Conference Name:

WCX SAE World Congress Experience (2025-04-08 : Detroit, Michigan, United States)

Language:

English

Physical Description:

1 online resource cm

Place of Publication:

Warrendale, PA SAE International 2025

Summary:

The proliferation of intelligent technologies in the future battlefield necessitates an exploration of crew workload balancing strategies for human-machine integrated formations. Many current techniques to measure cognitive workload, through qualitative surveys or wearable sensors, are too brittle for the harsh, austere operational environments found in military settings. Non-invasive workload estimation techniques, such as those that analyze physiological effects from video feeds of the crew, present a way forward for workload-aware Soldier-machine interfaces that could trigger events such as task reallocation if limits on crew or individual workload are exceeded. One such technique that is being explored is the use of facial expression analysis for workload estimation. We present the performance results of regression and classification models developed from supervised machine learning algorithms that predict pNN50, a common heart rate variability metric used as a physiological measure for workload, from action unit intensity data of the Facial Action Coding System (FACS). Drawing from these results, we propose implementation recommendations for leveraging facial expressions to inform crew workload in workload-aware Soldier-machine interfaces. We conclude with a discussion on open challenges and areas of exploration for non-invasive workload estimation in military vehicle applications

Notes:

Vendor supplied data

Publisher Number:

2025-01-8340

Access Restriction:

Restricted for use by site license