1 option
An AI-Based Embedded Offline Voice Assistant for Commercial Trucks: Enhancing Driver Safety and HMI Design
- Format:
- Book
- Conference/Event
- Author/Creator:
- De Oliveira Nelson, Rafael, author.
- Conference Name:
- SAE Brasil 2025 Congress (2025-10-07 : Sao Paolo, Brazil)
- Language:
- English
- Physical Description:
- 1 online resource cm
- Place of Publication:
- Warrendale, PA SAE International 2025
- Summary:
- Commercial vehicle operation faces challenges from driver distraction associated with traditional Human-Machine Interfaces (HMIs) and inconsistent network connectivity, particularly in long-haul scenarios. This paper addresses these issues through the development and presentation of an embedded, offline AI-powered voice assistant. The system is designed to reduce driver distraction and enhance operational efficiency by enabling hands-free control of vehicle functions and access to critical information, irrespective of internet availability. The technical approach involves a three-tier architecture comprising an Android-based In-Vehicle Infotainment (IVI) unit for primary user interaction and voice processing, an Android mobile device acting as a communication bridge and processing hub, and a proprietary OBD-II dongle for CAN bus interfacing. Offline speech recognition is achieved using embedded wake word detection and speech-to-intent engines. A user-centered design methodology, informed by a field study with 25 professional truck drivers in Brazil, guided the prioritization of system functionalities. Key findings from this study highlighted strong driver interest in voice interaction for vehicle status monitoring (e.g., fluid levels, fault alerts) and control of essential systems (e.g., lighting, cabin environment). The implemented prototype successfully integrates these prioritized features, demonstrating the viability of offline voice control. Preliminary observations indicate robust wake word and intent recognition accuracy (97% based on vendor benchmarks) and acceptable system responsiveness (400-700 ms latency) under typical cabin noise conditions. This work establishes a foundation for safer, more intuitive HMIs in software-defined commercial vehicles, emphasizing the importance of offline capabilities for reliable operation
- Notes:
- Vendor supplied data
- Publisher Number:
- 2025-36-0078
- Access Restriction:
- Restricted for use by site license
The Penn Libraries is committed to describing library materials using current, accurate, and responsible language. If you discover outdated or inaccurate language, please fill out this feedback form to report it and suggest alternative language.