Incorporating the Scenario-Based Framework Underpinned by Operational Design Domain (ODD) for Automated Driving Stack (ADS) Evaluation WMG, University of Warwick

Format:

Book

Conference/Event

Author/Creator:

Chodowiec, Emil, author.

Contributor:

Baker, Peter

Jennings, Paul

Khastgir, Siddartha

Mitchell, Joseph S. B.

Zhang, Xizhe

Conference Name:

WCX SAE World Congress Experience (2025-04-08 : Detroit, Michigan, United States)

Language:

English

Physical Description:

1 online resource cm

Place of Publication:

Warrendale, PA SAE International 2025

Summary:

The rapid development of open-source Automated Driving System (ADS) stacks has created a pressing need for clear guidance on their evaluation and selection for specific use cases. This paper introduces a scenario-based evaluation framework combined with a modular simulation framework, offering a scalable methodology for assessing and benchmarking ADS solutions, including but not limited to off-the-shelf designs. The study highlights the lack of clear Operational Design Domain (ODD) descriptions in such systems. Without a common understanding, users must rely on subjective assumptions, which hinders the process of accurate system selection. To address this gap, the study proposes adopting a standardised ISO 34503 ODD description format within the ADS stacks. The application of the proposed framework is showcased through a case study evaluating two open-source systems, Autoware and Apollo. By first defining the assumed system's ODD, then selecting a relevant scenario, and establishing pass/fail criteria, the framework provides objective data to highlight performance differences between both systems. The proposed methodology provides an unbiased foundation for informed decision-making, promoting the safe and effective integration of ADS technologies

Notes:

Vendor supplied data

Publisher Number:

2025-01-8067

Access Restriction:

Restricted for use by site license