Production-Ready Automated ECU Calibration Using Residual Reinforcement Learning RWTH Aachen University

Format:

Book

Conference/Event

Author/Creator:

Kampmeier, Andreas, author.

Badalian, Kevin, author.

Koch, Lucas, author.

Lee, Sung Yong, author.

Andert, Jakob, author.

Conference Name:

2026 Stuttgart International Symposium (2026-07-08 : Stuttgart, Germany)

Language:

English

Subjects (All):

Neural networks.

Optimization.

Machine learning.

Hardware-in-the-loop (HIL).

Electronic control units.

Product development.

Local Subjects:

Neural networks.

Optimization.

Machine learning.

Hardware-in-the-loop (HIL).

Electronic control units.

Product development.

Physical Description:

1 online resource

Place of Publication:

Warrendale, PA SAE International 2026

Summary:

Electronic Control Units (ECUs) have played a pivotal role in transforming motorcars of yore into the modern vehicles we see on our roads today. They actively regulate the actuation of individual components and thus determine the characteristics of the whole system. In this, the behavior of the control functions heavily depends on their calibration parameters which engineers traditionally design by hand. This is taking place in an environment of rising customer expectations and steadily shorter product development cycles. At the same time, legislative requirements are increasing while emission standards are getting stricter. Considering the number of vehicle variants on top of all that, the conventional method is losing its practical and financial viability. Prior work has already demonstrated that optimal control functions can be automatically developed with reinforcement learning (RL); since the resulting functions are represented by artificial neural networks, they lack explainability, a circumstance which renders them challenging to employ in production vehicles. In this article, we present an explainable approach to automating the calibration process using residual RL which follows established automotive development principles. Its applicability is demonstrated by means of a map-based air path controller in a series control unit using a hardware-in-the-loop (HiL) platform. Starting with a sub-optimal map, the proposed methodology quickly converges to a calibration which closely resembles the reference in the series ECU. The results prove that the approach is suitable for the industry where it leads to better calibrations in significantly less time and requires virtually no human intervention

Notes:

Vendor supplied data

Access Restriction:

Restricted for use by site license