Using Reinforcement Learning and Simulation to Develop Autonomous Vehicle Control Strategies PolySync Technologies

Format:

Book

Conference/Event

Author/Creator:

Navarro, Anthony, author.

Contributor:

Asher, Zachary

Fanas Rojas, Johan

Genc, Sahika

Goberville, Nick

Khalil, Rana

Rangarajan, Premkumar

Conference Name:

WCX SAE World Congress Experience (2020-04-21 : Detroit, Michigan, United States)

Language:

English

Physical Description:

1 online resource cm

Place of Publication:

Warrendale, PA SAE International 2020

Summary:

While machine learning in autonomous vehicles development has increased significantly in the past few years, the use of reinforcement learning (RL) methods has only recently been applied. Convolutional neural networks (CNNs) became common for their powerful object detection and identification and even provided end-to-end control of an autonomous vehicle. However, one of the requirements of a CNN is a large amount of labeled data to inform the neural network. While data is becoming more accessible, these networks are still sensitive to the format and collection environment which makes the use of others' data more difficult. In contrast, RL develops solutions in a simulation environment by trial and error without labeled data. Our research expands upon previous research in RL and proximal policy optimization (PPO) and the application of these algorithms to 1/18th scale cars by expanding the application of this control strategy to a full-sized passenger vehicle. By using this method of unsupervised learning, our research demonstrates the ability to learn new control strategies while in a simulation environment without the need for large amounts of real-world data. The use of simulation environments for RL is important as the unsupervised learning methodology requires many trials to learn appropriate behavior. Running this in the real-world would be expensive and impractical, however the simulation enables the solutions to be developed at low cost and time as the process can be accelerated beyond real-time. The simulation environment has high-fidelity to model vehicle dynamics as well as rendering capability for domain adaptation, and guarantees successful simulation-to-real world transfer. Traditional control algorithms are used on the strategies developed to ensure a proper mapping to the physical vehicle it is being applied to. This approach results in a low cost, low data solution that enables control of a full-sized, self-driving passenger vehicle

Notes:

Vendor supplied data

Publisher Number:

2020-01-0737

Access Restriction:

Restricted for use by site license