Suspension Control Strategies Using Switched Soft Actor-Critic Models for Real Roads

Hwanmoo Yong, Joohwan Seo, Jaeyoung Kim, Myonghoe Kim, Jongeun Choi

Research output: Contribution to journalArticlepeer-review

6 Citations (Scopus)

Abstract

In this paper, we propose learning and control strategies for a semi-active suspension system in a full car using soft actor-critic (SAC) models on real roads, where many road profiles with various power of disturbance exist (e.g., speed bumps and general roads). Therefore, a technique that enables deep reinforcement learning to cover different domains with largely different reward functions is proposed. This concept was first realized in a simulation environment. Our proposed switching learning system continuously identifies two different road disturbance profiles in real-time such that the appropriately designed SAC model can be learned and applied accordingly. The results of the proposed switching SAC algorithm were compared against those of advanced and conventional benchmark suspension systems. Based on the results, the proposed algorithm showed smaller root mean square values of the z-directional acceleration and pitch at the center of the body mass. Finally, we also presented a successfully implemented our SAC training system in a real car on real roads. The trained SAC model outperforms conventional controllers reducing the z-directional acceleration and pitch, similar to the simulation results, which is highly related to the riding comfort and vehicle maneuverability.

Original languageEnglish
JournalIEEE Transactions on Industrial Electronics
DOIs
Publication statusPublished - 2023 Jan 1

Bibliographical note

Publisher Copyright:
IEEE

All Science Journal Classification (ASJC) codes

  • Control and Systems Engineering
  • Electrical and Electronic Engineering

Fingerprint

Dive into the research topics of 'Suspension Control Strategies Using Switched Soft Actor-Critic Models for Real Roads'. Together they form a unique fingerprint.

Cite this