详情

原文传递 Framework of Active Obstacle Avoidance for Autonomous Vehicle Based on Hybrid Soft Actor-Critic Algorithm

题名：	Framework of Active Obstacle Avoidance for Autonomous Vehicle Based on Hybrid Soft Actor-Critic Algorithm
正文语种：	eng
作者：	Yuanhang Chen;Shaofang Wu
作者单位：	School of Intelligent Systems Engineering Guangdong Provincial Key Laboratory of Intelligent Transport System Sun Yat-Sen Univ. Guangzhou 510006 China;School of Intelligent Systems Engineering Guangdong Provincial Key Laboratory of Intelligent Transport System Sun Yat-Sen Univ. Guangzhou 510006 China
关键词：	Autonomous vehicle; Model predictive control (MPC); Soft actor-critic (SAC) algorithm; Path planning; Path tracking; Dual actor networks
摘要：	In this paper, a framework of active obstacle avoidance for autonomous vehicles based on the hybrid soft actor-critic (SAC) algorithm is proposed. In the stage of local path planning, a comprehensive cost function considering collision risks, deviation from the global route, road lines crossing, and driving comfortability is developed to provide a local optimal path avoiding both static and dynamic obstacles considering multiple predicting timesteps. Then, a path tracking controller on the foundation of a hybrid SAC algorithm is designed to mitigate the problem of high sample complexity caused by random initialization of parameters in conventional reinforcement learning approaches. Model predictive control (MPC) plays a guiding role by applying its control action to combine with the action of SAC online to obtain a more effective state and reward information for training. The mechanism of the combination of MPC with SAC to balance the exploration and reliability is explained in detail. In order to improve the convergence rate and learning efficiency, a dual actor network structure for two different control actions is adopted. With considerations of various relevant factors influencing the control effect, the reward for the hybrid SAC algorithm is designed carefully. Finally, the results of simulation experiments illustrate that the proposed approach performs effectively with the assurance of safety and driving comfortability. In summary, the hybrid SAC algorithm with dual actor networks performs better than other algorithms for comparison in all test scenarios in this paper.
出版年：	2023
期刊名称：	Journal of Transportation Engineering
卷：	149
期：	4
页码：	04023002.1-04023002.20