Decision-Making Method Combining Path Constraints-based Action Compensation for Autonomous Vehicles

Haiyan Zhao, Jingdi Cao, Xinghao Lu, Chengcheng Xu, Hong Chen

2025/6/03

IEEE Sensors Journal

Early Access 

Abstract：

In order to improve the performance and reliability of the decision-making process for autonomous vehicles, a decision-making method using deep reinforcement learning (DRL) and combining path constraints-based action compensation is proposed in this paper. In the decision-making method, an action compensation module based on path constraints is developed, which enhances the reliability of the decision of vehicle and ensures that the final output actions meet safety and comfort requirements. Additionally, the traditional reinforcement learning task is divided into three subtasks, and the switching between the subtasks is realized by the scene recognition module. It reduces the complexity of the task and improves the training efficiency and sample utilization. Moreover, rewards and penalties are designed within path constraints, incorporating the distance from the lane center and the heading deviation angle. This can provide efficient and timely feedback for the vehicle during environmental interactions, accelerating the training process and improving decision-making performance. Finally, experiments are conducted using the CARLA simulation platform. The results show that the proposed method not only enables reliable decision-making but also improves the performance of vehicle, ensuring smooth control of the vehicle through the driving task, which verifies the effectiveness of the proposed method.

Cite：

@ARTICLE{11023107,
  author={Zhao, Haiyan and Cao, Jingdi and Lu, Xinghao and Xu, Chengcheng and Chen, Hong},
  journal={IEEE Sensors Journal}, 
  title={Decision-Making Method Combining Path Constraints-based Action Compensation for Autonomous Vehicles}, 
  year={2025},
  volume={},
  number={},
  pages={1-1},
  doi={10.1109/JSEN.2025.3574069}}