Deep Deterministic Policy Gradient-Based Autonomous Driving for Mobile Robots in Sparse Reward Environments

In this paper, we propose a deep deterministic policy gradient (DDPG)-based path-planning method for mobile robots by applying the hindsight experience replay (HER) technique to overcome the performance degradation resulting from sparse reward problems occurring in autonomous driving mobile robots....

Full description

Bibliographic Details
Published in:	Sensors
Main Authors:	Minjae Park, Seok Young Lee, Jin Seok Hong, Nam Kyu Kwon
Format:	Article
Language:	English
Published:	MDPI AG 2022-12-01
Subjects:	reinforcement learning deep deterministic policy gradient hindsight experience replay mobile robot autonomous driving sparse reward environments
Online Access:	https://www.mdpi.com/1424-8220/22/24/9574

Similar Items

Autonomous Driving of Mobile Robots in Dynamic Environments Based on Deep Deterministic Policy Gradient: Reward Shaping and Hindsight Experience Replay
by: Minjae Park, et al.
Published: (2024-01-01)

Reward-weighted DHER Mechanism For Multi-goal Reinforcement Learning With Application To Robotic Manipulation Control
by: Xueyu Wei, et al.
Published: (2023-08-01)

Extended Maximum Actor–Critic Framework Based on Policy Gradient Reinforcement for System Optimization
by: Jung-Hyun Kim, et al.
Published: (2025-02-01)

Hindsight Goal Ranking on Replay Buffer for Sparse Reward Environment
by: Tung M. Luu, et al.
Published: (2021-01-01)

Consistent Experience Replay in High-Dimensional Continuous Control with Decayed Hindsights
by: Xiaoyun Feng
Published: (2022-09-01)

Curriculum Learning for Robot Manipulation Tasks With Sparse Reward Through Environment Shifts
by: Erdi Sayar, et al.
Published: (2024-01-01)

Cooperative multi-agent target searching: a deep reinforcement learning approach based on parallel hindsight experience replay
by: Yi Zhou, et al.
Published: (2023-02-01)

Autonomous Driving Control Using the DDPG and RDPG Algorithms
by: Che-Cheng Chang, et al.
Published: (2021-11-01)

Autonomous Driving Control Based on the Technique of Semantic Segmentation
by: Jichiang Tsai, et al.
Published: (2023-01-01)

Data-Efficient Reinforcement Learning Framework for Autonomous Flight Based on Real-World Flight Data
by: Uicheon Lee, et al.
Published: (2025-03-01)

Autonomous Driving Decision Control Based on Improved Proximal Policy Optimization Algorithm
by: Qingpeng Song, et al.
Published: (2023-05-01)

Self-competitive Hindsight Experience Replay with Penalty Measures
by: WANG Zihao, QIAN Xuezhong, SONG Wei
Published: (2024-05-01)

Research on reinforcement learning based on PPO algorithm for human-machine intervention in autonomous driving
by: Gaosong Shi, et al.
Published: (2024-03-01)

GOME-NGU: Visual Navigation Under Sparse Reward via Goal-Oriented Memory Encoder With Never Give Up
by: Ji Sue Lee, et al.
Published: (2025-01-01)

Clustering-based Failed goal Aware Hindsight Experience Replay
by: Taeyoung Kim, et al.
Published: (2024-12-01)

Energy Management Strategy for Hybrid Electric Vehicles Based on Experience-Pool-Optimized Deep Reinforcement Learning
by: Jihui Zhuang, et al.
Published: (2025-08-01)

Curriculum Learning Algorithms for Reward Weighting in Sparse Reward Robotic Manipulation Tasks
by: Benjamin Fele, et al.
Published: (2025-01-01)

Autonomous Maneuver Decision-Making Through Curriculum Learning and Reinforcement Learning With Sparse Rewards
by: Yujie Wei, et al.
Published: (2023-01-01)

Reinforcement Learning Navigation Method Based on Advantage Hindsight Experience Replay
by: Shaotong WANG, Liqun KUANG, Huiyan HAN, Fengguang XIONG, Hongxin XUE
Published: (2024-01-01)

PORF-DDPG: Learning Personalized Autonomous Driving Behavior with Progressively Optimized Reward Function
by: Jie Chen, et al.
Published: (2020-10-01)

Policy-Gradient and Actor-Critic Based State Representation Learning for Safe Driving of Autonomous Vehicles
by: Abhishek Gupta, et al.
Published: (2020-10-01)

Active Collision Avoidance for Robotic Arm Based on Artificial Potential Field and Deep Reinforcement Learning
by: Qiaoyu Xu, et al.
Published: (2024-06-01)

A Path-Planning Method Based on Improved Soft Actor-Critic Algorithm for Mobile Robots
by: Tinglong Zhao, et al.
Published: (2023-10-01)

End-to-End Automated Lane-Change Maneuvering Considering Driving Style Using a Deep Deterministic Policy Gradient Algorithm
by: Hongyu Hu, et al.
Published: (2020-09-01)

Deterministic Discounted Markov Decision Processes with Fuzzy Rewards/Costs
by: Hugo Cruz-Suárez, et al.
Published: (2023-09-01)

Adaptive Proportional Integral Robust Control of an Uncertain Robotic Manipulator Based on Deep Deterministic Policy Gradient
by: Puwei Lu, et al.
Published: (2021-08-01)

Deep reinforcement learning for a multi-objective operation in a nuclear power plant
by: Junyong Bae, et al.
Published: (2023-09-01)

MP-TD3: Multi-Pool Prioritized Experience Replay-Based Asynchronous Twin Delayed Deep Deterministic Policy Gradient Algorithm
by: Wenwen Tan, et al.
Published: (2024-01-01)

SRNeRF: Super-Resolution Neural Radiance Fields for Autonomous Driving Scenario Reconstruction from Sparse Views
by: Jun Wang, et al.
Published: (2025-01-01)

Constrained deterministic policy gradient adaptive dynamic programming using projected gradient update
by: Timotei Lala
Published: (2025-12-01)

Adaptive method runtime safety assurance for autonomous driving in dynamic scenarios
by: XU Bingfeng, et al.
Published: (2025-07-01)

Deep Reinforcement Learning Assisted UAV Path Planning Relying on Cumulative Reward Mode and Region Segmentation
by: Zhipeng Wang, et al.
Published: (2024-01-01)

Designing Reward Functions Using Active Preference Learning for Reinforcement Learning in Autonomous Driving Navigation
by: Lun Ge, et al.
Published: (2024-06-01)

Long-Term Visitation Value for Deep Exploration in Sparse-Reward Reinforcement Learning
by: Simone Parisi, et al.
Published: (2022-02-01)

AUV Collision Avoidance Planning Method Based on Deep Deterministic Policy Gradient
by: Jianya Yuan, et al.
Published: (2023-11-01)

Demonstration and offset augmented meta reinforcement learning with sparse rewards
by: Haorui Li, et al.
Published: (2025-02-01)

Multi-Objective Energy Management Strategy for Hybrid Electric Vehicles Based on TD3 with Non-Parametric Reward Function
by: Fuwu Yan, et al.
Published: (2022-12-01)

Autonomous Maneuvering Decision-Making Algorithm for Unmanned Aerial Vehicles Based on Node Clustering and Deep Deterministic Policy Gradient
by: Xianyong Jing, et al.
Published: (2024-12-01)

Distributed Drive Autonomous Vehicle Trajectory Tracking Control Based on Multi-Agent Deep Reinforcement Learning
by: Yalei Liu, et al.
Published: (2024-05-01)

A Robust Gaussian Process-Based LiDAR Ground Segmentation Algorithm for Autonomous Driving
by: Xianjian Jin, et al.
Published: (2022-06-01)