The authoritative source for research information and outputs is Elsevier Scopus, with researcher profile verification from the Deanship of Scientific Research.
المخرجات
Research outputs
Articles, reviews, conference papers and book chapters, indexed by DOI and linked to University researchers.
Reinforcement learning is a remarkable aspect of the artificial intelligence field with many applications. Reinforcement learning facilitates learning new tasks based on action and reward principles. Motion planning addresses the navigation problem for robots. Current motion planning approaches lack support for automated, timely responses to the environment. The problem becomes worse in a complex environment cluttered with obstacles. Reinforcement learning can increase the capacity of robotic systems due to the reward system's capability and feedback to the environment. This could help deal with a complex environment. Existing algorithms for path planning are slow, computationally expensive, and less responsive to the environment, which causes late convergence to a solution. Furthermore, they are less efficient for task learning due to post-processing requirements. Reinforcement learning can address these issues using its action feedback and reward policies. This research presents a novel Q-learning-based reinforcement algorithm with deep learning integration. The proposed approach is evaluated in a narrow and cluttered passage environment. Further, improvements in the convergence of reinforcement learning-based motion planning and collision avoidance are addressed. The proposed approach's agent converged in 210th episodes in a cluttered environment and 400th episodes in a narrow passage environment. A state-of-the-art comparison shows that the proposed approach outperformed existing approaches based on the number of turns and convergence of the path by the planner.
OPJU International Technology Conference on Smart Computing for Innovation and Advancement in Industry (OTCON) · 1-6
The deep Q-network (DQN) technique, as a classic value-based deep reinforcement learning process, has been widely applied in fields such as multi-robotic agent motion planning. However, the DQN method faces a series of tasks, such as overestimating Q-values, complex Q-value computations, neural networks lacking historical memory proficiencies, and inefficient exploration when using ε-greedy strategies. This paper proposes a DQN-based multi-robot agent deep reinforcement learning motion planning approach to solve these problems. To accomplish their objectives without colliding with one another, agents can acquire stable and efficient motion planning techniques with the aid of this method. Initially, a Dueling-based optimization tool is suggested, which is based on the DQN approach. It simplifies and improves the calculation of Q-values by calculating state values and advantage function values, and by choosing the appropriate action based on the parameters of the presently updating Q-value network. Additionally, we provide a GRU-based memory mechanism that incorporates GRU modules to facilitate the network's temporal data acquisition and handling of agents' historical information. And lastly, we offer a noise-based exploration technique that works. By introducing parameterized noise, the exploration technique in DQN is modified, improving the examination efficiency of agents, and achieving a balance between exploration and exploitation in multi-robotic agent systems. Tests were conducted in six different simulation scenarios on the PyBullet simulation platform. Experimental results show that the proposed method enables efficient collaboration among multi-robotic agent teams, agreeing them to go where they're going without running into each other, and the methods' training is steady.
The development of indoor navigation and positioning technology autonomous aerial vehicles, or AAVs, are employed extensively in many different industries due to their ease of operation and outstanding mobility. Drones can decrease responder injuries, increase mission effectiveness, and conduct search operations in locations that rescue crews are unable to access when utilized for indoor search and rescue during a disaster. This paper’s goal is to use a reinforcement learning algorithm to suggest a track planning technique for AAVs in indoor post-disaster scenarios. The difficulty of finding a safe path for AAVs in crowded indoor areas that present a significant risk to flight safety is the focus of this research. To address the difficulties caused by the intricate interior environment and the sluggish convergence of current reinforcement learning algorithms, an ensemble strategy based on reinforcement learning has been put forth. By using the coordinate connection between the beginning point and the endpoint to identify the primary barrier and the nodes surrounding it, this strategy seeks to minimize the search for superfluous nodes. The enhanced 3D navigation trajectory planning technique lowered the number of space search nodes by 55.49% and shortened the convergence time by 98.57%, according to simulation and testing of the optimization process in a three-dimensional grid diagram.
In Industry 4.0, industrial robot trajectory planning requires real-time collision avoidance. This is solved by our innovative Collision Criticality (CC) LSTM-DRL approach. This work suggests navigating many landscapes with diverse barriers using deep reinforcement learning (DRL) and long-short-term memory for data analytics in digital transformation. The robot’s current state is used by Crit LSTM DRL to estimate collision timing and obstacle CC. Obstacle courses use CC ranks. Robotics creates a fixed-dimensional vector that accurately represents reality using LSTM models. After that, the robot’s current state is added to this vector to complete its perception and cognition. Deep Reinforcement learning (DRL) optimizes state values using input data. At each time step, Deep Reinforcement Learning (DRL) and Long Short-Term Memory (LSTM) identify the next state values for all possible actions. System operation depends on the highest value’s action. We learned three environmental models in this research. A scenario with five, 10, or one to ten barriers was classified. These models were tested for adaptability to different obstacle densities. In obstacle-rich situations, researchers tested these three models’ strengths and weaknesses. Testing the algorithm in various settings proves its efficacy. The program also considers the combined influence of impediments on the robot by portraying them as a joint state. CC-LSTM-DRL performs well in Industry 4.0’s dynamic and challenging conditions, according to experiments. Mobile robots can confidently navigate changing environments due to their versatility and flexibility, making them ideal industrial tools. Industry 4.0, Collision Criticality, Industrial Robot, Autonomous Systems, Mobile Robots, Collision Risk
deep reinforcement learningreal-time analyticsindustrial robotsdigital transformation
IEEE International Conference on Innovations in High Speed Communication and Signal Processing (IHCSP) · 1-8
In Industry 4.0, industrial robot trajectory planning requires real-time collision avoidance. This is solved by our innovative Collision Criticality (CC) LSTM-DRL approach. This work suggests navigating many landscapes with diverse barriers using deep reinforcement learning (DRL) and long-short-term memory for data analytics in high Speed Communication. The robot's current state is used by Crit LSTM DRL to estimate collision timing and obstacle CC. Obstacle courses use CC ranks. Robotics creates a fixed-dimensional vector that accurately represents reality using LSTM models. After that, the robot's current state is added to this vector to complete its perception and cognition. Deep Reinforcement Learning (DRL) optimalizes state values using input data. At each time step, Deep Reinforcement Learning (DRL) and Long Short-Term Memory (LSTM) identify the next state values for all possible actions. System operation depends on the highest value's action. We learned three environmental models in this research. A scenario with five, 10, or one to ten barriers was classified. These models were tested for adaptability to different obstacle densities. In obstacle-rich situations, researchers tested these three models' strengths and weaknesses. Testing the algorithm in various settings proves its efficacy. The program also considers the combined influence of impediments on the robot by portraying them as a joint state. CC-LSTM-DRL performs well in Industry 4.0's dynamic and challenging conditions, according to experiments. Mobile robots can confidently navigate changing environments due to their versatility and flexibility, making them ideal industrial tools.
collision avoidanceLSTMdeep reinforcement learningobstacle density