Decision Making with STPA through Markov Decision Process, a Theoretic Framework for Safe Human-Robot Collaboration

During the last decades, collaborative robots capable of operating out of their cages are widely used in industry to assist humans in mundane and harsh manufacturing tasks. Although such robots are inherently safe by design, they are commonly accompanied by external sensors and other cyber-physical...

Full description

Bibliographic Details
Published in:	Applied Sciences
Main Authors:	Angeliki Zacharaki, Ioannis Kostavelis, Ioannis Dokas
Format:	Article
Language:	English
Published:	MDPI AG 2021-06-01
Subjects:	safe collaborative robots partially observable markov decision processes system theoretic process analysis safety awareness levels prompting system
Online Access:	https://www.mdpi.com/2076-3417/11/11/5212

Similar Items

An Algorithm for Making Regime-Changing Markov Decisions
by: Juri Hinz
Published: (2021-10-01)

A Discrete Partially Observable Markov Decision Process Model for the Maintenance Optimization of Oil and Gas Pipelines
by: Ezra Wari, et al.
Published: (2023-01-01)

A Corrosion Maintenance Model Using Continuous State Partially Observable Markov Decision Process for Oil and Gas Pipelines
by: Ezra Wari, et al.
Published: (2023-07-01)

Recent Advances in Deep Reinforcement Learning Applications for Solving Partially Observable Markov Decision Processes (POMDP) Problems: Part 1—Fundamentals and Applications in Games, Robotics and Natural Language Processing
by: Xuanchen Xiang, et al.
Published: (2021-07-01)

Recent Advances in Deep Reinforcement Learning Applications for Solving Partially Observable Markov Decision Processes (POMDP) Problems Part 2—Applications in Transportation, Industries, Communications and Networking and More Topics
by: Xuanchen Xiang, et al.
Published: (2021-10-01)

Factored Beliefs for Machine Agents in Decentralized Partially Observable Markov Decision Processes
by: Joshua Lapso, et al.
Published: (2022-05-01)

Safe Reinforcement Learning for Arm Manipulation with Constrained Markov Decision Process
by: Patrick Adjei, et al.
Published: (2024-04-01)

The optimal probability of the risk for finite horizon partially observable Markov decision processes
by: Xian Wen, et al.
Published: (2023-10-01)

When to monitor or control: Informed invasive species management using a partially observable Markov decision process (POMDP) framework
by: Thomas K. Waring, et al.
Published: (2024-09-01)

Enhancing Urban Public Safety through UAS Integration: A Comprehensive Hazard Analysis with the STAMP/STPA Framework
by: Eutteum Go, et al.
Published: (2024-05-01)

Analyses of Markov decision process structure regarding the possible strategic use of interacting memory systems
by: Eric A Zilli, et al.
Published: (2008-12-01)

Research on Distributed Multi-Sensor Cooperative Scheduling Model Based on Partially Observable Markov Decision Process
by: Zhen Zhang, et al.
Published: (2022-04-01)

System-Theoretic Process Analysis (STPA) for Hazard Analysis in Complex Systems: The Case of “Demand-Side Management in a Smart Grid”
by: Stylianos Karatzas, et al.
Published: (2020-09-01)

An Integrated Quantitative Safety Assessment Framework Based on the STPA and System Dynamics
by: Jian Jiao, et al.
Published: (2022-09-01)

Modelling and Intelligent Decision of Partially Observable Penetration Testing for System Security Verification
by: Xiaojian Liu, et al.
Published: (2024-12-01)

STPA and Bowtie risk analysis study for centralized and hierarchical control architectures comparison
by: Chaima Bensaci, et al.
Published: (2020-10-01)

An Automated Accident Causal Scenario Identification Method for Fully Automatic Operation System Based on STPA
by: Fei Yan, et al.
Published: (2021-01-01)

Risk Performance Analysis on Navigation of MASS via a Hybrid Framework of STPA and HMM: Evidence from the Human–Machine Co-Driving Mode
by: Wei Li, et al.
Published: (2024-07-01)

Feeding System’s Sensitivity and Reliability Analysis through Markov Decision Process
by: Sujata Jadhav, et al.
Published: (2025-04-01)

Joint Optimal Policy for Maintenance, Spare Unit Selection and Inventory Control Under a Partially Observable Markov Decision Process
by: Nozomu Ogura, et al.
Published: (2025-01-01)

Developing CBTC system safety requirement hierarchy through STPA methodology
by: ZuXi Chen, et al.
Published: (2024-06-01)

Finite State Approximations for Countable State Infinite Horizon Discounted Markov Decision Processes
by: Sjur D. Flåm
Published: (1987-04-01)

Decision-making models on perceptual uncertainty with distributional reinforcement learning
by: Shuyuan Xu, et al.
Published: (2023-04-01)

A Markov Decision Process with Awareness and Present Bias in Decision-Making
by: Federico Bizzarri, et al.
Published: (2023-06-01)

Dialogue Strateqy Integrating Markov Decision Process and Information Entropy
by: ZHU Yingbo, ZHAO Yangyang, WANG Pei, YIN Kai, WANG Zhenyu
Published: (2021-03-01)

Estimating the Reliability and Sensitivity of a Public Address System Through the Markov Decision Process
by: Pardeep Kumar, et al.
Published: (2024-11-01)

Robustness to Modeling Errors in Risk-Sensitive Markov Decision Problems With Markov Risk Measures
by: Shiping Shao, et al.
Published: (2025-01-01)

Convex Optimization of Markov Decision Processes Based on Z Transform: A Theoretical Framework for Two-Space Decomposition and Linear Programming Reconstruction
by: Shiqing Qiu, et al.
Published: (2025-05-01)

Decision Modeling of UAV On-Line Path Planning Based on IMM
Published: (2018-04-01)

Towards Automated Quality Control in Industrial Systems: Developing Markov Decision Process Model for Optimized Decision-Making
by: Katerina Mitkovska-Trendova, et al.
Published: (2024-11-01)

Stochastic energy management of DC photovoltaic microgrids using Markov decision process
by: Mohamed Aatabe, et al.
Published: (2025-09-01)

Modeling stochastic gene expression: From Markov to non-Markov models
by: Zhenquan Zhang, et al.
Published: (2020-08-01)

A study of value iteration and policy iteration for Markov decision processes in Deterministic systems
by: Haifeng Zheng, et al.
Published: (2024-11-01)

Open Markov Chains: Cumulant Dynamics, Fluctuations and Correlations
by: Raúl Salgado-García
Published: (2021-02-01)

A comprehensive STPA-PSO framework for quantifying smart glasses risks in manufacturing
by: Ali Karevan, et al.
Published: (2024-05-01)

Health Status-Based Predictive Maintenance Decision-Making via LSTM and Markov Decision Process
by: Pan Zheng, et al.
Published: (2022-12-01)

Investigation of a Markov Model for Computer System Security Threats
by: Alexey A. A. Magazev, et al.
Published: (2017-08-01)

Do Ṣukūk and Islamic indexes act as safe refuge to conventional stock markets? Evidence from Markov-switching CAPM approach
by: Slah Bahloul, et al.
Published: (2022-12-01)

Rate of Convergence and Periodicity of the Expected Population Structure of Markov Systems that Live in a General State Space
by: P. -C. G. Vassiliou
Published: (2020-06-01)

Modeling Local Search Metaheuristics Using Markov Decision Processes
by: Rubén Ruiz-Torrubiano, et al.
Published: (2025-08-01)