Markov Decision Process Cross-layer self-adaptation Decentralized planning Learning algorithms Markov Decision Processes Markov processes Multi-cloud Q-learning Reinforcement learning Self adaptation Adaptation planning Behavioral research Cloud computing Cross-layer Cross-layer interaction Cross-layer services Decision making Decision making process Heterogeneous environments Management Managers Multi-clouds Multiple organizations Quality assurance Quality of service Self-adaptation Service level agreement (SLAs)