Reinforcement Learning Based MAC Protocol (UW-ALOHA-QM) for Mobile Underwater Acoustic Sensor Networks
The demand for ocean exploration and exploitation is rapidly increasing and this has led to rapid growth in the market of mobile vehicles. Given the mobility, the key challenge is to design a highly adaptive solution with minimal signalling (and the associated delays) which current techniques have n...
Main Authors: | , , |
---|---|
Format: | Article |
Language: | English |
Published: |
IEEE
2021-01-01
|
Series: | IEEE Access |
Subjects: | |
Online Access: | https://ieeexplore.ieee.org/document/9311225/ |
id |
doaj-77a83bc90f4746ad9ae5af2c8671977c |
---|---|
record_format |
Article |
spelling |
doaj-77a83bc90f4746ad9ae5af2c8671977c2021-03-30T15:19:04ZengIEEEIEEE Access2169-35362021-01-0195906591910.1109/ACCESS.2020.30482939311225Reinforcement Learning Based MAC Protocol (UW-ALOHA-QM) for Mobile Underwater Acoustic Sensor NetworksSung Hyun Park0https://orcid.org/0000-0002-0961-2615Paul Daniel Mitchell1https://orcid.org/0000-0003-0714-2581David Grace2https://orcid.org/0000-0003-4493-7498Department of Electronic Engineering, University of York, York, U.K.Department of Electronic Engineering, University of York, York, U.K.Department of Electronic Engineering, University of York, York, U.K.The demand for ocean exploration and exploitation is rapidly increasing and this has led to rapid growth in the market of mobile vehicles. Given the mobility, the key challenge is to design a highly adaptive solution with minimal signalling (and the associated delays) which current techniques have not fully addressed. Therefore, the mobility and associated challenges in the underwater channel necessitates the design of a new approach to Medium Access Control (MAC) which provides the capability to adapt to rapidly changing conditions with no reliance on signalling which causes delays. This paper proposes the UW-ALOHA-QM protocol, which uses reinforcement learning to allow nodes to adapt to the time varying environment through trial-and-error interaction and thereby improve network resilience and adaptability. Simulations are carried out in four distinct scenarios in which node mobility patterns are significantly different. Simulation results demonstrate that UW-ALOHA-QM provides up to 300% improvement in channel utilisation with respect to existing protocols designed for mobile networks.https://ieeexplore.ieee.org/document/9311225/Medium access controlmobile sensor networksreinforcement learningQ-learningunderwater acoustic networks |
collection |
DOAJ |
language |
English |
format |
Article |
sources |
DOAJ |
author |
Sung Hyun Park Paul Daniel Mitchell David Grace |
spellingShingle |
Sung Hyun Park Paul Daniel Mitchell David Grace Reinforcement Learning Based MAC Protocol (UW-ALOHA-QM) for Mobile Underwater Acoustic Sensor Networks IEEE Access Medium access control mobile sensor networks reinforcement learning Q-learning underwater acoustic networks |
author_facet |
Sung Hyun Park Paul Daniel Mitchell David Grace |
author_sort |
Sung Hyun Park |
title |
Reinforcement Learning Based MAC Protocol (UW-ALOHA-QM) for Mobile Underwater Acoustic Sensor Networks |
title_short |
Reinforcement Learning Based MAC Protocol (UW-ALOHA-QM) for Mobile Underwater Acoustic Sensor Networks |
title_full |
Reinforcement Learning Based MAC Protocol (UW-ALOHA-QM) for Mobile Underwater Acoustic Sensor Networks |
title_fullStr |
Reinforcement Learning Based MAC Protocol (UW-ALOHA-QM) for Mobile Underwater Acoustic Sensor Networks |
title_full_unstemmed |
Reinforcement Learning Based MAC Protocol (UW-ALOHA-QM) for Mobile Underwater Acoustic Sensor Networks |
title_sort |
reinforcement learning based mac protocol (uw-aloha-qm) for mobile underwater acoustic sensor networks |
publisher |
IEEE |
series |
IEEE Access |
issn |
2169-3536 |
publishDate |
2021-01-01 |
description |
The demand for ocean exploration and exploitation is rapidly increasing and this has led to rapid growth in the market of mobile vehicles. Given the mobility, the key challenge is to design a highly adaptive solution with minimal signalling (and the associated delays) which current techniques have not fully addressed. Therefore, the mobility and associated challenges in the underwater channel necessitates the design of a new approach to Medium Access Control (MAC) which provides the capability to adapt to rapidly changing conditions with no reliance on signalling which causes delays. This paper proposes the UW-ALOHA-QM protocol, which uses reinforcement learning to allow nodes to adapt to the time varying environment through trial-and-error interaction and thereby improve network resilience and adaptability. Simulations are carried out in four distinct scenarios in which node mobility patterns are significantly different. Simulation results demonstrate that UW-ALOHA-QM provides up to 300% improvement in channel utilisation with respect to existing protocols designed for mobile networks. |
topic |
Medium access control mobile sensor networks reinforcement learning Q-learning underwater acoustic networks |
url |
https://ieeexplore.ieee.org/document/9311225/ |
work_keys_str_mv |
AT sunghyunpark reinforcementlearningbasedmacprotocoluwalohaqmformobileunderwateracousticsensornetworks AT pauldanielmitchell reinforcementlearningbasedmacprotocoluwalohaqmformobileunderwateracousticsensornetworks AT davidgrace reinforcementlearningbasedmacprotocoluwalohaqmformobileunderwateracousticsensornetworks |
_version_ |
1724179640000446464 |