Deploying a new realtime XRootD-v5 based monitoring framework for GridPP
To optimise the performance of distributed compute, smaller lightweight storage caches are needed which integrate with existing grid computing workflows. A good solution to provide lightweight storage caches is to use an XRootD-proxy cache. To support distributed lightweight XRootD proxy services ac...
Main Authors: | , |
---|---|
Format: | Article |
Language: | English |
Published: |
EDP Sciences
2021-01-01
|
Series: | EPJ Web of Conferences |
Online Access: | https://www.epj-conferences.org/articles/epjconf/pdf/2021/05/epjconf_chep2021_02052.pdf |
id |
doaj-50eb0945ec7a4f8aa3fea86d1ff8576a |
---|---|
record_format |
Article |
spelling |
doaj-50eb0945ec7a4f8aa3fea86d1ff8576a2021-08-26T09:27:32ZengEDP SciencesEPJ Web of Conferences2100-014X2021-01-012510205210.1051/epjconf/202125102052epjconf_chep2021_02052Deploying a new realtime XRootD-v5 based monitoring framework for GridPPCurrie Robert0Yuan Wenlong1School of Physics and Astronomy University of EdinburghSchool of Physics and Astronomy University of EdinburghTo optimise the performance of distributed compute, smaller lightweight storage caches are needed which integrate with existing grid computing workflows. A good solution to provide lightweight storage caches is to use an XRootD-proxy cache. To support distributed lightweight XRootD proxy services across GridPP we have developed a centralised monitoring framework. With the v5 release of XRootD it is possible to build a monitoring framework which collects distributed caching metadata broadcast from multiple sites. To provide the best support for these distributed caches we have built a centralised monitoring service for XRootD storage instances within GridPP. This monitoring solution is built upon experiences presented by CMS in setting up a similar service as part of their AAA system. This new framework is designed to provide remote monitoring of the behaviour, performance, and reliability of distributed XRootD services across the UK. Effort has been made to simplify ease of deployment by remote site administrators. The result of this work is an interactive dashboard system which enables administrators to access real-time metrics on the performance of their lightweight storage systems. This monitoring framework is intended to supplement existing functionality and availability testing metrics by providing detailed information and logging from a site perspective.https://www.epj-conferences.org/articles/epjconf/pdf/2021/05/epjconf_chep2021_02052.pdf |
collection |
DOAJ |
language |
English |
format |
Article |
sources |
DOAJ |
author |
Currie Robert Yuan Wenlong |
spellingShingle |
Currie Robert Yuan Wenlong Deploying a new realtime XRootD-v5 based monitoring framework for GridPP EPJ Web of Conferences |
author_facet |
Currie Robert Yuan Wenlong |
author_sort |
Currie Robert |
title |
Deploying a new realtime XRootD-v5 based monitoring framework for GridPP |
title_short |
Deploying a new realtime XRootD-v5 based monitoring framework for GridPP |
title_full |
Deploying a new realtime XRootD-v5 based monitoring framework for GridPP |
title_fullStr |
Deploying a new realtime XRootD-v5 based monitoring framework for GridPP |
title_full_unstemmed |
Deploying a new realtime XRootD-v5 based monitoring framework for GridPP |
title_sort |
deploying a new realtime xrootd-v5 based monitoring framework for gridpp |
publisher |
EDP Sciences |
series |
EPJ Web of Conferences |
issn |
2100-014X |
publishDate |
2021-01-01 |
description |
To optimise the performance of distributed compute, smaller lightweight storage caches are needed which integrate with existing grid computing workflows. A good solution to provide lightweight storage caches is to use an XRootD-proxy cache. To support distributed lightweight XRootD proxy services across GridPP we have developed a centralised monitoring framework. With the v5 release of XRootD it is possible to build a monitoring framework which collects distributed caching metadata broadcast from multiple sites. To provide the best support for these distributed caches we have built a centralised monitoring service for XRootD storage instances within GridPP. This monitoring solution is built upon experiences presented by CMS in setting up a similar service as part of their AAA system. This new framework is designed to provide remote monitoring of the behaviour, performance, and reliability of distributed XRootD services across the UK. Effort has been made to simplify ease of deployment by remote site administrators.
The result of this work is an interactive dashboard system which enables administrators to access real-time metrics on the performance of their lightweight storage systems. This monitoring framework is intended to supplement existing functionality and availability testing metrics by providing detailed information and logging from a site perspective. |
url |
https://www.epj-conferences.org/articles/epjconf/pdf/2021/05/epjconf_chep2021_02052.pdf |
work_keys_str_mv |
AT currierobert deployinganewrealtimexrootdv5basedmonitoringframeworkforgridpp AT yuanwenlong deployinganewrealtimexrootdv5basedmonitoringframeworkforgridpp |
_version_ |
1721195783028473856 |