Sharing server nodes for storage and computer

• Main Authors: Smith David, Di Girolamo Alessandro, Glushkov Ivan, Jones Ben, Kiryanov Andrey, Lamanna Massimo, Mascetti Luca, McCance Gavin, Rousseau Herve, Schovancová Jaroslava, Schulz Markus, Tollefsen Havard, Valassi Andrea
• Format: Article
• Language: English
• Published: EDP Sciences 2019-01-01
• Series: EPJ Web of Conferences
• Online Access: https://www.epj-conferences.org/articles/epjconf/pdf/2019/19/epjconf_chep2018_08025.pdf

Based on the observation of low average CPU utilisation of several hundred file storage servers in the EOS storage system at CERN, the Batch on EOS Extra Resources (BEER) project developed an approach to also utilise these resources for batch processing. Initial proof of concept tests showed little interference between batch and storage services on a node. Subsequently a model for production was developed and implemented. This has been deployed on part of the CERN EOS production service. The implementation and test results will be presented. The potential for additional resources at the CERN Tier-0 centre is of the order of ten thousand hardware threads in the near term, as well as being a step towards a hyper-converged infrastructure.