CERN Tape Archive: production status, migration from CASTOR and new features

• Main Authors: Cano Eric, Bahyl Vladimír, Caffy Cédric, Cancio Germán, Davis Michael, Kotlyar Viktor, Leduc Julien, Lin Tao, Murray Steven
• Format: Article
• Language: English
• Published: EDP Sciences 2020-01-01
• Series: EPJ Web of Conferences
• Online Access: https://www.epj-conferences.org/articles/epjconf/pdf/2020/21/epjconf_chep2020_04013.pdf

During 2019 and 2020, the CERN tape archive (CTA) will receive new data from LHC experiments and import existing data from CASTOR, which will be phased out for LHC experiments before Run 3. This contribution will present the statuses of CTA as a service and of its integration with EOS and FTS and the data flow chains of LHC experiments. The latest enhancements and additions to the software as well as the development outlook will be presented. With the development of the repack function, a necessary behind-the-scenes feature, CTA can now take over custodial data and handle media migration, compaction and failures. Further metadata handling optimisations allowed doubling the maximum file rate performance to 200Hz per queue. New retrieve scheduling options are being developed at the request of experiments, with optional FIFO behaviour to ensure better control of the timing for datasets retrieve, and fair share support for competing activities within the same VO. Support for multiple backend databases (Oracle, PostgreSQL, MySQL) have been developed at CERN and contributed by external institutes. This contribution will also report on the challenges of and solutions for migrating data from the decades old CASTOR to CTA. The practical example of the preparation for the migration of ATLAS data will be presented.