Publications

The architecture, design, concepts, implementation, and operational experience of Rucio is backed by a number of peer-reviewed publications, including journal articles, conference proceedings, and doctoral theses.

Recommended for citation

Martin Barisits, Thomas Beermann, Frank Berghaus, Brian Bockelman, Joaquin Bogado, David Cameron, Dimitrios Christidis, Diego Ciangottini, Gancho Dimitrov, Markus Elsing, Vincent Garonne, Alessandro di Girolamo, Luc Goossens, Wen Guan, Jaroslav Guenther, Tomas Javurek, Dietmar Kuhn, Mario Lassnig, Fernando Lopez, Nicolo Magini, Angelos Molfetas, Armin Nairz, Farid Ould-Saada, Stefan Prenner, Cedric Serfon, Graeme Stewart, Eric Vaandering, Petya Vasileva, Ralph Vigne, Tobias Wegner
Rucio: Scientific Data Management

Barisits, M., Beermann, T., Berghaus, F. et al. Comput Softw Big Sci (2019) 3: 11

https://doi.org/10.1007/s41781-019-0026-3

@article{rucio2019,
       author = {{Barisits}, Martin and {Beermann}, Thomas and {Berghaus}, Frank and
         {Bockelman}, Brian and {Bogado}, Joaquin and {Cameron}, David and
         {Christidis}, Dimitrios and {Ciangottini}, Diego and
         {Dimitrov}, Gancho and {Elsing}, Markus and {Garonne}, Vincent and
         {di Girolamo}, Alessandro and {Goossens}, Luc and {Guan}, Wen and
         {Guenther}, Jaroslav and {Javurek}, Tomas and {Kuhn}, Dietmar and
         {Lassnig}, Mario and {Lopez}, Fernando and {Magini}, Nicolo and
         {Molfetas}, Angelos and {Nairz}, Armin and {Ould-Saada}, Farid and
         {Prenner}, Stefan and {Serfon}, Cedric and {Stewart}, Graeme and {Vaand
        ering}, Eric and {Vasileva}, Petya and {Vigne}, Ralph and
         {Wegner}, Tobias},
        title = "Rucio: Scientific Data Management",
      journal = "Computing and Software for Big Science",
       volume = "3",
         year = "2019",
        month = "Aug",
          day = "09",
       number = "1",
        pages = "11",
         issn = "2510-2044",
          doi = "10.1007/s41781-019-0026-3",
          url = "https://doi.org/10.1007/s41781-019-0026-3",
    publisher = "Springer International Publishing"
}

Doctoral and Master's Theses

  • Wegner Tobias, Advanced cloud bursting methods with large data volumes, Dissertation, University of Wuppertal, Germany, ongoing
  • Begy Volodimir, Heuristic model for selection of data access profiles, Dissertation, University of Vienna, Austria, ongoing
  • Vamosi Ralf, Allocation optimisation in a data-intensive grid, Dissertation, University of Vienna, Austria, ongoing
  • Bogado Joaquin, Modelling queuing and transfer times for wide-area transfers, Dissertation, University of La Plata, Argentina, ongoing
  • Prenner Stefan, Intelligent Prefetching for a Grid Enabled Distributed System, Master's Thesis, Technical University of Vienna, Austria, 2019
  • Beermann Thomas, A popularity prediction and dynamic data replication study for the ATLAS distributed data management, Dissertation, University of Wuppertal, Germany, 2017
  • Barisits Martin, Hybrid simulation models for data-intensive systems, Dissertation, Technical University of Vienna, Austria, 2017
  • Lassnig Mario, Workload modelling for data-intensive systems, Dissertation, University of Innsbruck, Austria, 2014
  • Branco Miguel, Distributed data management for large scale applications, Dissertation, University of Southampton, UK, 2009

Proceedings

  • Lassnig, Barisits, Christidis, Experiences in Exascale Scientific Data Management, IEEE Computer Society, Data Engineering Bulletin 43:1, 2020
  • Barisits, Beermann, Garonne, Javurek, Lassnig, Serfon, The ATLAS Data Management System Rucio: Supporting LHC Run-2 and beyond, ACAT, Seattle, 2017
  • Barisits, Kuehn, Lassnig, A hybrid simulation model for data grids, 16th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (CCGrid), Cartagena, Colombia, 2016
  • Lassnig, Toler, Vamosi, Bogado, Machine learning of network metrics in ATLAS Distributed Data Management, CHEP, San Francisco, 2016
  • Garonne, Barisits, Beermann, Lassnig, Serfon, Guan, Experiences with the new ATLAS Distributed Data Management System, CHEP, San Francisco, 2016
  • Barisits, Serfon, Javurek, et al., Automatic rebalancing of data in ATLAS distributed data management, CHEP, San Francisco, 2016
  • Beermann, et al., C3PO - A Dynamic Data Placement Agent for ATLAS Distributed Data Management, CHEP, San Francisco, 2016
  • Babik, McKee, Garonne, et al., Integrating network and transfer metrics to optimize transfer efficiency and experiment workflows, CHEP, Okinawa, 2015
  • Wildish, Lassnig, Garonne, et al., Dimensions of Data Management: A taxonomy of data-transfer solutions in ATLAS and CMS, CHEP, Okinawa, 2015
  • Elmsheuser, Serfon, et al., New data access with HTTP/WebDAV in the ATLAS experiment, CHEP, Okinawa, 2015
  • Beermann, Stewart, Maettig, A study on dynamic data placement for the ATLAS Distributed Data Management system, CHEP, Okinawa, 2015
  • Serfon, Garonne, et al., The ATLAS Data Management system - Rucio: commissioning, migration and operational experiences, CHEP, Okinawa, 2015
  • Vigne, Lassnig, et al., Scalable and fail-safe deployment of the ATLAS Distributed Data Management system Rucio, CHEP, Okinawa, 2015
  • Beermann, Lassnig, et al., Monitoring and controlling ATLAS data management: The Rucio web user interface, CHEP, Okinawa, 2015
  • Barisits, Serfon, et al., Resource control in ATLAS distributed data management: Rucio Accounting and Quotas, CHEP, Okinawa, 2015
  • Beermann, Maettig, Stewart, Lassnig, et al., Popularity Prediction Tool for ATLAS Distributed Data Management, 11th International Symposium on Grids and Clouds (ISGC), Taipei, Taiwan, 2014
  • Stewart, Garonne, Lassnig, Molfetas, et al., Advances in service and operations for ATLAS data managmeent, ACAT, London, 2014
  • Serfon, et al. Rucio, the next-generation Data Management system in ATLAS, ICHEP, Valencia, 2014
  • Lassnig, et al., The ATLAS data management software engineering process, CHEP, Amsterdam, 2014
  • Vigne, Schikuta, et al., DDM Workload Emulation, CHEP, Amsterdam, 2014
  • Lassnig, van Dongen, et al., The DMLite Rucio Plugin: ATLAS data in a filesystem, CHEP, Amsterdam, 2014
  • Garonne, Vigne, Stewart, Barisits, Beermann, Lassnig, Serfon, Goossens, Nairz, Rucio – The next generation of large scale distributed system for ATLAS Data Management, CHEP, Amsterdam, 2014
  • Serfon, Garonne, et al., ATLAS DQ2 to Rucio renaming infrastructure, CHEP, Amsterdam, 2014
  • Beermann, Maettig, Stewart, Lassnig, et al., Popularity Prediction Tool for ATLAS Distributed Data Management, CHEP, Amsterdam, 2014
  • Barisits, Serfon, Garonne, Lassnig, et al., ATLAS Replica Management in Rucio: Replication Rules and Subscriptions, CHEP, Amsterdam, 2014
  • Dimitrov, Maeno, Garonne, Next generation database relational solutions for ATLAS distributed computing, CHEP, Amsterdam, 2014
  • Garonne, Lassnig, Barisits, Beermann, et al., The ATLAS Distributed Data Management System and Database, Workshop on Extremely Large Databases (XLDB), Geneva, Switzerland, 2013
  • Barisits, Lassnig, et al., Simulating the ATLAS Distributed Data Management System, CHEP, New York, 2012
  • Beermann, Molfetas, Lassnig, et al., The ATLAS DDM Tracer monitoring framework, CHEP, New York, 2012
  • Molfetas, et al., Popularity framework for monitoring user workload, CHEP, New York, 2012
  • Garonne, Lassnig, Molfetas, Serfon, Barisits, Beermann, et al., The ATLAS Distributed Data Management project: Past and Future, CHEP, New York, 2012
  • Lassnig, Dimitrov, Molfetas, et al., ATLAS DDM/DQ2 & NoSQL databases: Use cases and experiences, CHEP, New York, 2012
  • Chinzer, Lassnig, Dimitrov, et al., Accounting the ATLAS DDM system - A case study with Oracle, MongoDB and HBase, CHEP, New York, 2012
  • Lassnig, Fahringer, et al., A Similarity Measure for Time, Frequency, and Dependencies in Large-Scale Workloads, ACM SIGARCH / IEEE International Conference for High Performance Computing, Networking, Storage and Analysis (Supercomputing), Seattle, US, 2011
  • Molfetas, et al., Popularity framework to process dataset traces and its application on dynamic replica reduction in the ATLAS experiment, CHEP, Taipei, 2010
  • Calfayan, Dongsong, Garonne, Usage of Message Queueing Technologies in the ATLAS Distributed Data Management System, CHEP, Taipei, 2010
  • Lassnig, Fahringer, et al., Identification, modelling and prediction of non-periodic bursts in workloads, 10th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (CCGrid), Melbourne, Australia, 2010
  • Lassnig, Fahringer, et al., Stream Monitoring in Large-Scale Distributed Concealed Environments, IEEE International Conference on e-Science, Oxford, UK, 2009
  • Rocha, et al., The ATLAS Distributed Data Management Dashboard, CHEP, Prague, 2009
  • Viegas, Dimitrov, Salgado, et al., The ATLAS Distributed Data Management Central Catalogues and steps towards scalability and high availability, CHEP, Prague, 2009
  • Barreiro, Jezequel, Garonne, et al., The ATLAS DQ2 Accounting and Storage Usage service, CHEP, Prague, 2009
  • Lassnig, Branco, Garonne, Analysing ATLAS user behaviour for improved distributed mass-storage performance, CHEP, Prague, 2009
  • Branco, Zaluska, De Roure, Lassnig, Garonne, Managing very large distributed datasets on a Data Grid, Concurrency and Computation: Practice & Experience, Wiley, 2009
  • Branco, Salgado, Lassnig, Garonne, et al., Managing ATLAS data on a petabyte-scale with DQ2, CHEP, Victoria, 2007
  • Rocha, Gaidioz, et al., Monitoring the Atlas Distributed Data Management System, CHEP, Victoria, 2007
  • Cameron, Branco, Wenaus, A Scalable Distributed Data Management System for ATLAS, CHEP, Mumbai, 2006
  • Branco, Don Quijote - Data Management for the ATLAS Automatic Production System, CHEP, Interlaken, 2004

Get in touch

We are always happy to chat. You can drop us a mail and we will reply as quickly as possible.