publication . Conference object . Other literature type . Article . 2016

ATLAS EventIndex general dataflow and monitoring infrastructure

D. Barberis; J. Hřivnáč; Andrea Favareto; R. Többicke; R. Yuan; C. Garcia Montoro; José Salt; Fedor Prokoshin; J. Sanchez; A. Fernandez Casani; ...
Open Access English
  • Published: 10 Oct 2016
  • Publisher: HAL CCSD
  • Country: France
Abstract
International audience; The ATLAS EventIndex has been running in production since mid-2015, reliably collecting information worldwide about all produced events and storing them in a central Hadoop infrastructure at CERN. A subset of this information is copied to an Oracle relational database for fast dataset discovery, event-picking, crosschecks with other ATLAS systems and checks for event duplication. The system design and its optimization is serving event picking from requests of a few events up to scales of tens of thousand of events, and in addition, data consistency checks are performed for large production campaigns. Detecting duplicate events with a scop...
Subjects
free text keywords: programming, data compilation, performance, data management, ATLAS, monitoring, [INFO]Computer Science [cs], Particle Physics - Experiment, General Physics and Astronomy, Dataflow, Computer science, Atlas (anatomy), medicine.anatomical_structure, medicine, Grid, Operating system, computer.software_genre, computer, Object storage
HAL - UPEC / UPEM
Conference object . 2016
Hyper Article en Ligne
Conference object . 2016
CERN Document Server
Other literature type . 2017
Hal-Diderot
Conference object . 2016
Provider: Hal-Diderot
Any information missing or wrong?Report an Issue