{"references": ["G. K. Lockwood, W. Yoo, S. Byna, N. J. Wright, S. Snyder, K. Harms, Z. Nault, and P. Carns, \"UMAMI: A Recipe for Generating Meaningful Metrics through Holistic I/O Performance Analysis,\" in Proceedings of the 2nd Joint International Workshop on Parallel Data Storage & Data Intensive Scalable Computing Systems - PDSW-DISCS '17, 2017, pp. 55\u201360.", "G. K. Lockwood, N. J. Wright, S. Snyder, P. Carns, G. Brown, and K. Harms, \"TOKIO on ClusterStor: Connecting Standard Tools to Enable Holistic I/O Performance Analysis,\" in Proceedings of the 2018 Cray User Group, 2018."]}

The TOKIO Automated Benchmark Collection (TOKIO-ABC) is a software repository containing specific versions of several benchmark applications run daily at the National Energy Research Scientific Computing Center (NERSC) and the Argonne Leadership Computing Facility (ALCF). It also contains build scripts that encode the specific build processes used to generate the test application binaries at both sites as well as all of the exact input parameters used in each daily benchmark test.