Wright, Steven A. orcid.org/0000-0001-7133-8533, Hammond, Simon D., Pennycook, Simon J. et al. (1 more author) (2011) Light-weight parallel I/O analysis at scale. In: Computer Performance Engineering - 8th European Performance Engineering Workshop, EPEW 2011, Proceedings. 8th European Performance Engineering Workshop, EPEW 2011, 12-13 Oct 2011 Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) . , GBR , pp. 235-249.
Abstract
Input/output (I/O) operations can represent a significant proportion of the run-time when large scientific applications are run in parallel. Although there have been advances in the form of file-format libraries, file system design and I/O hardware, a growing divergence exists between the performance of parallel file systems and compute processing rates. In this paper we utilise RIOT, an input/output tracing toolkit being developed at the University of Warwick, to assess the performance of three standard industry I/O benchmarks and mini-applications. We present a case study demonstrating the tracing and analysis capabilities of RIOT at scale, using MPI-IO, Parallel HDF-5 and MPI-IO augmented with the Parallel Log-structured File System (PLFS) middle-ware being developed by the Los Alamos National Laboratory.
Metadata
Item Type: | Proceedings Paper |
---|---|
Authors/Creators: |
|
Copyright, Publisher and Additional Information: | This is an author-produced version of the published paper. Uploaded in accordance with the publisher’s self-archiving policy. Further copying may not be permitted; contact the publisher for details |
Keywords: | Input/Output,Message Passing Interface,Parallel I/O,Parallel Log-structured File System,Profiling |
Dates: |
|
Institution: | The University of York |
Academic Units: | The University of York > Faculty of Sciences (York) > Computer Science (York) |
Depositing User: | Pure (York) |
Date Deposited: | 04 Oct 2018 09:20 |
Last Modified: | 08 Jan 2025 00:16 |
Published Version: | https://doi.org/10.1007/978-3-642-24749-1_18 |
Status: | Published |
Series Name: | Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) |
Identification Number: | 10.1007/978-3-642-24749-1_18 |
Related URLs: | |
Open Archives Initiative ID (OAI ID): | oai:eprints.whiterose.ac.uk:136616 |
Download
Filename: light_weight_parallel_analysis_scale_Wright_2018.pdf
Description: light-weight-parallel-analysis-scale-Wright-2018