Dickson, James, Wright, Steven orcid.org/0000-0001-7133-8533, Maheswaran, Satheesh et al. (3 more authors) (2017) Replicating HPC I/O workloads with proxy applications. In: Proceedings of PDSW-DISCS 2016:1st Joint International Workshop on Parallel Data Storage and Data Intensive Scalable Computing Systems - Held in conjunction with SC16: The International Conference for High Performance Computing, Networking, Storage and An. 1st Joint International Workshop on Parallel Data Storage and Data Intensive Scalable Computing Systems, PDSW-DISCS 2016, 14 Nov 2016 IEEE , USA , pp. 13-18.
Abstract
Large scale simulation performance is dependent on a number of components, however the task of investigation and optimization has long favored computational and communication elements above I/O. Manually extracting the pattern of I/O behavior from a parent application is a useful way of working to address performance issues on a per-application basis, but developing workflows with some degree of automation and flexibility provides a more powerful approach to tackling current and future I/O challenges. In this paper we describe a workload replication workflow that extracts the I/O pattern of an application and recreates its behavior with a flexible proxy application. We demonstrate how simple lightweight characterization can be translated to provide an effective representation of a physics application, and show how a proxy replication can be used as a tool for investigating I/O library paradigms.
Metadata
Item Type: | Proceedings Paper |
---|---|
Authors/Creators: |
|
Copyright, Publisher and Additional Information: | © Copyright 2017 IEEE - All rights reserved. Use of this web site signifies your agreement to the terms and conditions. This is an author-produced version of the published paper. Uploaded in accordance with the publisher’s self-archiving policy. Further copying may not be permitted; contact the publisher for details. |
Dates: |
|
Institution: | The University of York |
Academic Units: | The University of York > Faculty of Sciences (York) > Computer Science (York) |
Depositing User: | Pure (York) |
Date Deposited: | 06 Sep 2018 09:10 |
Last Modified: | 17 Dec 2024 00:33 |
Published Version: | https://doi.org/10.1109/PDSW-DISCS.2016.007 |
Status: | Published |
Publisher: | IEEE |
Identification Number: | 10.1109/PDSW-DISCS.2016.007 |
Related URLs: | |
Open Archives Initiative ID (OAI ID): | oai:eprints.whiterose.ac.uk:135341 |
Download
Filename: Replicating_HPC_IO_workloads_Dickson_2016.pdf
Description: Replicating-HPC-IO-workloads-Dickson-2016