Solis Moreno, I, Garraghan, P, Townend, PM et al. (1 more author) (2013) An Approach for Characterizing Workloads in Google Cloud to Derive Realistic Resource Utilization Models. In: Service Oriented System Engineering (SOSE), 2013 IEEE 7th International Symposium on. 7th IEEE International Symposium of Service-Oriented System Engineering, 25-28 Mar 2013, San Francisco, USA. IEEE , San Francisco, USA , pp. 49-60. ISBN 978-1-4673-5659-6
Abstract
Analyzing behavioral patterns of workloads is critical to understanding Cloud computing environments. However, until now only a limited number of real-world Cloud datacenter tracelogs have been available for analysis. This has led to a lack of methodologies to capture the diversity of patterns that exist in such datasets. This paper presents the first large-scale analysis of real-world Cloud data, using a recently released dataset that features traces from over 12,000 servers over the period of a month. Based on this analysis, we develop a novel approach for characterizing workloads that for the first time considers Cloud workload in the context of both user and task in order to derive a model to capture resource estimation and utilization patterns. The derived model assists in understanding the relationship between users and tasks within workload, and enables further work such as resource optimization, energy-efficiency improvements, and failure correlation. Additionally, it provides a mechanism to create patterns that randomly fluctuate based on realistic parameters. This is critical to emulating dynamic environments instead of statically replaying records in the tracelog. Our approach is
evaluated by contrasting the logged data against simulation experiments, and our results show that the derived model parameters correctly describe the operational environment within a 5% of error margin, confirming the great variability of patterns that exist in Cloud computing.
Metadata
Item Type: | Proceedings Paper |
---|---|
Authors/Creators: |
|
Copyright, Publisher and Additional Information: | (c) 2013, IEEE. Reproduced in accordance with the publisher's self-archiving policy. |
Keywords: | Cloud computing workload patterns; MapReduce analysis; Resource usage patterns; Workload characterization |
Dates: |
|
Institution: | The University of Leeds |
Academic Units: | The University of Leeds > Faculty of Engineering & Physical Sciences (Leeds) > School of Computing (Leeds) The University of Leeds > Faculty of Engineering & Physical Sciences (Leeds) |
Depositing User: | Symplectic Publications |
Date Deposited: | 02 Sep 2013 11:56 |
Last Modified: | 20 Jun 2021 08:37 |
Published Version: | http://dx.doi.org/10.1109/SOSE.2013.24 |
Status: | Published |
Publisher: | IEEE |
Identification Number: | 10.1109/SOSE.2013.24 |
Open Archives Initiative ID (OAI ID): | oai:eprints.whiterose.ac.uk:76287 |