Patel, J, Jindal, V, Yen, IL et al. (3 more authors) (2015) Workload Estimation for Improving Resource Management Decisions in the Cloud. In: Proceedings - 2015 IEEE 12th International Symposium on Autonomous Decentralized Systems, ISADS 2015. 2015 IEEE Twelfth International Symposium on Autonomous Decentralized Systems, 25-27 Mar 2015, Taichung , Taiwan. IEEE , 25 - 32. ISBN 9781479982615
Abstract
In cloud computing, good resource management can benefit both cloud users as well as cloud providers. Workload prediction is a crucial step towards achieving good resource management. While it is possible to estimate the workloads of long-running tasks based on the periodicity in their historical workloads, it is difficult to do so for tasks which do not have such recurring workload patterns. In this paper, we present an innovative clustering based resource estimation approach which groups tasks that have similar characteristics into the same cluster. The historical workload data for tasks in a cluster are used to estimate the resources needed by new tasks based on the cluster(s) to which they belong. In particular, for a new task T, we measure T's initial workload and predict to which cluster(s) it may belong. Then, the workload information of the cluster(s) is used to estimate the workload of T. The approach is experimentally evaluated using Google dataset, including resource usage data of over half a million tasks. We develop a workload model based on the dataset which is then used to estimate the workload patterns of several randomly selected tasks from the trace log. The results confirm the effectiveness of this cluster-based method for estimating the resources required by each task.
Metadata
Item Type: | Proceedings Paper |
---|---|
Authors/Creators: |
|
Keywords: | Cloud computing, workload prediction, workload |
Dates: |
|
Institution: | The University of Leeds |
Academic Units: | The University of Leeds > Faculty of Engineering & Physical Sciences (Leeds) > School of Computing (Leeds) > Institute for Computational and Systems Science (Leeds) |
Depositing User: | Symplectic Publications |
Date Deposited: | 13 Nov 2015 13:06 |
Last Modified: | 13 Nov 2015 13:11 |
Published Version: | http://dx.doi.org/10.1109/ISADS.2015.17 |
Status: | Published |
Publisher: | IEEE |
Identification Number: | 10.1109/ISADS.2015.17 |
Open Archives Initiative ID (OAI ID): | oai:eprints.whiterose.ac.uk:89247 |