Theoretical results of QoS-guaranteed resource scaling for cloud-based MapReduce

Xu, Xiaoyong, Tang, Maolin, & Tian, Yu-Chu (2016) Theoretical results of QoS-guaranteed resource scaling for cloud-based MapReduce. IEEE Transactions on Cloud Computing. (In Press)

[img] Accepted Version (PDF 1MB)
Administrators only | Request a copy from author

View at publisher


Quality of Service (QoS) is a new issue in cloud-based MapReduce, which is a popular computation model for parallel and distributed processing of big data. QoS guarantee is challenging in a dynamical computation environment due to the fact that a fixed resource allocation may become under-provisioning, which leads to QoS violation, or over-provisioning, which increases unnecessary resource cost. This requires runtime resource scaling to adapt environmental changes for QoS guarantee. Aiming to guarantee the QoS, which is referred as to hard deadline in this work, this paper develops a theory to determine how and when resource is scaled up/down for cloud-based MapReduce. The theory employs a nonlinear transformation to define the problem in a reverse resource space, simplifying the theoretical analysis significantly. Then, theoretical results are presented in three theorems on sufficient conditions for guaranteeing the QoS of cloud-based MapReduce. The superiority and applications of the theory are demonstrated through case studies.

Impact and interest:

Citation counts are sourced monthly from Scopus and Web of Science® citation databases.

These databases contain citations from different subsets of available publications and different time periods and thus the citation count from each is usually different. Some works are not in either database and no count is displayed. Scopus includes citations from articles published in 1996 onwards, and Web of Science® generally from 1980 onwards.

Citations counts from the Google Scholar™ indexing service can be viewed at the linked Google Scholar™ search.

ID Code: 92771
Item Type: Journal Article
Refereed: Yes
Additional URLs:
Keywords: MapReduce, cloud computing, Quality of Service,, resource scaling, hard deadline
DOI: 10.1109/TCC.2016.2535277
ISSN: 2168-7161
Subjects: Australian and New Zealand Standard Research Classification > INFORMATION AND COMPUTING SCIENCES (080000) > DISTRIBUTED COMPUTING (080500) > Distributed Computing not elsewhere classified (080599)
Divisions: Current > Schools > School of Electrical Engineering & Computer Science
Current > QUT Faculties and Divisions > Science & Engineering Faculty
Copyright Owner: Copyright 2016 IEEE
Deposited On: 09 Feb 2016 22:42
Last Modified: 10 Mar 2016 03:48

Export: EndNote | Dublin Core | BibTeX

Repository Staff Only: item control page