A new approach to the cloud-based heterogeneous MapReduce placement problem

Xu, Xiaoyong & Tang, Maolin (2016) A new approach to the cloud-based heterogeneous MapReduce placement problem. IEEE Transactions on Services Computing, 9(6), pp. 862-871.

View at publisher

Abstract

Guaranteeing Quality of Service (QoS) with minimum computation cost is the most important objective of cloud-based MapReduce computations. Minimizing the total computation cost of cloud-based MapReduce computations is done through MapReduce placement optimization. MapReduce placement optimization approaches can be classified into two categories: homogeneous MapReduce placement optimization and heterogeneous MapReduce placement optimization. It is generally believed that heterogeneous MapReduce placement optimization is more effective than homogeneous MapReduce placement optimization in reducing the total running cost of cloud-based MapReduce computations. This paper proposes a new approach to the heterogeneous MapReduce placement optimization problem. In this new approach, the heterogeneous MapReduce placement optimization problem is transformed into a constrained combinatorial optimization problem and is solved by an innovative constructive algorithm. Experimental results show that the running cost of the cloud-based MapReduce computation platform using this new approach is 24:3%-44:0% lower than that using the most popular homogeneous MapReduce placement approach, and 2:0%-36:2% lower than that using the heterogeneous MapReduce placement approach not considering the spare resources from the existing MapReduce computations. The experimental results have also demonstrated the good scalability of this new approach.

Impact and interest:

0 citations in Scopus
Search Google Scholar™

Citation counts are sourced monthly from Scopus and Web of Science® citation databases.

These databases contain citations from different subsets of available publications and different time periods and thus the citation count from each is usually different. Some works are not in either database and no count is displayed. Scopus includes citations from articles published in 1996 onwards, and Web of Science® generally from 1980 onwards.

Citations counts from the Google Scholar™ indexing service can be viewed at the linked Google Scholar™ search.

Full-text downloads:

5 since deposited on 25 May 2015
1 in the past twelve months

Full-text downloads displays the total number of times this work’s files (e.g., a PDF) have been downloaded from QUT ePrints as well as the number of downloads in the previous 365 days. The count includes downloads for all files if a work has more than one.

ID Code: 84443
Item Type: Journal Article
Refereed: Yes
Keywords: MapReduce, Cloud-based MapReduce computation, MapReduce placement, Combinatorial optimization
DOI: 10.1109/TSC.2015.2433914
ISSN: 1939-1374
Divisions: Current > Schools > School of Electrical Engineering & Computer Science
Current > QUT Faculties and Divisions > Science & Engineering Faculty
Copyright Owner: 2015 IEEE
Copyright Statement: Personal use is permitted, but republication/redistribution requires IEEE permission
Deposited On: 25 May 2015 01:50
Last Modified: 26 Dec 2016 23:49

Export: EndNote | Dublin Core | BibTeX

Repository Staff Only: item control page