Tools
Tools
Gavua, EK and Kecskemeti, G (2019) A Comparative Analysis and Evaluation of MapReduce Cloud Computing Simulators. In: 2019 International Conference on High Performance Computing & Simulation (HPCS) . (The 2019 International Conference on High Performance Computing & Simulation (HPCS 2019), 15 July 2019 - 19 July 2019, Dublin, Ireland).
|
Text
hpcs19-EG-KG-Accepted.pdf - Accepted Version Download (140kB) | Preview |
Abstract
The application of MapReduce cloud computing simulators for research and development is becoming popular, due to its efficiency and ease of utilization. This ignited the development of several cloud simulators for algorithm testing and performance analysis of dynamic MapReduce environments. The selection of appropriate simulator for a specific research remains a challenge. We have designed a MapReduce classification framework to guide cloud and big data researchers on suitable tools. We have reviewed eleven MapReduce specific simulators. Our evaluation first revealed thirty general functional requirements for more widely applicable cloud simulators. Then, we focused on specific concerns of MapReduce related simulations and filtered the general requirements down to the most relevant thirteen. Our evaluation highlighted the strengths and weakness of several MapReduce simulators. IoT-Based applications, stream processing and replaying of production cluster workloads are key criteria absent from many simulators. Therefore, we identified these as gaps, that simulator developers could focus on when extending their works towards MapReduce oriented simulations. Finally, researchers simulating dynamic behaviors of Hadoop clusters should select simulators efficient in parameter tuning.
| Item Type: | Conference or Workshop Item (Paper) |
|---|---|
| Additional Information: | © 2019 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works. |
| Subjects: | Q Science > QA Mathematics > QA75 Electronic computers. Computer science |
| Divisions: | Computer Science & Mathematics |
| Date Deposited: | 16 May 2019 12:15 |
| Last Modified: | 22 May 2024 12:51 |
| DOI or ID number: | 10.1109/HPCS48598.2019.9188142 |
| URI: | https://researchonline.ljmu.ac.uk/id/eprint/10714 |
 |
View Item |