Towards a Resource Elasticity Benchmark for Cloud Environments
A. Weber, N. Herbst, H. Groenda, und S. Kounev. Proceedings of the 2nd International Workshop on Hot Topics in Cloud Service Scalability (HotTopiCS 2014), co-located with the 5th ACM/SPEC International Conference on Performance Engineering (ICPE 2014), Seite 5:1--5:8. New York, NY, USA, ACM, (März 2014)
Zusammenfassung
Auto-scaling features offered by today's cloud infrastructures provide increased flexibility especially for customers that experience high variations in the load intensity over time. However, auto-scaling features introduce new system quality attributes when considering their accuracy, timing, and boundaries. Therefore, distinguishing between different offerings has become a complex task, as it is not yet supported by reliable metrics and measurement approaches. In this paper, we discuss shortcomings of existing approaches for measuring and evaluating elastic behavior and propose a novel benchmark methodology specifically designed for evaluating the elasticity aspects of modern cloud platforms. The benchmark is based on open workloads with realistic load variation profiles that are calibrated to induce identical resource demand variations independent of the underlying hardware performance. Furthermore, we propose new metrics that capture the accuracy of resource allocations and de-allocations, as well as the timing aspects of an auto-scaling mechanism explicitly.
Proceedings of the 2nd International Workshop on Hot Topics in Cloud Service Scalability (HotTopiCS 2014), co-located with the 5th ACM/SPEC International Conference on Performance Engineering (ICPE 2014)
%0 Conference Paper
%1 WeHeGrKo2014-HotTopicsWS-ElaBench
%A Weber, Andreas
%A Herbst, Nikolas Roman
%A Groenda, Henning
%A Kounev, Samuel
%B Proceedings of the 2nd International Workshop on Hot Topics in Cloud Service Scalability (HotTopiCS 2014), co-located with the 5th ACM/SPEC International Conference on Performance Engineering (ICPE 2014)
%C New York, NY, USA
%D 2014
%I ACM
%K BUNGEE Cloud Elasticity LIMBO Metrics_and_benchmarking_methodologies Performance Resource_management Tool descartes t_workshop myown
%P 5:1--5:8
%T Towards a Resource Elasticity Benchmark for Cloud Environments
%U http://doi.acm.org/10.1145/2649563.2649571
%X Auto-scaling features offered by today's cloud infrastructures provide increased flexibility especially for customers that experience high variations in the load intensity over time. However, auto-scaling features introduce new system quality attributes when considering their accuracy, timing, and boundaries. Therefore, distinguishing between different offerings has become a complex task, as it is not yet supported by reliable metrics and measurement approaches. In this paper, we discuss shortcomings of existing approaches for measuring and evaluating elastic behavior and propose a novel benchmark methodology specifically designed for evaluating the elasticity aspects of modern cloud platforms. The benchmark is based on open workloads with realistic load variation profiles that are calibrated to induce identical resource demand variations independent of the underlying hardware performance. Furthermore, we propose new metrics that capture the accuracy of resource allocations and de-allocations, as well as the timing aspects of an auto-scaling mechanism explicitly.
@inproceedings{WeHeGrKo2014-HotTopicsWS-ElaBench,
abstract = {{Auto-scaling features offered by today's cloud infrastructures provide increased flexibility especially for customers that experience high variations in the load intensity over time. However, auto-scaling features introduce new system quality attributes when considering their accuracy, timing, and boundaries. Therefore, distinguishing between different offerings has become a complex task, as it is not yet supported by reliable metrics and measurement approaches. In this paper, we discuss shortcomings of existing approaches for measuring and evaluating elastic behavior and propose a novel benchmark methodology specifically designed for evaluating the elasticity aspects of modern cloud platforms. The benchmark is based on open workloads with realistic load variation profiles that are calibrated to induce identical resource demand variations independent of the underlying hardware performance. Furthermore, we propose new metrics that capture the accuracy of resource allocations and de-allocations, as well as the timing aspects of an auto-scaling mechanism explicitly.}},
added-at = {2020-04-05T23:07:53.000+0200},
address = {New York, NY, USA},
author = {Weber, Andreas and Herbst, Nikolas Roman and Groenda, Henning and Kounev, Samuel},
biburl = {https://www.bibsonomy.org/bibtex/26637f3038de0ebd1ca0cd511447adb90/samuel.kounev},
booktitle = {Proceedings of the 2nd International Workshop on Hot Topics in Cloud Service Scalability (HotTopiCS 2014), co-located with the 5th ACM/SPEC International Conference on Performance Engineering (ICPE 2014)},
interhash = {b48b599d7b3cad49ab264723cc9b121a},
intrahash = {6637f3038de0ebd1ca0cd511447adb90},
keywords = {BUNGEE Cloud Elasticity LIMBO Metrics_and_benchmarking_methodologies Performance Resource_management Tool descartes t_workshop myown},
month = {March},
pages = {5:1--5:8},
publisher = {ACM},
series = {HotTopiCS '14},
timestamp = {2020-10-21T04:00:41.000+0200},
title = {{Towards a Resource Elasticity Benchmark for Cloud Environments}},
url = {http://doi.acm.org/10.1145/2649563.2649571},
year = 2014
}