Inproceedings,

Challenges and Future Directions in Efficiency Benchmarking (Vision Paper)

, , , , , , , , and .
Companion of the 2023 ACM/SPEC International Conference on Performance Engineering, page 51–55. New York, NY, USA, Association for Computing Machinery, (2023)

Abstract

SPEC benchmarks are crucial contributors behind the improvement of server efficiency since 2007, given their role in making the power consumption and efficiency of servers transparent for government regulators, customers, and the manufacturers themselves.As the IT landscape experiences radical transformations, efficiency benchmarks need to be updated accordingly to generate results relevant to government regulators, manufacturers, and customers. In this paper, we outline current challenges efficiency benchmark developers are tackling and highlight recent technological developments the next generation of efficiency benchmarks should take into account.

Tags

Users

  • @se-group
  • @max.meissner
  • @samuel.kounev
  • @dblp
  • @michael_stenger

Comments and Reviews