Towards a Quantum Benchmark Suite with Standardized KPIs

Benchmarking quantum computing hardware and related software is being researched very actively at the moment as predicting the real-world performance of quantum processing units for broad application areas in a fair, standardized and vendor-agnostic way is still very challenging. In this paper, we present our research plans for designing a quantum benchmark suite based on measuring a complete set of standardized key performance indicators together with a brief overview of the state-of-the-art of quantum benchmarking. With this in mind we discuss general ideas about designing, assessing and standardizing quantum benchmarks.