TPC Benchmark™VMS (TPC-VMS) Overview

The TPC Virtual Measurement Single System Specification (TPC-VMS) leverages the TPC-C, TPC-E, TPC-H and TPC-DS Benchmarks by adding the methodology and requirements for running and reporting performance metrics for virtualized databases. The intent of TPC-VMS is to represent a Virtualization Environment where three database workloads are consolidated onto one server. Test sponsors choose one of the four benchmark workloads (TPC-C, TPC-E, TPC-H, or TPC-DS) and runs one instance of that benchmark workload in each of the 3 virtual machines (VMs) on the system under test. The 3 virtualized databases must have the same attributes, e.g. the same number of TPC-C warehouses, the same number of TPC-E Load Units, or the same TPC-DS or TPC-H scale factors. The TPC-VMS Primary Performance Metric is the minimum value of the three TPC Benchmark Primary metrics for the TPC Benchmarks run in the Virtualization Environment.

Virtualization Performance Insights from TPC-VMS

Wayne D. Smith and Shiny Sebastian both fron Intel, have written a paper describing the TPC-VMS (Virtual Measurement Single System) benchmark that leverages the TPC-C, TPC-E, TPC-H, and TPC-DS benchmarks to provide a measure of database performance in a virtualized environment. TPC-VMS requires 3 identical TPC Benchmarks to be run in separate virtual machines, i.e. 3 TPC-C VMs, 3 TPC-E VMs, 3 TPC-H VMs or 3 TPC-DS VMs. The TPC-VMS performance metric is the minimum value of the three TPC performance metrics. During the development phase, the workload was prototyped to prove the viability of the benchmark. At first glance TPC-VMS was considered a simple benchmark; however the prototyping effort uncovered a number of performance issues intrinsic to virtualization of database applications.
To view the full paper, click here.

• PDF (1.9 MB)
• DOC (6.1 MB)
• About Download Formats

• Pricing Specification