TPC photo
The TPC defines transaction processing and database benchmarks and delivers trusted results to the industry
 Home
 Results
 Benchmarks
 TPC Documentation
 Technical Articles
 Related Links
 What's New
 About the TPC
 Who We Are
 Contact Us
 Join the TPC
 TPCTC
 Document Search


 Member Login

TPC-VMS

TPC Benchmark(tm) VMS (TPC-VMS) Overview

The TPC Virtual Measurement Single System Specification (TPC-VMS) leverages the TPC-C, TPC-E, TPC-H and TPC-DS Benchmarks by adding the methodology and requirements for running and reporting performance metrics for virtualized databases. The intent of TPC-VMS is to represent a Virtualization Environment where three database workloads are consolidated onto one server. Test sponsors choose one of the four benchmark workloads (TPC-C, TPC-E, TPC-H, or TPC-DS) and runs one instance of that benchmark workload in each of the 3 virtual machines (VMs) on the system under test. The 3 virtualized databases must have the same attributes, e.g. the same number of TPC-C warehouses, the same number of TPC-E Load Units, or the same TPC-DS or TPC-H scale factors. The TPC-VMS Primary Performance Metric is the minimum value of the three TPC Benchmark Primary metrics for the TPC Benchmarks run in the Virtualization Environment.


Virtualization Performance Insights from TPC-VMS

Wayne D. Smith and Shiny Sebastian both fron Intel, have written a paper describing the TPC-VMS (Virtual Measurement Single System) benchmark that leverages the TPC-C, TPC-E, TPC-H, and TPC-DS benchmarks to provide a measure of database performance in a virtualized environment. TPC-VMS requires 3 identical TPC Benchmarks to be run in separate virtual machines, i.e. 3 TPC-C VMs, 3 TPC-E VMs, 3 TPC-H VMs or 3 TPC-DS VMs. The TPC-VMS performance metric is the minimum value of the three TPC performance metrics. During the development phase, the workload was prototyped to prove the viability of the benchmark. At first glance TPC-VMS was considered a simple benchmark; however the prototyping effort uncovered a number of performance issues intrinsic to virtualization of database applications.
To view the full paper, click here.



TPC-VMS Benchmark Results

Note 1:The TPC-VMS Specification leverages the TPC-C, TPC-E, TPC-H and TPC-DS Benchmarks by adding the methodology and requirements for running and reporting virtualization metrics. TPC-VMS defines four new benchmarks that are neither comparable to each other nor to the base benchmarks from which they are derived. The primary metric reported as defined by TPC-VMS is in the form of VMS "performance" where the performance units are specific by each TPC Benchmark, e.g. VMStpmC, VMStpsE, VMSQphH or VMSQphDS. There is no requirement, intended or implied, to publish a Result of the TPC Benchmark used as the basis for the TPC-VMS Result.


TPC-VMStpsE - Top Performance Results
Version 1.x.x Results  

Rank Company System Performance
(VMStpsE)
Price/VMStpsE Watts/VMStpsE System Availability VMMS VM1 DBMS VM1 Operating System Processors / Cores /
Threads
Date Submitted
     HP Proliant DL380p Gen8 Intel® Xeon® E5-2697v2 C/S with 1 Proliant DL360 G7  718.12  648 USD   NR  04/14/2014  VMware vSphere 5.5  Microsoft SQL Server 2014 Enterprise Edition  Microsoft Windows Server 2012 Standard Edition  2/24/48  4/14/2014 
     HP Proliant DL385p Gen8 AMD Opteron(tm) 6386SE Processor C/S with 1 Proliant DL360 G7  457.55  571 USD   NR  09/30/2013  VMware vSphere 5.5  Microsoft SQL Server 2012 Enterprise Edition SP1  Microsoft Windows Server 2012 Standard Edition  2/32/32  08/26/2013 

'NR' in the Watts/Ktpmc column indicates that no energy data was reported for that benchmark.




TPC-VMStpsE - Top Price/Performance Results
Version 1.x.x Results  

Rank Company System Performance
(VMStpsE)
Price/VMStpsE Watts/VMStpsE System Availability VMMS VM1 DBMS VM1 Operating System Processors / Cores /
Threads
Date Submitted
     HP Proliant DL385p Gen8 AMD Opteron(tm) 6386SE Processor C/S with 1 Proliant DL360 G7  457.55  571 USD   NR  09/30/2013  VMware vSphere 5.5  Microsoft SQL Server 2012 Enterprise Edition SP1  Microsoft Windows Server 2012 Standard Edition  2/32/32  08/26/2013 
     HP Proliant DL380p Gen8 Intel® Xeon® E5-2697v2 C/S with 1 Proliant DL360 G7  718.12  648 USD   NR  04/14/2014  VMware vSphere 5.5  Microsoft SQL Server 2014 Enterprise Edition  Microsoft Windows Server 2012 Standard Edition  2/24/48  4/14/2014 


'NR' in the Watts/Ktpmc column indicates that no energy data was reported for that benchmark.

TPC-VMS Current Version
The current version of TPC-VMS is Version 1.2.0. Click on the preferred format below to download:
 
Related Spec
This Benchmark refers to the pricing specification.


to top of page
Home   Results   Benchmarks   Technical Articles   Related Links   What's New   About the TPC   Who We Are   Privacy Policy   About Pricing   Contact Us  
 

Valid XHTML 1.0 Transitional Valid CSS!