TPC photo
The TPC defines transaction processing and database benchmarks and delivers trusted results to the industry
    Document Search         Member Login    
     Home
About the TPC
Benchmarks
      Newsletter
      Join the TPC
      Downloads
      Technical Articles
      TPCTC
      Performance-Pulse

TPC Benchmark Status May 2013

Overview

Published about 4 times per year, the TPC Benchmark Status Report is a digest of the activities of the TPC and its technical subcommittees.

The TPC held a meetings on February 8th in Austin, Texas. The TPC-H specification was updated to Version 2.15.0 following minor corrections and clarifications. The TPC’s fifth Technology Conference, TPCTC 2013, was approved and will be held in conjunction with the annual conference on Very Large Databases (VLDB), in Trento, Italy. The TPC has also made several improvements to the web site and notification services to enhance the user experience.

 

Current Benchmarks

TPC-C

The TPC-C Maintenance Subcommittee had no outstanding issues to discuss. The subcommittee continues to monitor the benchmark, along with any TAB interpretations and rulings, for discussion and possible inclusion in future versions of the TPC-C specification.

 

TPC-DS

The TPC-DS Maintenance Subcommittee had no outstanding issues to discuss. The subcommittee continues to monitor the benchmark, along with any TAB interpretations and rulings, for discussion and possible inclusion in future versions of the TPC-DS specification.

 

TPC-E

The TPC-E Maintenance Subcommittee has made some minor enhancements to the EGen code to improve platform support, made some editorial changes to the specification, and is reviewing and extending the development of the unit test framework for EGen.

 

TPC-H

The TPC-H Maintenance Subcommittee released Version 2.15.0 of the TPC-H specification, which corrects a wrong reference, formalizes the term GUI and documentation disclosure in the specification and corrects an error in dbgen.

 

TPC-VMS

The TPC-VMS Maintenance Subcommittee had no outstanding issues to discuss. TPC-VMS specifies the rules and methodology for measuring and reporting TPC-C, TPC-E, TPC-H and TPC-DS metrics running in a Virtualized Environment.

 

Benchmarks Under Development

TPC-DI

Data Integration (DI), also known as ‘ETL’, is the analysis, combination, and transformation of data from a variety of sources and formats into a unified data model representation. Data Integration is a key element of data warehousing, application integration, and business analytics solutions. The variety and volume of data is always increasing and performance of data integration systems is critical. However, there has been no industry standard for measuring and comparing the performance of DI systems.

The TPC-DI benchmark subcommittee is continuing refinement of the specification. Definition of the System Under Test and rules for Pricing have been specified, and progress has been made on the definition of the automated audit. Development of the data generator is ongoing.

TPC-V

The TPC-V development subcommittee has been making progress in developing an end-to-end reference benchmarking kit, which can now run transactions on multiple databases in multiple VMs on a virtualized server. A new draft version of the specification has been approved.

 

Specifications Common to All Benchmarks

TPC-Energy

The TPC Energy subcommittee updated the EMSC code to version 1.5.0 while the TPC-Energy specification is now revision 1.50.

 

Pricing Specification

The current TPC Price Specification is Version 1.7.0 which includes minor enhancements to recognize use of storage devices other than rotating disks and to recognize that pricing rules apply to results that are in an active state on the TPC results list. All prior active results are considered to be comparable to those published under revision 1.7.

 

Other TPC Activities

TPC Technology Conference

The proceedings from TPCTC 2012 are now available.

The VLDB has approved the 2013 edition in conjunction with VLDB 2013. The TPC has issued a call for papers for the workshop which will be held on August 26, 2013 in Trento, Italy. With this conference, the fifth in the series, the TPC encourages researchers and industry experts to submit novel ideas and methodologies in performance evaluation, measurement, and characterization. Topics of interest include, but are not limited to:

  • Big Data Appliances
  • Cloud Computing
  • In-memory databases
  • Social media infrastructure
  • Business intelligence
  • Complex event processing
  • Database optimizations
  • Green computing
  • Disaster tolerance and recovery
  • Energy and space efficiency
  • Hardware innovations
  • Data Integration
  • Hybrid workloads
  • Virtualization
  • Lessons learned in practice using TPC workloads
  • Enhancements to TPC workloads

Abstracts are due on June 8 and papers on June 15, 2013.

 

TPC Web Site Enhancements

The TPC has made several improvements to the web site to ease navigation and enhance the searching for relevant results. The notification service has also been enhanced.

The advanced sorting feature (see example here) now presents a clearer screen and easier to understand filters. In addition, results are displayed immediately after a filter or parameter has been entered or changed. Another feature is the possibility to download a results spreadsheet for each of the benchmark specifications (see example here).

A new notification service has also been introduced. After signing up and setting a password, a menu will appear where users can choose the types of notifications they wish to receive. These options include:

  • Signing up for the Benchmark Status Report
  • Selection of the benchmark category of interest. The user will get notifications only on the categories they select
  • Selection of the frequency (e.g., daily, weekly, and/or montly digests)

 

All Benchmark Status Reports
 

Valid XHTML 1.0 Transitional Valid CSS!

  

Valid XHTML 1.0 Transitional Valid CSS!