TPC photo
The TPC defines transaction processing and database benchmarks and delivers trusted results to the industry
 Home
 Results
 Benchmarks
 Technical Articles
 Related Links
 What's New
 About the TPC
 Who We Are
 Contact Us
 Join the TPC
 TPCTC
 Document Search


 Member Login

TPC Benchmark Status November 2013

Overview

The TPC Benchmark Status Report is a digest of the activities of the TPC and its technical subcommittees.

The TPC held a meetings on April 18th in Raleigh, NC, June 20th in Redmond, WA, and September 12th in Minneapolis, MN. The TPC-H specification was updated to Version 2.16.0 following minor corrections and clarifications. The TPC’s fifth Technology Conference, TPCTC 2013, was held in conjunction with the annual conference on Very Large Databases (VLDB), in Trento, Italy. The TPC has also introduced the concept of Historical Results.

 

Current Benchmarks

All Benchmarks

In an effort to keep the information on the web site current and relevant, the TPC has opted to classify certain older results as historical results. Results will become historical if:

  • The system (hardware or software) is no longer available, or
  • The system does not fulfill the pricing requirements of the TPC, or
  • The result is older than 3 years and the sponsor does not request an extension of the date that the result becomes obsolete.

These results will no longer appear on the top ten lists but are still accessible in two ways:

 

TPC-DS

The TPC-DS Maintenance Subcommittee made some minor improvements to the benchmark specification resulting in version 1.2 of the TPC-DS specification.

 

TPC-E

The TPC-E Maintenance Subcommittee has made some minor enhancements to the EGen code to improve platform support, made some editorial changes to the specification, and is reviewing and extending the development of the unit test framework for EGen.

 

TPC-H

The TPC-H Maintenance Subcommittee released Version 2.16.0 of the TPC-H specification, which corrects several query parameters in dbgen.

 

TPC-VMS

The TPC announced the publication of the first TPC-VMS result on August 26.

 

Benchmarks Under Development

TPC-DI

Data Integration (DI), also known as ‘ETL’, is the analysis, combination, and transformation of data from a variety of sources and formats into a unified data model representation. Data Integration is a key element of data warehousing, application integration, and business analytics solutions. The variety and volume of data is always increasing and performance of data integration systems is critical. However, there has been no industry standard for measuring and comparing the performance of DI systems.

The TPC-DI benchmark subcommittee is continuing refinement of the specification. Definition of the System Under Test and rules for Pricing have been specified, and progress has been made on the definition of the automated audit. Development of the data generator is ongoing.

 

TPC-V

The TPC-V development subcommittee has been making progress in developing an end-to-end reference benchmarking kit, which can now run transactions on multiple databases in multiple VMs on a virtualized server. A new draft version of the specification has been approved.

 

Other TPC Activities

TPC Technology Conference

The held a very successful TPC TC conference in Trento, Italy in conjunction with VLDB 2013. The presentations are now linked on the web site.

The TPC approved holding the 6th annual technology conference in conjunction with VLDB 2014.

 

TPC Big Data Working Group

The designation "Big Data" has become a mainstream buzz phrase across many industries as well as research circles. Big Data was identified as one of the top areas for benchmark development at the most recent TPC Technology Conference on Performance Evaluation and Benchmarking. However, today many vendors are making performance claims that are not easily verifiable in the absence of a neutral industry-wide benchmark.

With this in mind, the TPC has created a Big Data Working Group (TPC-BDWG) tasked with developing industry standards for benchmarking Big Data systems. Companies, research and government institutions who are interested in influencing the development of such benchmarks are encouraged to join the TPC.

 

TPC Web Site Enhancements

The TPC has made several improvements to the web site to ease navigation and enhance the searching for relevant results. The notification service has also been enhanced.

The advanced sorting feature (see example here) now presents a clearer screen and easier to understand filters. In addition, results are displayed immediately after a filter or parameter has been entered or changed. Another feature is the possibility to download a results spreadsheet for each of the benchmark specifications (see example here).

A new notification service has also been introduced. After signing up and setting a password, a menu will appear where users can choose the types of notifications they wish to receive. These options include:

  • Signing up for the Benchmark Status Report
  • Selection of the benchmark category of interest. The user will get notifications only on the categories they select
  • Selection of the frequency (e.g., daily, weekly, and/or montly digests)

 

All Benchmark Status Reports
 


to top of page
Home   Results   Benchmarks   Technical Articles   Related Links   What's New   About the TPC   Who We Are   Privacy Policy   About Pricing   Contact Us  
 

Valid XHTML 1.0 Transitional Valid CSS!