TPC photo
The TPC defines transaction processing and database benchmarks and delivers trusted results to the industry
    Document Search         Member Login    
     Home
About the TPC
Benchmarks
      Newsletter
      Join the TPC
      Downloads
      Technical Articles
      TPCTC
      Performance-Pulse

TPC Benchmark Status November 2013

Overview

The TPC Benchmark Status Report is a digest of the activities of the TPC and its technical subcommittees.

The TPC held a meetings on April 18th in Raleigh, NC, June 20th in Redmond, WA, and September 12th in Minneapolis, MN. The TPC-H specification was updated to Version 2.16.0 following minor corrections and clarifications. The TPC’s fifth Technology Conference, TPCTC 2013, was held in conjunction with the annual conference on Very Large Databases (VLDB), in Trento, Italy. The TPC has also introduced the concept of Historical Results.

 

Current Benchmarks

All Benchmarks

In an effort to keep the information on the web site current and relevant, the TPC has opted to classify certain older results as historical results. Results will become historical if:

  • The system (hardware or software) is no longer available, or
  • The system does not fulfill the pricing requirements of the TPC, or
  • The result is older than 3 years and the sponsor does not request an extension of the date that the result becomes obsolete.

These results will no longer appear on the top ten lists but are still accessible in two ways:

 

TPC-DS

The TPC-DS Maintenance Subcommittee made some minor improvements to the benchmark specification resulting in version 1.2 of the TPC-DS specification.

 

TPC-E

The TPC-E Maintenance Subcommittee has made some minor enhancements to the EGen code to improve platform support, made some editorial changes to the specification, and is reviewing and extending the development of the unit test framework for EGen.

 

TPC-H

The TPC-H Maintenance Subcommittee released Version 2.16.0 of the TPC-H specification, which corrects several query parameters in dbgen.

 

TPC-VMS

The TPC announced the publication of the first TPC-VMS result on August 26.

 

Benchmarks Under Development

TPC-DI

Data Integration (DI), also known as ‘ETL’, is the analysis, combination, and transformation of data from a variety of sources and formats into a unified data model representation. Data Integration is a key element of data warehousing, application integration, and business analytics solutions. The variety and volume of data is always increasing and performance of data integration systems is critical. However, there has been no industry standard for measuring and comparing the performance of DI systems.

The TPC-DI benchmark subcommittee is continuing refinement of the specification. Definition of the System Under Test and rules for Pricing have been specified, and progress has been made on the definition of the automated audit. Development of the data generator is ongoing.

 

TPC-V

The TPC-V development subcommittee has been making progress in developing an end-to-end reference benchmarking kit, which can now run transactions on multiple databases in multiple VMs on a virtualized server. A new draft version of the specification has been approved.

 

Other TPC Activities

TPC Technology Conference

The held a very successful TPC TC conference in Trento, Italy in conjunction with VLDB 2013. The presentations are now linked on the web site.

The TPC approved holding the 6th annual technology conference in conjunction with VLDB 2014.

 

TPC Big Data Working Group

The designation "Big Data" has become a mainstream buzz phrase across many industries as well as research circles. Big Data was identified as one of the top areas for benchmark development at the most recent TPC Technology Conference on Performance Evaluation and Benchmarking. However, today many vendors are making performance claims that are not easily verifiable in the absence of a neutral industry-wide benchmark.

With this in mind, the TPC has created a Big Data Working Group (TPC-BDWG) tasked with developing industry standards for benchmarking Big Data systems. Companies, research and government institutions who are interested in influencing the development of such benchmarks are encouraged to join the TPC.

 

All Benchmark Status Reports
 

Valid XHTML 1.0 Transitional Valid CSS!

  

Valid XHTML 1.0 Transitional Valid CSS!