TPC photo
The TPC defines transaction processing and database benchmarks and delivers trusted results to the industry
    Document Search         Member Login    
     Home
About the TPC
Benchmarks
      Newsletter
      Join the TPC
      Downloads
      Technical Articles
      TPCTC
      Performance-Pulse

TPC Benchmark Status
May 2010

Overview

Published 4 times per year, the TPC Benchmark Status Report is a digest of the activities of the TPC and its technical subcommittees.

The TPC held a General Council meeting on April 22nd in Redmond, WA. On the OLTP front, the TPC-C Maintenance Subcommittee worked on requirements for the measurement resolution and reporting resolution of the TPC-C numerical quantities. the TPC-E Maintenance Subcommittee overhauled the status checking mechanisms of EGen, resulting in Version 1.11.0. With respect to decision support, the TPC-H Maintenance Subcommittee clarified rounding, precision, and auditor check list items with regard to durability and ACID testing, resulting in Version 2.11.0. The Energy Subcommittee updated the specification to version 1.1.1 to further clarify some definitions, and added extensions to the code.

 

Current Benchmarks

TPC-C

The TPC-C Maintenance Subcommittee discussed requirements for the measurement resolution and the reporting resolution of the TPC-C numerical quantities. The subcommittee will coordinate with the TPC-E subcommittee, the TPC-H subcommittee, the TPC-ETL subcommittee, and the TPC-certified auditors to develop consistent wording for the measurement resolution and reporting resolution across the different TPC specifications. This wording will be included in future revisions of the TPC specifications.

 

TPC-H

The TPC-H Maintenance Subcommittee released version 2.11.0 which clarifies rounding, precision, and auditor check list items with regard to durability and ACID testing. Version 2.11.0 is effective immediately. Version 2.10.0 becomes obsolete at 11:59 PM PT on June 21, 2010. Results under 2.11.0 will be comparable with all previous 2.x revisions.

In addition, the TPC lifted the restrictions specific to 30TB and 100TB results that were imposed last year.

 

TPC-E

The TPC-E Maintenance Subcommitteehas completed its work on the overhaul of the status checking mechanisms in EGen that are used to detect errors and/or questionable circumstances while the workload is being run.

Some editorial changes were made to the TPC-E Specification to support these EGen changes.

A new revision of the TPC-E benchmark standard (v1.11.0) with these specification and EGen changes was approved and is available immediately, and v1.10.0 becomes obsolete at 11:59 PM PT on June 21, 2010. Prior results and Version 1.11.0 results are comparable. Prior results do not need to be upgraded to Version 1.11.0 results.

 

Benchmarks Under Development

ETL

The ETL benchmark committee completed a draft of the transform specifications, and has begun work on data generation. Some member companies are now working on test implementations of the benchmark transformations.

Companies interested in participating in the development of this benchmark are invited to join and encouraged to contact the TPC Administrator.

 

Other TPC Activities

TPC Technology Conference 2010

Following the success of the event in 2009, the TPC is conducting its second TPC Technology Conference on Performance Evaluation and Benchmarking (TPCTC 2010). The conference will be collocated with the 36th International Conference on Very Large Data Bases (VLDB) on Sept. 17 in Singapore. The TPC is a co-sponsor of VLDB 2010. TPC is encouraging industry experts and researchers to submit novel ideas and methodologies in performance evaluation, measurement and characterization for 2012 and beyond. Conference information is available at www.tpc.org/tpctc/tpctc2010.

 

TPC Virtualization Working Group

The TPC extended the virtualization benchmark working group charter to develop a draft specification to be presented to the TPC at the June 2010 meeting.

Organizations that are interested in influencing the TPC-Virtualization benchmark are encouraged to become members.

 

TPC Energy

The TPC-Energy Subcommittee updated the specification to version 1.1.1 which clarifies and adds definitions. It also clarifies the required selection of sampling rates related to the Data Averaging Interval of the Power Analyzer.

The TPC-Energy Subcommittee also added additional extensions to the code which interfaces to the power analyzers and temperature probes. This code collects the energy and temperature data of the components of the System Under Test and creates a uniform log for reporting the results. The TPC uses a modified SPEC PTDaemon power and temperature daemon code as part of the Energy Measurement System (EMS) with extensions for the TPC implementation. These programs are available to Test Sponsors to run the TPC-Energy option of the TPC Benchmarks.

The TPC-Energy Specification 1.1.1 has been approved by the TPC membership and is now the current version of TPC-Energy Benchmark Specification. TPC-Energy results may now be audited and submitted for publication.

 

Pricing Specification

Version 1.5.0 of the Pricing Specification is currently required for all TPC benchmarks. The Price Maintenance Committee has not identified any additional changes needed for future versions of the specification.

 

Public Relations Committee

The TPC welcomed a new member, Cisco, and issued a press release in support of the TPC TC2010 Conference and announcing the formation of the Virtualization Working Group.

We welcome opportunities to present the benefits and status of TPC benchmarks: if you are interested in inviting someone from the TPC for a presentation, please contact Michael Majdalany (majdalany @ tpc.org)

 

 

All Benchmark Status Reports
 

Valid XHTML 1.0 Transitional Valid CSS!