Fourth TPC Technology Conference on Performance Evaluation & Benchmarking
(TPCTC 2012)

in conjunction with VLDB 2012

Conference Program

August 27, 2012

07:30 - 08:20 Breakfast

08:20 - 08:45 Opening Remarks and Welcome
Raghunath Nambiar, Cisco
Invited Talk
Transaction Processing Performance Council: State of the Council 2012
Raghunath Nambiar, Cisco; Meikel Poess, Oracle; Michael Majdalany, LoBue & Majdalany Mgmt Group; Matthew Emmerton, IBM ; Andrew Masland, NEC; Forrest Carman, Owen Media; Reza Taheri, VMare
08:45 - 09:10 Incorporating Recovery from Failures into a Data Integration Benchmark
Meikel Poess, Oracle; Len Wyatt, Microsoft; Brian Caufield, IBM; Marco Vieira, University of Coimbra
09:10 - 09:35 Two firsts for the TPC: A benchmark to characterize databases virtualized in the cloud, and a publicly-available, complete end-to-end reference kit
Andy Bond, Red Hat, Inc.; Reza Taheri, VMware; Greg Kopczinski, VMware
09:35 - 10:00 Adding a Temporal Dimension to the TPC-H Benchmark
Mohammed Al-Kateb, Teradata Corporation; Alain Crolotte, Teradata Corporation; Ahmad Ghazal, Teradata Corporation; Linda Rose, Teradata Corporation

10:00 - 10:30 Coffee Break

10:30 - 11:10 Invited Talk
Performance Per Watt - Benchmarking ways to get more for less
Karl Huppler, IBM
11:10 - 11:35 Revisiting ETL Benchmarking - the Case for Hybrid Flows
Alkis Simitsis, HPLabs; Kevin Wilkinson, HPLabs
11:35 - 12:00 MulTe: A Multi-Tenancy Database Benchmark Framework
Tim Kiefer, Dresden Univ, of Technology; Benjamin Schlegel, Dresden University of Technology; Wolfgang Lehner, Dresden University of Technology

12:00 - 13:30 Lunch Break

13:30 - 14:25 Keynote
BDMS Performance Evaluation: Practices, Pitfalls, and Possibilities
Michael Carey, University of California, Irvine

14:25 - 14:50 Data Historians in the Data Management Landscape
Brice Chardin, LIRIS; Jean-Marc Lacombe, EDF R&D; Jean-Marc Petit, LIRIS
14:50 - 15:15 Scalable Generation of Synthetic GPS Traces with Real-life Data Characteristics
Konrad Bösche, TomTom; Thibault Sellam, CWI; Holger Pirk, CWI; René Beier, TomTom; Peter Mieth, TomTom; Stefan Manegold, CWI
15:15 - 15:40 S3G2: A Scalable Structure-correlated Social Graph Generator
Minh-Duc Pham, CWI; Peter Boncz, CWI; Orri Erling, Openlink Software

15:40 - 16:00 Coffee Break

16:00 - 16:25 Benchmarking in the Cloud: What it Should, Can, and Cannot Be
Enno Folkerts, SAP; Alexander Alexandrov, TU Berlin; Kai Sachs, SAP AG; Alexandru Iosup, TU Delft; Volker Markl, TU Berlin; Cafer Tosun, SAP AG
16:25 - 16:50 Characterizing Cloud Performance with TPC Benchmarks
Wayne Smith, Intel
16:50 - 17:15 WBDB2012 report
Setting the Direction for Big Data Benchmark Standards

Tilmann Rabl, University of Toronto; Chaitanya Baru, San Diego Supercomputer Center; Milind Bhandarkar, EMC/Greenplum; Meikel Poess, Oracle; Raghunath Nambiar, Cisco
17:15 - 17:30 Closing Remarks
Meikel Poess, Oracle

Call For Papers

Over the past two decades, the Transaction Processing Performance Council (TPC) has had a significant impact on the computing industry's use of industry-standard benchmarks. For example, vendors and endusers rely on TPC benchmarks to provide real-world data that is backed by a stringent and independent review process. Vendors also use TPC benchmarks to demonstrate performance competitiveness for their existing products, and to improve/monitor the performance of products-under-development. Many buyers often use TPC benchmark results as points of comparison when purchasing new computing systems.
The technology landscape is continually evolving and challenging industry experts and researchers to develop innovative techniques to evaluate and benchmark computing systems. The TPC remains committed to developing highly relevant benchmark standards and will continue to develop new benchmarks to keep pace. With this conference, the TPC encourages researchers and industry experts to submit novel ideas and methodologies in performance evaluation, measurement, and characterization.

Topics of interest include, but are not limited to:

  • Big Data analytics and infrastructure
  • Database Appliances
  • Cloud Computing
  • In-memory databases
  • Social media infrastructure
  • Business intelligence
  • Complex event processing
  • Database optimizations
  • Green computing
  • Disaster tolerance and recovery
  • Energy and space efficiency
  • Hardware innovations
  • Data Integration
  • Hybrid workloads
  • Virtualization
  • Lessons learned in practice using TPC workloads
  • Enhancements to TPC workloads

Submission Guidelines

Authors are invited to submit original, unpublished papers that are not currently under review for any other conference or journal. We also encourage the submission of extended abstracts, position statement papers and lessons learned in practice. The length of a paper should not exceed 16 pages. Papers should follow the LNCS format. The title page must contain a short abstract. All papers should be submitted electronically in PDF format to the review web site at:>

Important Dates

Abstract due June 8, 2012
Papers due June 15, 2012
Notification of acceptance June 30, 2012
Camera-ready copies July 15, 2012
Workshop session August 27, 2012

Conference Venue and Registration
Please visit the VLDB2012 conference web site at:

Proceedings will be published by Springer-Verlag as Lecture Notes in Computer Science (LNCS). Selected papers may be considered for future TPC benchmark developments.
LNCS logo

TPCTC 2012 Organization
General Chairs:
Raghunath Nambiar, Cisco, USA,
Meikel Poess, Oracle, USA,

Program Committee:
Alain Crolotte, Teradata, USA
Chaitanya Baru, San Diego Supercomputer Center, USA
Harumi Kuno, HP Labs, USA
Daniel Bowers, Ideas International, USA
Marco Vieira, University of Coimbra, Portugal
Masaru Kitsuregawa, University of Tokyo, Japan
Michael Brey, Oracle, USA
Michael Molloy, Dell, USA
Coskun Nurcan, Intel, USA
Tilmann Rabl, University of Toronto, Canada

Publicity Committee:
Raghunath Nambiar, Cisco, USA
Andrew Masland, NEC, USA
Meikel Poess, Oracle, USA
Matthew Emmerton, IBM, Canada
Reza Taheri, VMware, USA
Michael Majdalany, L&M Management Group, USA
Forrest Carman, Owen Media, USA

Keynote Speaker:
Michael J. Carey, University of California, Irvine, USA

Invited Speaker:
Karl Huppler, IBM, USA