Sixth TPC Technology Conference on Performance Evaluation & Benchmarking
(TPCTC 2014)

in conjunction with VLDB 2014

Conference Program

September 5, 2014

08:00 - 08:30 Opening Remarks and Welcome
Raghunath Nambiar
08:30 - 09:00 Introducing TPCx-HS: Industry’s First Standard for Benchmarking Big Data Systems
Raghunath Nambiar, Tariq Magdon-Ismail, Akon Dey, Paul Cao, Andrew Bond and Da Qi Ren
09:00 - 09:30 An Evaluation of Alternative Physical Graph Data Designs for Processing Interactive Social Networking Actions
Shahram Ghandeharizadeh, Reihane Boghrati and Sumita Barahmand
09:30 - 10:00 On Characterizing the Performance of Distributed Graph Computation Platforms
Ahmed Barnawi, Omar Batarfi, Seyed-Mehdi-Reza Beheshti, Radwa Elshawi, Ayman Fayoumi, Reza Nouri and Sherif Sakr

10:00 - 10:30 Tea Break

10:30 - 11:00 An Analysis of the BigBench Workload
Chaitan Baru, Milind Bhandarkar, Carlo Curino, Manuel Danisch, Michael Frank, Bhaskar Gowda, Jie Huang, Hans-Arno Jacobsen, Dileep Kumar, Raghunath Nambiar, Meikel Poess, Francois Raab, Tilmann Rabl, Nishkam Ravi, Kai Sachs, Lan Yi and Choonhan Youn
11:00 - 11:30 A Parallel Scaling Framework for Universal Data Generation
Ling Gu, Minqi Zhou and Qiangqiang Kang
11:30 - 12:00 Towards an Extensible Middleware for Database Benchmarks
David Bermbach, Jörn Kuhlenkamp, Akon Dey, Sherif Sakr and Raghunath Nambiar
12:00 - 12:30 Scaling up MixeDd Workloads: a Battle of Data Freshness, Flexibility, and Scheduling
Iraklis Psaroudakis, Florian Wolf, Norman May, Thomas Neumann, Alexander Boehm, Anastasia Ailamaki and Kai-Uwe Sattler

12:30 - 13:45 Lunch Break

13:45 - 14:30 Invited Talk
Towards Benchmarking IT-OT Big Data Applications

Umeshwar Dayal and Chetan Gupta
14:30 - 15:00 Parameter Curation for Benchmark Queries
Andrey Gubichev and Peter Boncz

15:00 - 15:30 Tea Break

15:30 - 16:00 Downtime-Free Live Migration in a Multitenant Database
Nicolas Michael and Yixiao Shen
16:00 - 16:30 Performance analysis of database virtualization with the TPC-VMS benchmark
Eric Deehr, Wen-Qi Fang, H. Reza Taheri and Hai-Fang Yun
16:30 - 17:00 A Query, a Minute: Evaluating Performance Isolation in Cloud Databases
Tim Kiefer, Hendrik Schön, Dirk Habich and Wolfgang Lehner
17:00 - 17:30 Composite Key Generation on a Shared-Nothing Architecture
Marie Hoffmann, Alexander Alexandrov, Periklis Andritsos, Juan Soto and Volker Markl
17:30 - 18:00 Closing Remarks
Meikel Poess

Call For Papers

The Transaction Processing Performance Council (TPC) is a non-profit organization established in August 1988. Over the past two decades, the TPC has had a significant impact on the computing industry’s use of industry-standard benchmarks. Vendors use TPC benchmarks to illustrate performance competitiveness for their existing products, and to improve and monitor the performance of their products under development. Many buyers use TPC benchmark results as points of comparison when purchasing new computing systems. The information technology landscape is evolving at a rapid pace, challenging industry experts and researchers to develop innovative techniques for evaluation, measurement and characterization of complex systems. The TPC remains committed to developing new benchmark standards to keep pace, and one vehicle for achieving this objective is the sponsorship of the Technology Conference on Performance Evaluation and Benchmarking (TPCTC). Over the last five years we have held TPCTC successfully in conjunction with VLDB.

With this conference, the TPC encourages researchers and industry experts to submit novel ideas and methodologies in performance evaluation, measurement, and characterization.

Topics of interest include, but are not limited to:

  • Big Data
  • Benchmark Developments
  • Appliances
  • Cloud Computing
  • In-memory databases
  • Social media infrastructure
  • Business intelligence
  • Complex event processing
  • Database optimizations
  • Green computing
  • Disaster tolerance and recovery
  • Energy and space efficiency
  • Hardware innovations
  • Data Integration
  • Hybrid workloads
  • Virtualization
  • Lessons learned in practice using TPC workloads
  • Enhancements to TPC workloads
Submission Guidelines
Authors are invited to submit original, unpublished papers that are not currently under review for any other conference or journal. We also encourage the submission of extended abstracts, position statement papers and lessons learned in practice. The length of a paper should not exceed 16 pages. Papers should follow the LNCS format. The title page must contain a short abstract. All papers should be submitted electronically in PDF format to the review web site at:

Important Dates

Abstract due June 8, 2014
Papers due June 15, 2014
Notification of acceptance June 30, 2014
Camera-ready copies July 15, 2014
Workshop session September 5, 2014

Conference Venue and Registration
Please visit the VLDB2014 conference web site at:

Proceedings will be published by Springer-Verlag as Lecture Notes in Computer Science (LNCS). Selected papers may be considered for future TPC benchmark developments.
LNCS logo

TPCTC 2014 Organization

General Chairs:
Raghunath Nambiar, Cisco, USA,
Meikel Poess, Oracle, USA,

Program Committee:
Chaitanya Baru, SDSC, USA
Daniel Bowers, Gartner, USA
Michael Brey, Oracle, USA
Alain Crolotte, Teradata, USA
Akon Dey, University of Sydney, Australia
Masaru Kitsuregawa, University of Tokyo, Japan
Harumi Kuno, HP Labs, USA
Dhabaleswar Panda, The Ohio State University, USA
Tilmann Rabl, University of Toronto, Canada
Reza Taheri, VMWare, USA
Marco Vieira, University of Coimbra, Portugal
Wen Chen, University of North Dakota, USA
Xiaohua Tony, Drexel University, USA
Jianfeng Zhan, Chinese Academy of Sciences, PRC

Publicity Committee:
Raghunath Nambiar, Cisco, USA
Andrew Bond, Red Hat, USA
Andrew Masland, NEC, USA
Meikel Poess, Oracle, USA
Da-Qi Ren, Huawei, PRC
Reza Taheri, VMware, USA

Michael Majdalany, L&M Management Group, USA
Forrest Carman, Owen Media, USA
Andreas Hotea, Hotea Solutions, USA