Tenth TPC Technology Conference on Performance Evaluation & Benchmarking
(TPCTC 2018)

in conjunction with VLDB 2018



Conference Program

August 31st, 2018


08:30 - 09:00 Opening Remarks, Welcome. Industry Standards for the AI Era
Raghunath Nambiar
09:00 - 09:30 UniBench: A Benchmark for Multi-Model Database Management Systems
Chao Zhang, Jiaheng Lu, Pengfei Xu and Yuxing Chen
09:30 - 10:00 A Comparison of Two Cache Augmented SQL Architectures
Shahram Ghandeharizadeh and Hieu Nguyen
10:00 - 10:30 PolyBench: The first benchmark for polystores
Jeyhun Karimov, Tilmann Rabl and Volker Markl


10:30 - 11:00 Coffee Break


11:00 - 11:30 Benchmarking Distributed Data Processing Systems for Machine Learning Workloads
Christoph Boden, Tilmann Rabl, Sebastian Schelter and Volker Markel
11:30 - 12:00 Benchmarking and Performance Analysis of Event Sequence Queries on RelationalDatabase
Yuto Hayamizu, Ryoji Kawamichi, Kazuo Goda and Masaru Kitsuregawa
12:00 - 12:30 Requirements for an Enterprise AI Benchmark
Cedric Bourrasset, France Boillod-Cerneux, Ludovic Sauge, Myrtille Deldossi, François Weillenreiter, Rajesh Bordawekar, Susan Malaika, Jean-Armand Broyelle, Marc West and Brian Belgodere


12:30 - 14:00 Lunch Break


14:00 - 15:00 Industry Panel “Benchmarking for 2020 and Beyond"
Ajay Dholakia, Shahram Ghandeharizadeh, Rajesh Bordawekar, Raghunath Nambiar
15:00 - 15:30 Characterizing the performance and resilience of HCI clusters with the TPCx-HCI
Reza Taheri, Andrew Bond, Doug Johnson, Greg Kopczynski, Gary Little and Bhavik Desai


15:30 - 16:00 Coffee Break


16:00 - 16:30 Data Consistency Properties of Document Store as a Service (DSaaS): using MongoDB Atlas as an example
Chenhao Huang, Michael Cahill, Alan Fekete and Uwe Röhm
16:30 - 17:00 Towards Evaluation of Tensorflow Performance in a Distributed Compute Environment
Miro Hodak and Ajay Dholakia
17:00 - 17:30 Lessons Learned from Performance Benchmarking of TPC-DS using Transwarp with Cisco UCS
Manan Trivedi and Zhenqiang Chen
17:30 - 18:00 Closing Remarks and the Road Ahead
Meikel Poess



Call For Papers

The Transaction Processing Performance Council (TPC) is a non-profit organization established in August 1988. Over the past two decades, the TPC has had a significant impact on the computing industry’s use of industry-standard benchmarks. Vendors use TPC benchmarks to illustrate performance competitiveness for their existing products, and to improve and monitor the performance of their products under development. Many buyers use TPC benchmark results as points of comparison when purchasing new computing systems. The information technology landscape is evolving at a rapid pace, challenging industry experts and researchers to develop innovative techniques for evaluation, measurement and characterization of complex systems. The TPC remains committed to developing new benchmark standards to keep pace, and one vehicle for achieving this objective is the sponsorship of the Technology Conference on Performance Evaluation and Benchmarking (TPCTC). Over the last nine years we have held TPCTC successfully in conjunction with VLDB.


With the tenth TPC Technology Conference on Performance Evaluation and Benchmarking (TPCTC 2018) proposal, we strive to excel the success of previous workshops by encouraging researchers and industry experts to present and debate novel ideas and methodologies in performance evaluation and benchmarking for emerging technology areas. Authors are invited to submit original, unpublished papers that are not currently under review for any other conference or journal. We also encourage the submission of extended abstracts, position statement papers and lessons learned in practice. The accepted papers will be published in the workshop proceedings, and selected papers will be considered for future TPC benchmark developments.
 

Topics of interest include, but are not limited to:

  • Artificial Intelligence
  • Big Data and Analytics
  • Complex event processing
  • Database Optimizations
  • Data Integration
  • Disaster tolerance and recovery
  • Emerging storage technologies (NVMe, 3D XPoint Memory etc)
  • Hybrid workloads
  • Energy and space efficiency
  • In-memory databases
  • Internet of Things
  • Virtualization
  • Enhancements to TPC workloads
  • Lessons learned in practice using TPC workloads
  • Collection and interpretation of performance data in public cloud environments

Submission Guidelines

Authors are invited to submit original, unpublished papers that are not currently under review for any other conference or journal. We also encourage the submission of extended abstracts, position statement papers and lessons learned in practice. The length of a paper should not exceed 16 pages. Papers should follow the LNCS format. The title page must contain a short abstract. All papers should be submitted electronically in PDF format to the review web site at: Easychair

Important Dates

Abstract due: June 10th, 2018
Papers due: June 15th, 2018
Notification of acceptance: June 22nd, 2018
Camera-ready copies: August 1st, 2018
Conference day: August 31st, 2018


Conference Venue and Registration
Please visit the VLDB2018 conference web site at: http://www.vldb.org/2018/

Proceedings
Proceedings will be published by Springer-Verlag as Lecture Notes in Computer Science (LNCS). Selected papers may be considered for future TPC benchmark developments.
LNCS logo



TPCTC 2018 Organization (Tentative)

General Chairs and Contacts
Raghunath Nambiar, AMD, USA
Meikel Poess, Oracle, USA

Program Committee (Tentative)
Daniel Bowers, Gartner, USA
Michael Brey, Oracle, USA
Alain Crolotte, Teradata, USA
Paul Cao, HPE, USA
Ajay Dholakia, Lenovo, USA
Karthik Kulkarni, Cisco, USA
Dhabaleswar Panda, The Ohio State University, USA
Reza Taheri, VMWare, USA

Publicity Committee
Andrew Bond, Red Hat, USA
Paul Cao, HPE, USA
Meikel Poess, Oracle, USA
Reza Taheri, VMware, USA
Vo Ngoc Phu, Duy Tan University, Vietnam

Michael Majdalany, L&M Management Group, USA
Forrest Carman, Owen Media, USA
Andreas Hotea, Hotea Solutions, USA



Keynote and invited talks: ytd



About the TPC
The Transaction Processing Performance Council (TPC) is a non-profit organization that defines transaction processing and database benchmarks and distributes vendor-neutral performance data to the industry. Additional information is available at http://www.tpc.org/.