Eleventh TPC Technology Conference on Performance Evaluation & Benchmarking
(TPCTC 2019)

in conjunction with VLDB 2019




Conference Program

August 26th, 2019


08:30 - 09:00 Opening Remarks, Welcome. The New TPC
Raghunath Nambiar.
09:00 - 09:30 Towards Benchmarking Cloud Big Data Services under SLA constraints
Nicolas Poggi, Victor Cuevas-Vicenttín, David Carrera, Josep Lluis Berral, Thomas Fenech, Gonzalo Gomez, Davide Brini, Alejandro Montero, Umar Farooq Minhas, Jose A. Blakeley, Donald Kossmann, Raghu Ramakrishnan and Clemens Szyperski.
09:30 - 10:00 Efficient Multiway Hash Join on Recongurable Hardware
Rekha Singhal, Yaqiz Zhang, Jeffrey D. Ullman, Raghu Prabhakar and Kunle Olukotun.
10:00 - 10:30 Challenges in Distributed MLPerf
Miro Hodak and Ajay Dholakia.


10:30 - 11:00 Coffee Break


11:00 - 11:30 AdaBench - Towards an Industry Standard Benchmark for Advanced Analytics
Tilmann Rabl, Christoph Brücke-Wendorff, Philipp Härtling, Stella Stars, Rodrigo Escobar Palacios, Hamesh Patel, Satyam Srivastava, Christoph Boden, Jens Meiners and Sebastian Schelter.
11:30 - 12:00 TPCxBB (BigBench) in a single node environment
Dippy Aggarwal, Shreyas Shekhar, Chris Elford, Umachandar Jayachandran, Sadashivan Krishnamurthy, Brendan Niebruegge and Jamie Reding.
12:00 - 12:30 CBench-Dynamo: A Consistency Benchmark for NoSQL Database Systems
Miguel Diogo, Bruno Cabral and Jorge Bernardino.


12:30 - 13:30 Lunch Break


13:30 - 14:30 Keynote: State of Permissionless and Permissioned Blockchains: Myths and Reality
C. Mohan, IBM Almaden Research Center.
14:30 - 15:00 Benchmarking Databases "On-The-Go"
Carl Nuessle, Oliver Kennedy and Lukasz Ziarek.
15:00 - 15:30 End-to-End Benchmarking of Deep Learning Platforms
Vincent Deuschle, Alexander Alexandrov and Volker Markl.


15:30 - 16:00 Coffee Break


16:00 - 17:00 Panel: Role of the TPC in the Cloud Age
Alain Crolotte, Feifei Li, Peter Boncz ,Raghunath Nambiar, Meikel Poess (moderator)
17:00 - 17:30 Benchmarking Database Cloud Services
Manfred Drozd.
17:30 - 18:00 Use Machine Learning Methods to Predict Performance of Storage Devices
Yingxuan Zhu.
18:00 - 18:30 Closing Remarks



Call For Papers

The Transaction Processing Performance Council (TPC) is a non-profit organization established in August 1988. Over the past two decades, the TPC has had a significant impact on the computing industry’s use of industry-standard benchmarks. Vendors use TPC benchmarks to illustrate performance competitiveness for their existing products, and to improve and monitor the performance of their products under development. Many buyers use TPC benchmark results as points of comparison when purchasing new computing systems. The information technology landscape is evolving at a rapid pace, challenging industry experts and researchers to develop innovative techniques for evaluation, measurement and characterization of complex systems. The TPC remains committed to developing new benchmark standards to keep pace, and one vehicle for achieving this objective is the sponsorship of the Technology Conference on Performance Evaluation and Benchmarking (TPCTC). Over the last nine years we have held TPCTC successfully in conjunction with VLDB.


With the eleventh TPC Technology Conference on Performance Evaluation and Benchmarking (TPCTC 2019) proposal, we strive to excel the success of previous workshops by encouraging researchers and industry experts to present and debate novel ideas and methodologies in performance evaluation and benchmarking for emerging technology areas. Authors are invited to submit original, unpublished papers that are not currently under review for any other conference or journal. We also encourage the submission of extended abstracts, position statement papers and lessons learned in practice. The accepted papers will be published in the workshop proceedings, and selected papers will be considered for future TPC benchmark developments.
 

Topics of interest include, but are not limited to:

  • Blockchain
  • Big Data and Analytics
  • Complex event processing
  • Database Optimizations
  • Data Integration
  • Disaster tolerance and recovery
  • Artificial Intelligence
  • Emerging storage technologies (NVMe, 3D XPoint Memory etc)
  • Hybrid workloads
  • Energy and space efficiency
  • In-memory databases
  • Internet of Things
  • Virtualization
  • Enhancements to TPC workloads
  • Lessons learned in practice using TPC workloads
  • Collection and interpretation of performance data in public cloud environments

Submission Guidelines

Authors are invited to submit original, unpublished papers that are not currently under review for any other conference or journal. We also encourage the submission of extended abstracts, position statement papers and lessons learned in practice. The length of a paper should not exceed 16 pages. Papers should follow the LNCS format. The title page must contain a short abstract. All papers should be submitted electronically in PDF format to the review web site at: Easychair

Important Dates

Abstract due: June 10th, 2019
Papers due: June 15th, 2019
Notification of acceptance: July 5th, 2019
Camera-ready copies: August 1st, 2019
Conference day: August 26th (full day)


Conference Venue and Registration
Please visit the VLDB2019 conference web site at: http://www.vldb.org/2019/

Proceedings
Proceedings will be published by Springer-Verlag as Lecture Notes in Computer Science (LNCS). Selected papers may be considered for future TPC benchmark developments.
LNCS logo



TPCTC 2019 Organization (Tentative)

General Chairs and Contacts
Raghunath Nambiar, AMD, USA, raghu.nambiar@amd.com
Meikel Poess, Oracle, USA, meikel.poess@oracle.com

Program Committee (Tentative)
Daniel Bowers, Gartner, USA
Michael Brey, Oracle, USA
Alain Crolotte, Teradata, USA
Paul Cao, HPE, USA
Ajay Dholakia, Lenovo, USA
Karthik Kulkarni, Cisco, USA
Manoj Kumar, INFLIBNET, India
Dhabaleswar Panda, The Ohio State University, USA
Tilmann Rabl, TU Berlin, Germany
Reza Taheri, VMWare, USA

Publicity Committee
Meikel Poess, Oracle, USA
Andrew Bond, Red Hat, USA
Paul Cao, HPE, USA
Gary Little, Nutanix, USA
Raghunath Nambiar, AMD, USA
Reza Taheri, VMware, USA

Michael Majdalany, L&M Management Group, USA
Forrest Carman, Owen Media, USA
Andreas Hotea, Hotea Solutions, USA



Keynote and invited talks:
State of Permissionless and Permissioned Blockchains: Myths and Reality
C. Mohan, IBM Almaden Research Center



About the TPC
The Transaction Processing Performance Council (TPC) is a non-profit organization that defines transaction processing and database benchmarks and distributes vendor-neutral performance data to the industry. Additional information is available at http://www.tpc.org/.