Performance Evaluation in Database Research: Principles and Experience
Authors
- Stefan Manegold (CWI, Amsterdam, The Netherlands)
- Ioana Manolescu (INRIA Saclay, France)
Abstract
A significant part of today's database research focuses on improving performance of a specific system. Quantitative experiments are the best way to validate such results. However, performing experiments is not always easy. Besides the complexity of the system under test, designing an experiment, choosing the right environment and parameter values, analyzing the data which is gathered, and reporting it to a third party in an expressive and intelligible way is hard.
In this tutorial, we present a general road-map to the above steps, including tips and tricks on how to organize and present code that performs experiments, so that an outsider can repeat them.
The tutorial is primarily aimed at MS and PhD students seeking to improve their experiment practices, but more senior attendants may also find it interesting.
About the Authors
Stefan Manegold (CWI, Amsterdam, The Netherlands)
Stefan Manegold is a researcher in the database group at CWI in Amsterdam, The Netherlands. His research work comprises database architectures and data management on modern hardware as well as database-supported XML processing, with a particular interest in optimization, performance and benchmarking. He is co-founder of the DaMoN workshop series (co-located with SIGMOD since 2005) and co-chair of ExpDB 2007.
Ioana Manolescu (INRIA Saclay, France)
Ioana Manolescu is a researcher in the Gemo group of INRIA Saclay, in France. Her research work is centered around XML data management, distributed data management systems, and Web application modeling. She is a founder of two SIGMOD-affiliated workshops, XIME-P on XQuery processing, and ExpDB on experimental evaluation in database research.