Time is Money but How Much? Elastic Dataflow Processing on the Cloud
Prof. Yannis Ioannidis, University of Athens (Greece)
when: 25 September 2015, 4pm
where: room Turing, 7th floor, Paris Descartes University, 45 Rue Des Saints Peres, Paris 75006
Elasticity allows cloud resources to be leased on demand and used for as much time as needed, thereby creating virtual infrastructures that adapt to the workload and change dynamically over time. In this talk, we discuss how elasticity affects execution of complex database queries and the corresponding dataflows arising from them. In particular, we focus on the related concept of eco-elasticity, which captures the trade-offâetween the execution time of a dataflow and the corresponding amount of money one needs to pay to achieve it according to the charging policy of the cloud provider. We present the results of several studies of different problems and demonstrate the importance of eco-elasticity in dataflow optimization and database self-tuning in cloud environments. Specifically, we discuss common analytical queries and show how the tree execution plans they generate may be processed on the cloud so that profit is maximized. Furthermore, we discuss automated index creation and management taking advantage of paid-for but unused compute and storage resources. Finally, we outline the main aspects of Exareme, a system for elastic dataflow processing on the cloud, which has been built with eco-elasticity as one of its fundamental elements and has been used in all the experiments we present.
This is joint work with Herald Kllapi and (in parts) with Dimitris Achlioptas and Verena Kantere, with contributions from several members of the MaDgIK team at the Univ. of Athens and the "Athena" Research Center.
Yannis Ioannidis is currently a Professor at the Department of Informatics and Telecommunications of the University of Athens. In early 2011 he also became the President and General Director of the ATHENA Research and Innovation Center. He received his Ph.D. degree from the University of California-Berkeley in 1986. Immediately after that he joined the University of Wisconsin-Madison, where he became a Professor. His research interests include database and information systems, personalization and social networks, data infrastructures and digital libraries & repositories, scientific systems and workflows, eHealth systems, and human-computer interaction.
Yannis is an ACM and IEEE Fellow (2004 and 2010, respectively) and a member of Academia Europaea. He is also a recipient of the VLDB "10-Year Best Paper Award" (2003), the "Presidential Young Investigator Award" - PYI (1991), and of several awards for teaching excellence.
Yannis has been a (co-)principal investigator in over thirty five research projects funded by various government agencies (USA, Europe, Greece) or private industry. He is currently an Associate Editor of Information Systems and the Journal of Digital Libraries and has been a member of the program committees of over sixty conferences, six times as (co-)chair (ICDE'09, ADBIS'07, EDBT'06, HDMS'03, VLDB'02, VDB'98, and SSDBM'97).
Yannis has served as the ACM SIGMOD Chair (July 2009-June 2013), and is or has been a member of several other executive bodies of professional organizations (VLDB Endowment, IEEE TCDE Executive Committee, EDBT Endowment) and Scientific Advisory Boards (Max Planck Institute for Informatics, Greek National Science & Technology Council, Information Technology advisor to the Greek Minister of Health). He currently serves as the Greek delegate to the European Strategy Forum on Research Infrastructures (ESFRI), and an expert in the Programme Committee on Research Infrastructures within the European Commission's Horizon2020 Framework Programme.
Hosted by: Themis Palpanas
List of past seminars