Automatically Indexing Millions of Databases in Microsoft Azure SQL Database
- Sudipto Das ,
- Miroslav Grbic ,
- Igor Ilic ,
- Isidora Jovandic ,
- Andrija Jovanovic ,
- Vivek Narasayya ,
- Miodrag Radulovic ,
- Maja Stikic ,
- Gaoxiang Xu ,
- Surajit Chaudhuri
Published by ACM | Organized by ACM
An appropriate set of indexes can result in orders of magnitude better query performance. Index management is a challenging task even for expert human administrators. Fully automating this process is of significant value. We describe the challenges, architecture, design choices, implementation, and learnings from building an industrial-strength auto-indexing service for Microsoft Azure SQL Database, a relational database
service. Our service has been generally available for more than two years, generating index recommendations for every database in Azure SQL Database, automatically implementing them for a large fraction, and significantly improving performance of hundreds of thousands of databases. We also share our experience from experimentation at scale with production databases which gives us confidence in our index recommendation quality for complex real applications.
Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for thirdparty components of this work must be honored. For all other uses, contact the owner/author(s).