Research talk: Approximate nearest neighbor search systems at scale
Building deep learning-based search and recommendation systems at internet scale requires a complete redesign of the search index. Key to this redesign is a fast, accurate, and cost-efficient indexing system for approximate nearest neighbor search. In this talk, we’ll present our recent advances in this space, including the DiskANN and FreshDiskANN systems and the underlying algorithms. These algorithms present an order-of-magnitude improvement in scale and cost-of-operation over the state of the art and are a first of their kind at effectively using solid-state drives (SSDs) to serve at interactive (milliseconds) latencies. In addition, they provide faster in-memory search than other graph indices, like HNSW, and support real-time concurrent insertions and deletions to SSD-resident indices without losing recall. We’ll provide an overview their applicability to various product scenarios and highlight directions for further research.
Learn more about the 2021 Microsoft Research Summit: https://Aka.ms/researchsummit (opens in new tab)
- Track:
- The Future of Search & Recommendation
- Date:
- Speakers:
- Harsha Simhadri
- Affiliation:
- Microsoft Research India
-
-
Harsha Simhadri
Principal Researcher
-
-
The Future of Search & Recommendation
-
-
Keynote: Universal search and recommendation
Speakers:- Paul Bennett
-
-
-
-
Research talk: Learning and pretraining strategies for dense retrieval in search and beyond
Speakers:- Chenyan Xiong
-
-
Research talk: Is phrase retrieval all we need?
Speakers:- Danqi Chen
-
-
-
-
-
Research talk: IGLU: Interactive grounded language understanding in a collaborative environment
Speakers:- Julia Kiseleva
-
Research talk: Summarizing information across multiple documents and modalities
Speakers:- Subhojit Som
-
-
-
Panel: The future of search and recommendation: Beyond web search
Speakers:- Eric Horvitz,
- Nitin Agrawal,
- Soumen Chakrabati
-
-
-
Research talk: Attentive knowledge-aware graph neural networks for recommendation
Speakers:- Yaming Yang
-
Panel: Causality in search and recommendation systems
Speakers:- Emre Kiciman,
- Amit Sharma,
- Dean Eckles
-