---

Lecture Slides and References

The topics, schedule, and lecture slides listed in this page are tentative, and will be updated periodically (e.g. weekly).

Weeks 1 and 2: Web Search and Information Retrieval

• Introduction
• Information retrieval model
• Ranking and Learning
• Contextual representation: BERT/GPT
• Recent papers on neural information retrieval
• Projects

References:

• T. Yang, A. Gerasoulis, Web Search Engines: Practice and Experience in Computer Science Handbook (T. Gonzalez. Eds), Chapman & Hall/CRC Press, 2014.
• CMS (Chapters 7 and 8) on retrieval models
• J. Guo, Y. Fan, Q. Ai, and W. B.Croft. A Deep Relevance Matching Model for Ad-hoc Retrieval, CIKM 2016.
• Pretrained Transformers for Text Ranking: BERT and Beyond, Andrew Yates, Rodrigo Nogueira, and Jimmy Lin, 2021
• Jacob Devlin et al. BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding, NAACL 2019.

Weeks 3-4: Advanced Topics on Document Retrieval, Ranking, and Indexing

• Recent research progress on neural information retrieval
• Inverted indexing and sparse retrieval
  
• Project meeting (3rd week of October)

References:

• SPLADE Sparse Retrieval. SIGIR 2021/2022.
• RocketQA: Dense Retrieval. EMNLP 2021
• LADR: Proximity graph based dense retrieval. SIGIR 2023.
• RetroMAE: Pretraining for dense retrieval. EMNLP 2022. LexMAE: Pretraining for sparse retrieval. ICLR 2023.
• O. Khattab, M. Zaharia ColBERT: Efficient and Effective Passage Search via Contextualized Late Interaction over BERT (Multi-vector representation) SIGIR 2020.
• Y. Yang et al., Compact Token Representations with Contextual Quantization for Efficient Document Re-ranking (Multi-vector representation) ACL'22.

Weeks 5-7: Offline Processing and Online Systems

• HW1
• Offline data processing and systems support
• Duplicate analysis and similarity computing
• Online query processing
• Group presentations

Weeks 8-10: Group Presentations

• HW2
• Nearest neighbor search
• Course summary

Back to class homepage