Information Retrieval
Instructor: Venkatesh Vinayakarao
Term: Aug - Dec 2018
Teaching Assistants: To be announced.



Welcome to Information Retrieval (IR) course! It is difficult to imagine living without search engines. Availability of big data has necessitated a systematic study of retrieval techniques. Principles and practices of information retrieval have been a focus of both researchers and practitioners alike. This course is not about just search engines. It is about dealing with big data and retrieving information which opens up interesting applications for information technology. This course will introduce students to key parts of IR such as indexing techniques, challenges in query processing and well-known retrieval models.

Key Learning Objectives

At the end of this course, you should be able to:
  • Understand and apply text retrieval techniques to big data.
  • Understand and apply text indexing techniques.
  • Analyze and evaluate existing retrieval systems.

Lecture Resources

Lecture #TopicReadingsSlides/Material
1Boolean RetrievalChapter 1 from CPSLecture 1
Assignment 1
2Content Processing and EvaluationChapter 2 from CPSLecture 2
3Handling DictionariesChapter 3 from CPSLecture 3
4Index Construction and Index CompressionChapter 4,5 from CPSLecture 4
5Musings from the Real WorldNone.Lecture 5
6Implementing a Search Engine with LuceneNone.Tutorial 1 - Lucene
LuceneDemo: Import into eclipse as an archive file.
7Stemming - Porter/SnowballSnowball Stemmer
Porter Algorithm
Tutorial 2 - Manning's Slides on Stemming
StemmingDemo.zip: Import into eclipse as an archive file.
Lecture 6
8Vector Space ModelChapter 6 of CPSLecture 7 - Bonus Task and Mock Mid-Term
Mock Mid-Term Question Paper
Assignment 2
9Term Weighting
TF-IDF and Variants of TF-IDF
Chapter 6,7 of CPSLecture 8
Lecture 9
10Revisiting Indexes: Forward, Inverted, Positional, Permuterm and k-gram Indexes
Revisiting Query Processing:Query processing order for boolean queries
Lecture 10
Surprise Test 1
Lecture 11
Surprise Test 2
Mid Term
11Zones and Fields, Term WeightsChapter 6 of CPSLecture 12
Lecture 13
12IR EvaluationChapter 8 of CPS
13Relevance FeedbackChapter 9 of CPS
14Pseudo-Relevance FeedbackChapter 9 of CPS
Assignment 3
15Query ExpansionChapter 9 of CPS
16Probabilistic RetrievalChapter 11 of CPS
17Language Models for IRChapter 12 of CPS
18Advanced Topics in IR (Web Basics, Web Crawling, Link Analysis)Chapter 19,20,21 of CPS
Final Exam


Evaluation
InstrumentMax Marks
Mid-Term35%
Final Exam35%
Assignment 12%
Assignments 2, 3 (4% each)8%
Project20%

Pre-requisites
Students must bring strong programming skills, preferrably in Java.

Project
The project component is mandatory. Students may form groups of up to three. The objective is to learn by building a search engine yourself. Project will be evaluated in three parts:
  • A two page technical report covering the approach.
  • A live demo of the project.
  • A 15 minute presentation.
Resources

Text
  • [CPS] An Introduction to Information Retrieval. Christopher D. Manning, Prabhakar Raghavan, Hinrich Schütze.
Reference
  • [BDT] Search Engines: Information Retrieval in Practice. Bruce Croft, Donald Metzler, Trevor Strohman


If you are not having fun, you are not the best student you can be!