Drop Your Decoder: Pre-training with Bag-of-Word Prediction for Dense Passage Retrieval
Association for Computing Machinery (ACM) via YouTube
2,000+ Free Courses with Certificates: Coding, AI, SQL, and More
Python, Prompt Engineering, Data Science — Build the Skills Employers Want Now
Overview
Google, IBM & Meta Certificates — All 10,000+ Courses at 40% Off
One annual plan covers every course and certificate on Coursera. 40% off for a limited time.
Get Full Access
Learn about an innovative approach to dense passage retrieval in this 15-minute conference talk from SIGIR 2024. Explore how pre-training with bag-of-word prediction can enhance retrieval performance by eliminating the need for a decoder component. Discover the technical implementation details and potential benefits of this streamlined approach presented at the Association for Computing Machinery's Special Interest Group on Information Retrieval conference.
Syllabus
SIGIR 2024 W1.1 [fp] Drop your Decoder: Pre-training with Bag-of-Word Prediction
Taught by
Association for Computing Machinery (ACM)