Class Central is learner-supported. When you buy through links on our site, we may earn an affiliate commission.

YouTube

Is GPL the Future of Sentence Transformers - Generative Pseudo-Labeling Deep Dive

James Briggs via YouTube

Start learning Write review
DataCamp Ad

Power BI Fundamentals - Create visualizations and dashboards from scratch

Learn More → Boot.dev Ad

Learn Backend Development Part-Time, Online

Learn More →

Overview

Google, IBM & Meta Certificates – 40% Off
One Coursera Plus subscription covers most Professional Certificates on Coursera.
Unlock All Certificates
This course explains generative pseudo-labeling for training sentence transformers with unstructured text. It covers query generation, negative mining with vector retrieval, pseudo-labeling, MarginMSE fine-tuning, and evaluation.

Syllabus

Intro
Semantic Web and Other Uses
Why GPL?
How GPL Works
Query Generation
CORD-19 Dataset and Download
Query Generation Code
Query Generation is Not Perfect
Negative Mining
Negative Mining Implementation
Negative Mining Code
Pseudo-Labeling
Pseudo-Labeling Code
Importance of Pseudo-Labeling
Margin MSE Loss
MarginMSE Fine-tune Code
Choosing Number of Steps
Fast Evaluation
What's Next for Sentence Transformers?

Taught by

James Briggs

Reviews

Start your review of Is GPL the Future of Sentence Transformers - Generative Pseudo-Labeling Deep Dive

Start learning

Never Stop Learning.

Get personalized course recommendations, track subjects and courses with reminders, and more.

Sign up for free
Someone learning on their laptop while sitting on the floor.