Train Sentence Transformers by Generating Queries - GenQ
Offered By: James Briggs via YouTube
Course Description
Overview
Learn how to train sentence transformers using the GenQ technique for improved dense retrieval in semantic search. Explore the challenges of fine-tuning bi-encoders and discover how GenQ leverages text generation to create synthetic training data. Dive into the process of augmenting passages with synthetic queries, understand asymmetric semantic search, and master T5 query generation. Follow along with a comprehensive code walkthrough for implementing GenQ and fine-tuning bi-encoders. Gain insights into overcoming data scarcity and enhancing retriever performance in this informative video tutorial.
Syllabus
Intro
Why GenQ?
GenQ Overview
Training Data
Asymmetric Semantic Search
T5 Query Generation
Finetuning Bi-encoders
GenQ Code Walkthrough
Finetuning Bi-encoder Walkthrough
Final Points
Taught by
James Briggs
Related Courses
Semantic Search for AI - Testing Out Qdrant Neural SearchDavid Shapiro ~ AI via YouTube How to Use OpenAI Whisper to Fix YouTube Search
James Briggs via YouTube Spotify's Podcast Search Explained
James Briggs via YouTube Is GPL the Future of Sentence Transformers - Generative Pseudo-Labeling Deep Dive
James Briggs via YouTube Fine-Tune High Performance Sentence Transformers With Multiple Negatives Ranking
James Briggs via YouTube