Train Sentence Transformers by Generating Queries - GenQ
Offered By: James Briggs via YouTube
Course Description
Overview
Learn how to train sentence transformers using the GenQ technique for improved dense retrieval in semantic search. Explore the challenges of fine-tuning bi-encoders and discover how GenQ leverages text generation to create synthetic training data. Dive into the process of augmenting passages with synthetic queries, understand asymmetric semantic search, and master T5 query generation. Follow along with a comprehensive code walkthrough for implementing GenQ and fine-tuning bi-encoders. Gain insights into overcoming data scarcity and enhancing retriever performance in this informative video tutorial.
Syllabus
Intro
Why GenQ?
GenQ Overview
Training Data
Asymmetric Semantic Search
T5 Query Generation
Finetuning Bi-encoders
GenQ Code Walkthrough
Finetuning Bi-encoder Walkthrough
Final Points
Taught by
James Briggs
Related Courses
Natural Language ProcessingColumbia University via Coursera Natural Language Processing
Stanford University via Coursera Introduction to Natural Language Processing
University of Michigan via Coursera moocTLH: Nuevos retos en las tecnologĂas del lenguaje humano
Universidad de Alicante via MirĂadax Natural Language Processing
Indian Institute of Technology, Kharagpur via Swayam