YoVDO

Train Sentence Transformers by Generating Queries - GenQ

Offered By: James Briggs via YouTube

Tags

Natural Language Processing (NLP) Courses Semantic Search Courses Sentence Transformers Courses

Course Description

Overview

Learn how to train sentence transformers using the GenQ technique for improved dense retrieval in semantic search. Explore the challenges of fine-tuning bi-encoders and discover how GenQ leverages text generation to create synthetic training data. Dive into the process of augmenting passages with synthetic queries, understand asymmetric semantic search, and master T5 query generation. Follow along with a comprehensive code walkthrough for implementing GenQ and fine-tuning bi-encoders. Gain insights into overcoming data scarcity and enhancing retriever performance in this informative video tutorial.

Syllabus

Intro
Why GenQ?
GenQ Overview
Training Data
Asymmetric Semantic Search
T5 Query Generation
Finetuning Bi-encoders
GenQ Code Walkthrough
Finetuning Bi-encoder Walkthrough
Final Points


Taught by

James Briggs

Related Courses

Natural Language Processing
Columbia University via Coursera
Natural Language Processing
Stanford University via Coursera
Introduction to Natural Language Processing
University of Michigan via Coursera
moocTLH: Nuevos retos en las tecnologĂ­as del lenguaje humano
Universidad de Alicante via MirĂ­adax
Natural Language Processing
Indian Institute of Technology, Kharagpur via Swayam