CLAP With Me: Step-by-Step Semantic Search on Audio Sources
Offered By: OpenSource Connections via YouTube
Course Description
Overview
Explore the innovative world of semantic search on audio sources in this 42-minute conference talk from Haystack US 2024. Dive into the concept of CLAP (Contrastive Language–Audio Pre-training), a groundbreaking approach that connects audio and text data in a single multimodal space. Learn how CLAP enables semantic search across audio data, similar to how CLIP works for images and text. Follow along as the speaker builds a small application that generates CLAP vector embeddings from audio files, indexes them to Opensearch, and implements semantic search queries over audio data. Gain insights into the basics of CLAP, its functionality, and its potential applications in enhancing search relevance for text queries on audio sources. Benefit from the speaker's experience as a search engineer and leader in search and personalization engineering, tackling the complex challenge of improving relevance in audio-based searches.
Syllabus
Haystack US 2024 - AJ Wallace: CLAP With Me: Step by Step Semantic Search on Audio Sources
Taught by
OpenSource Connections
Related Courses
Introduction to Digital Sound DesignEmory University via Coursera Foundations of Wavelets and Multirate Digital Signal Processing
Indian Institute of Technology Bombay via Swayam iOS Development for Creative Entrepreneurs
University of California, Irvine via Coursera Deploying TinyML
Harvard University via edX Digital Signal Processing
École Polytechnique Fédérale de Lausanne via Coursera