YoVDO

Teacher-Student Architecture for Knowledge Distillation Explained

Offered By: Unify via YouTube

Tags

Artificial Intelligence Courses Machine Learning Courses Deep Learning Courses Neural Networks Courses Transfer Learning Courses Model Optimization Courses Model Compression Courses

Course Description

Overview

Save Big on Coursera Plus. 7,000+ courses at $160 off. Limited Time Only!
Explore the Teacher-Student Architecture for Knowledge Distillation in this comprehensive conference talk. Delve into the research presented by Chengming Hu, focusing on the paper "Teacher-Student Architecture for Knowledge Distillation: A Survey." Examine the application of Teacher-Student architectures in knowledge distillation across various objectives, including knowledge compression, expansion, adaptation, and enhancement. Gain insights into the latest developments in AI research and industry trends, with references to additional resources such as The Deep Dive newsletter and Unify's blog. Learn about the practical implications of this research for AI optimization, large language models, and translation tasks.

Syllabus

Teacher-Student Architecture for Knowledge Distillation Explained


Taught by

Unify

Related Courses

Neural Networks for Machine Learning
University of Toronto via Coursera Good Brain, Bad Brain: Basics
University of Birmingham via FutureLearn Statistical Learning with R
Stanford University via edX Machine Learning 1—Supervised Learning
Brown University via Udacity Fundamentals of Neuroscience, Part 2: Neurons and Networks
Harvard University via edX