YoVDO

Teacher-Student Architecture for Knowledge Distillation Explained

Offered By: Unify via YouTube

Tags

Artificial Intelligence Courses Machine Learning Courses Deep Learning Courses Neural Networks Courses Transfer Learning Courses Model Optimization Courses Model Compression Courses

Course Description

Overview

Save Big on Coursera Plus. 7,000+ courses at $160 off. Limited Time Only!
Explore the Teacher-Student Architecture for Knowledge Distillation in this comprehensive conference talk. Delve into the research presented by Chengming Hu, focusing on the paper "Teacher-Student Architecture for Knowledge Distillation: A Survey." Examine the application of Teacher-Student architectures in knowledge distillation across various objectives, including knowledge compression, expansion, adaptation, and enhancement. Gain insights into the latest developments in AI research and industry trends, with references to additional resources such as The Deep Dive newsletter and Unify's blog. Learn about the practical implications of this research for AI optimization, large language models, and translation tasks.

Syllabus

Teacher-Student Architecture for Knowledge Distillation Explained


Taught by

Unify

Related Courses

Structuring Machine Learning Projects
DeepLearning.AI via Coursera Natural Language Processing on Google Cloud
Google Cloud via Coursera Introduction to Learning Transfer and Life Long Learning (3L)
University of California, Irvine via Coursera Advanced Deployment Scenarios with TensorFlow
DeepLearning.AI via Coursera Neural Style Transfer with TensorFlow
Coursera Project Network via Coursera