YoVDO

Teacher-Student Architecture for Knowledge Distillation Explained

Offered By: Unify via YouTube

Tags

Artificial Intelligence Courses Machine Learning Courses Deep Learning Courses Neural Networks Courses Transfer Learning Courses Model Optimization Courses Model Compression Courses

Course Description

Overview

Save Big on Coursera Plus. 7,000+ courses at $160 off. Limited Time Only!
Explore the Teacher-Student Architecture for Knowledge Distillation in this comprehensive conference talk. Delve into the research presented by Chengming Hu, focusing on the paper "Teacher-Student Architecture for Knowledge Distillation: A Survey." Examine the application of Teacher-Student architectures in knowledge distillation across various objectives, including knowledge compression, expansion, adaptation, and enhancement. Gain insights into the latest developments in AI research and industry trends, with references to additional resources such as The Deep Dive newsletter and Unify's blog. Learn about the practical implications of this research for AI optimization, large language models, and translation tasks.

Syllabus

Teacher-Student Architecture for Knowledge Distillation Explained


Taught by

Unify

Related Courses

Introduction to Artificial Intelligence
Stanford University via Udacity Probabilistic Graphical Models 1: Representation
Stanford University via Coursera Artificial Intelligence for Robotics
Stanford University via Udacity Computer Vision: The Fundamentals
University of California, Berkeley via Coursera Learning from Data (Introductory Machine Learning course)
California Institute of Technology via Independent