Inside ChatGPT- Unveiling the Training Process of OpenAI's Language Model
Offered By: Krish Naik via YouTube
Course Description
Overview
Delve into the intricate training process of OpenAI's language model in this 21-minute video. Explore the three stages of ChatGPT's training: Generative Pretraining, Supervised Fine Tuning, and Reinforcement Learning Through Human Feedbacks. Gain insights into how this large language model learns to generate text, translate languages, create diverse content, and provide informative answers. Discover the massive dataset of text and code used for training and understand how ChatGPT adapts to new information. Follow along with timestamps for each key section, including an introduction and detailed explanations of each training stage.
Syllabus
Introduction
3 stages of training
Generative Pretraining
Supervised Fine Tuning
Reinforcement Learning Through Human Feedbacks
Taught by
Krish Naik
Related Courses
Microsoft Bot Framework and Conversation as a PlatformMicrosoft via edX Unlocking the Power of OpenAI for Startups - Microsoft for Startups
Microsoft via YouTube Improving Customer Experiences with Speech to Text and Text to Speech
Microsoft via YouTube Stanford Seminar - Deep Learning in Speech Recognition
Stanford University via YouTube Select Topics in Python: Natural Language Processing
Codio via Coursera