Intro to AI Transformers
Offered By: Codecademy
Course Description
Overview
Learn about what transformers are (the T of GPT) and how to work with them using Hugging Face libraries
Generative AI tools like ChatGPT are powered by neural networks called transformers. In this course, you will learn how transformers work and use Hugging Face's transformer tools to generate text (with GPT-2) and perform sentiment analysis (with BERT). Along the way, you’ll learn about the history of transformer models and how to address carbon impacts of model training.
* Understand how transformers work
* Use Hugging Face’s Transformers package
* Create pipelines for NLP tasks
* Select the right model for a task
Generative AI tools like ChatGPT are powered by neural networks called transformers. In this course, you will learn how transformers work and use Hugging Face's transformer tools to generate text (with GPT-2) and perform sentiment analysis (with BERT). Along the way, you’ll learn about the history of transformer models and how to address carbon impacts of model training.
* Understand how transformers work
* Use Hugging Face’s Transformers package
* Create pipelines for NLP tasks
* Select the right model for a task
Syllabus
- Transformers: the "T" in GPT: Learn about transformers, the "T" in GPT.
- Lesson: Transformers: The 'T' in GPT
- Quiz: Introduction to Transformers Quiz
- Exploring Transformers with Hugging Face: Apply transformers to text generation and sentiment analysis using Hugging Face's libraries.
- Lesson: Exploring Transformers with Hugging Face
- Quiz: Exploring Transformers Quiz
- Article: Carbon Footprints of Transformer Models
- Project: Exploring Transformers and their Carbon Footprint
- Informational: Next Steps
Taught by
Kenny Lin
Related Courses
Regression ModelsJohns Hopkins University via Coursera FA19: Statistical Modeling and Regression Analysis
Georgia Institute of Technology via edX Évaluez et améliorez les performances d'un modèle de machine learning
CentraleSupélec via OpenClassrooms Линейная регрессия
Saint Petersburg State University via Coursera Обобщенные линейные модели
Saint Petersburg State University via Coursera