Intro to AI Transformers
Offered By: Codecademy
Course Description
Overview
Learn about what transformers are (the T of GPT) and how to work with them using Hugging Face libraries
Generative AI tools like ChatGPT are powered by neural networks called transformers. In this course, you will learn how transformers work and use Hugging Face's transformer tools to generate text (with GPT-2) and perform sentiment analysis (with BERT). Along the way, you’ll learn about the history of transformer models and how to address carbon impacts of model training.
* Understand how transformers work
* Use Hugging Face’s Transformers package
* Create pipelines for NLP tasks
* Select the right model for a task
Generative AI tools like ChatGPT are powered by neural networks called transformers. In this course, you will learn how transformers work and use Hugging Face's transformer tools to generate text (with GPT-2) and perform sentiment analysis (with BERT). Along the way, you’ll learn about the history of transformer models and how to address carbon impacts of model training.
* Understand how transformers work
* Use Hugging Face’s Transformers package
* Create pipelines for NLP tasks
* Select the right model for a task
Syllabus
- Transformers: the "T" in GPT: Learn about transformers, the "T" in GPT.
- Lesson: Transformers: The 'T' in GPT
- Quiz: Introduction to Transformers Quiz
- Exploring Transformers with Hugging Face: Apply transformers to text generation and sentiment analysis using Hugging Face's libraries.
- Lesson: Exploring Transformers with Hugging Face
- Quiz: Exploring Transformers Quiz
- Article: Carbon Footprints of Transformer Models
- Project: Exploring Transformers and their Carbon Footprint
- Informational: Next Steps
Taught by
Kenny Lin
Related Courses
Intro to Deep Learning with PyTorchFacebook via Udacity Natural Language Processing with Sequence Models
DeepLearning.AI via Coursera Deep Learning
Universidad Anáhuac via edX Create a Superhero Name Generator with TensorFlow
Coursera Project Network via Coursera Natural Language Generation in Python
DataCamp