Intro to AI Transformers
Offered By: Codecademy
Course Description
Overview
Learn about what transformers are (the T of GPT) and how to work with them using Hugging Face libraries
Generative AI tools like ChatGPT are powered by neural networks called transformers. In this course, you will learn how transformers work and use Hugging Face's transformer tools to generate text (with GPT-2) and perform sentiment analysis (with BERT). Along the way, you’ll learn about the history of transformer models and how to address carbon impacts of model training.
* Understand how transformers work
* Use Hugging Face’s Transformers package
* Create pipelines for NLP tasks
* Select the right model for a task
Generative AI tools like ChatGPT are powered by neural networks called transformers. In this course, you will learn how transformers work and use Hugging Face's transformer tools to generate text (with GPT-2) and perform sentiment analysis (with BERT). Along the way, you’ll learn about the history of transformer models and how to address carbon impacts of model training.
* Understand how transformers work
* Use Hugging Face’s Transformers package
* Create pipelines for NLP tasks
* Select the right model for a task
Syllabus
- Transformers: the "T" in GPT: Learn about transformers, the "T" in GPT.
- Lesson: Transformers: The 'T' in GPT
- Quiz: Introduction to Transformers Quiz
- Exploring Transformers with Hugging Face: Apply transformers to text generation and sentiment analysis using Hugging Face's libraries.
- Lesson: Exploring Transformers with Hugging Face
- Quiz: Exploring Transformers Quiz
- Article: Carbon Footprints of Transformer Models
- Project: Exploring Transformers and their Carbon Footprint
- Informational: Next Steps
Taught by
Kenny Lin
Related Courses
Text Mining and AnalyticsUniversity of Illinois at Urbana-Champaign via Coursera Introduction to Natural Language Processing
University of Michigan via Coursera Enabling Technologies for Data Science and Analytics: The Internet of Things
Columbia University via edX Machine Learning Capstone: An Intelligent Application with Deep Learning
University of Washington via Coursera moocTLH: Nuevos retos en las tecnologías del lenguaje humano
Universidad de Alicante via Miríadax