Intro to AI Transformers
Offered By: Codecademy
Course Description
Overview
Save Big on Coursera Plus. 7,000+ courses at $160 off. Limited Time Only!
Learn about what transformers are (the T of GPT) and how to work with them using Hugging Face libraries
Generative AI tools like ChatGPT are powered by neural networks called transformers. In this course, you will learn how transformers work and use Hugging Face's transformer tools to generate text (with GPT-2) and perform sentiment analysis (with BERT). Along the way, you’ll learn about the history of transformer models and how to address carbon impacts of model training.
* Understand how transformers work
* Use Hugging Face’s Transformers package
* Create pipelines for NLP tasks
* Select the right model for a task
Generative AI tools like ChatGPT are powered by neural networks called transformers. In this course, you will learn how transformers work and use Hugging Face's transformer tools to generate text (with GPT-2) and perform sentiment analysis (with BERT). Along the way, you’ll learn about the history of transformer models and how to address carbon impacts of model training.
* Understand how transformers work
* Use Hugging Face’s Transformers package
* Create pipelines for NLP tasks
* Select the right model for a task
Syllabus
- Transformers: the "T" in GPT: Learn about transformers, the "T" in GPT.
- Lesson: Transformers: The 'T' in GPT
- Quiz: Introduction to Transformers Quiz
- Exploring Transformers with Hugging Face: Apply transformers to text generation and sentiment analysis using Hugging Face's libraries.
- Lesson: Exploring Transformers with Hugging Face
- Quiz: Exploring Transformers Quiz
- Article: Carbon Footprints of Transformer Models
- Project: Exploring Transformers and their Carbon Footprint
- Informational: Next Steps
Taught by
Kenny Lin
Related Courses
Models and Platforms for Generative AIIBM via edX Natural Language Processing with Attention Models
DeepLearning.AI via Coursera Circuitos con SPICE: Sistemas trifásicos y análisis avanzado
Pontificia Universidad Católica de Chile via Coursera Linear Circuits
Georgia Institute of Technology via Coursera Open Source LLMOps
Pragmatic AI Labs via edX