YoVDO

[BETA] Finetuning Transformer Models

Offered By: Codecademy

Tags

Transformer Models Courses Machine Learning Courses Sentiment Analysis Courses

Course Description

Overview

Save Big on Coursera Plus. 7,000+ courses at $160 off. Limited Time Only!
Learn the basics of finetuning, GPU use in deep learning, and finetuning with Hugging Face.
Learn the basics of finetuning, GPU use in deep learning, and finetuning with Hugging Face.


* Understanding finetuning

* GPU use in deep learning

* Finetuning with Hugging Face


Syllabus

  • Finetuning Transformer Models: Learn the basics of finetuning transformer models as well as the techniques used to efficiently train large models on consumer hardware (PEFT).
    • Lesson: Finetuning Fundamentals
    • Lesson: Finetuning with LoRA and QLoRA
    • Quiz: Introduction to Finetuning Quiz
  • Finetuning with Hugging Face: Practice finetuning with Hugging Face libraries, performing a full finetune, LoRA, and QLoRA on a BERT sentiment classifier.
    • Lesson: Finetuning Transformers with Hugging Face
    • Quiz: Finetuning Transformers with Hugging Face
    • KanbanProject: Finetuning a Generative Language Model
    • Informational: Next Steps

Taught by

Kenny Lin

Related Courses

Introduction to Artificial Intelligence
Stanford University via Udacity Natural Language Processing
Columbia University via Coursera Probabilistic Graphical Models 1: Representation
Stanford University via Coursera Computer Vision: The Fundamentals
University of California, Berkeley via Coursera Learning from Data (Introductory Machine Learning course)
California Institute of Technology via Independent