YoVDO

[BETA] Finetuning Transformer Models

Offered By: Codecademy

Tags

Transformer Models Courses Machine Learning Courses Sentiment Analysis Courses

Course Description

Overview

Save Big on Coursera Plus. 7,000+ courses at $160 off. Limited Time Only!
Learn the basics of finetuning, GPU use in deep learning, and finetuning with Hugging Face.
Learn the basics of finetuning, GPU use in deep learning, and finetuning with Hugging Face.


* Understanding finetuning

* GPU use in deep learning

* Finetuning with Hugging Face


Syllabus

  • Finetuning Transformer Models: Learn the basics of finetuning transformer models as well as the techniques used to efficiently train large models on consumer hardware (PEFT).
    • Lesson: Finetuning Fundamentals
    • Lesson: Finetuning with LoRA and QLoRA
    • Quiz: Introduction to Finetuning Quiz
  • Finetuning with Hugging Face: Practice finetuning with Hugging Face libraries, performing a full finetune, LoRA, and QLoRA on a BERT sentiment classifier.
    • Lesson: Finetuning Transformers with Hugging Face
    • Quiz: Finetuning Transformers with Hugging Face
    • KanbanProject: Finetuning a Generative Language Model
    • Informational: Next Steps

Taught by

Kenny Lin

Related Courses

Generative Pre-trained Transformers (GPT)
University of Glasgow via Coursera
Transformer Models and BERT Model - Deutsch
Google Cloud via Coursera
LinkedIn AI Academy AI-100: 2 Supervised Learning with Neural Networks
LinkedIn Learning
Sequence Models
DeepLearning.AI via Coursera
Introduction to Large Language Models for Data Practitioners
Pluralsight