YoVDO

[BETA] Finetuning Transformer Models

Offered By: Codecademy

Tags

Transformer Models Courses Machine Learning Courses Sentiment Analysis Courses

Course Description

Overview

Save Big on Coursera Plus. 7,000+ courses at $160 off. Limited Time Only!
Learn the basics of finetuning, GPU use in deep learning, and finetuning with Hugging Face.
Learn the basics of finetuning, GPU use in deep learning, and finetuning with Hugging Face.


* Understanding finetuning

* GPU use in deep learning

* Finetuning with Hugging Face


Syllabus

  • Finetuning Transformer Models: Learn the basics of finetuning transformer models as well as the techniques used to efficiently train large models on consumer hardware (PEFT).
    • Lesson: Finetuning Fundamentals
    • Lesson: Finetuning with LoRA and QLoRA
    • Quiz: Introduction to Finetuning Quiz
  • Finetuning with Hugging Face: Practice finetuning with Hugging Face libraries, performing a full finetune, LoRA, and QLoRA on a BERT sentiment classifier.
    • Lesson: Finetuning Transformers with Hugging Face
    • Quiz: Finetuning Transformers with Hugging Face
    • KanbanProject: Finetuning a Generative Language Model
    • Informational: Next Steps

Taught by

Kenny Lin

Related Courses

Text Mining and Analytics
University of Illinois at Urbana-Champaign via Coursera Introduction to Natural Language Processing
University of Michigan via Coursera Enabling Technologies for Data Science and Analytics: The Internet of Things
Columbia University via edX Machine Learning Capstone: An Intelligent Application with Deep Learning
University of Washington via Coursera moocTLH: Nuevos retos en las tecnologías del lenguaje humano
Universidad de Alicante via Miríadax