YoVDO

Fine-tuning LLMs with Hugging Face SFT and QLoRA - LLMOps Techniques

Offered By: LLMOps Space via YouTube

Tags

Fine-Tuning Courses Hugging Face Courses Supervised Fine-Tuning Courses LLMOps Courses QLoRA Courses Instruction-Tuning Courses

Course Description

Overview

Save Big on Coursera Plus. 7,000+ courses at $160 off. Limited Time Only!
Explore the intricacies of supervised fine-tuning and instruction tuning for Large Language Models (LLMs) in this comprehensive 54-minute video from LLMOps Space. Delve into specialized fine-tuning techniques for adapting LLMs to niche tasks using labeled data, and learn how to enhance LLM capabilities through instruction tuning. Discover the process of dataset preparation for effective instruction tuning, and gain insights into optimizing memory and speed using the BitsAndBytes library for model quantization. Understand the benefits of the PEFT library from Hugging Face and the role of LoRA in fine-tuning. Explore the functionalities of the TRL (Transformers Reinforcement Learning) library. Watch as Harpreet from Deci AI demonstrates how to fine-tune LLMs using Hugging Face SFT and QLoRA techniques, bridging the gap between model objectives and user-specific requirements.

Syllabus

Fine-tuning LLMs with Hugging Face SFT | QLoRA | LLMOps


Taught by

LLMOps Space

Related Courses

TensorFlow: Working with NLP
LinkedIn Learning
Introduction to Video Editing - Video Editing Tutorials
Great Learning via YouTube
HuggingFace Crash Course - Sentiment Analysis, Model Hub, Fine Tuning
Python Engineer via YouTube
GPT3 and Finetuning the Core Objective Functions - A Deep Dive
David Shapiro ~ AI via YouTube
How to Build a Q&A AI in Python - Open-Domain Question-Answering
James Briggs via YouTube