Llama3 8B QLora Fine-Tuning with Chain-of-Thought Dataset
Offered By: The Machine Learning Engineer via YouTube
Course Description
Overview
Discover how to fine-tune a Llama3 8B model using QLora with a Chain-of-Thought (CoT) dataset in this informative 28-minute video tutorial. Learn the step-by-step process of implementing QLora fine-tuning techniques on the Llama3 8B model, specifically focusing on enhancing its performance with CoT reasoning. Access accompanying Jupyter notebooks for Llama3 8B, Llama2 7B, and Mistral 7B models to follow along and apply the concepts demonstrated. Gain valuable insights into machine learning and data science practices while exploring advanced language model fine-tuning techniques.
Syllabus
Llama3 8B QLora Fine Tuning CoT #machinelearning #datascience
Taught by
The Machine Learning Engineer
Related Courses
Fine-Tuning LLM with QLoRA on Single GPU - Training Falcon-7b on ChatBot Support FAQ DatasetVenelin Valkov via YouTube Deploy LLM to Production on Single GPU - REST API for Falcon 7B with QLoRA on Inference Endpoints
Venelin Valkov via YouTube Building an LLM Fine-Tuning Dataset - From Reddit Comments to QLoRA Training
sentdex via YouTube Generative AI: Fine-Tuning LLM Models Crash Course
Krish Naik via YouTube Aligning Open Language Models - Stanford CS25 Lecture
Stanford University via YouTube