YoVDO

LLMOps: OpenVino Toolkit - Quantizing LLama3.1 8B to 4int and CPU Inference

Offered By: The Machine Learning Engineer via YouTube

Tags

Machine Learning Courses Deep Learning Courses LLaMA (Large Language Model Meta AI) Courses Inference Courses Model Optimization Courses OpenVINO Courses LLMOps Courses

Course Description

Overview

Save Big on Coursera Plus. 7,000+ courses at $160 off. Limited Time Only!
Explore the process of converting a LLAMA3.1 8B model to OpenVino IR format and quantizing it to 4-bit integer precision in this 19-minute video tutorial. Learn how to perform inference on CPU using the quantized model. Access the accompanying notebook on GitHub to follow along with the step-by-step instructions for model conversion, quantization, and inference using the OpenVino Toolkit. Gain practical insights into LLMOps techniques for optimizing large language models for efficient deployment on CPU hardware.

Syllabus

LLMOps: OpenVino Toolkit quantizar 4int LLama3.1 8B e Inferencia CPU #datascience #machinelearning


Taught by

The Machine Learning Engineer

Related Courses

Neural Networks for Machine Learning
University of Toronto via Coursera 機器學習技法 (Machine Learning Techniques)
National Taiwan University via Coursera Machine Learning Capstone: An Intelligent Application with Deep Learning
University of Washington via Coursera Прикладные задачи анализа данных
Moscow Institute of Physics and Technology via Coursera Leading Ambitious Teaching and Learning
Microsoft via edX