YoVDO

LLMOps: OpenVino Toolkit para Quantizar LLama 3.2 3B a 4int e Inferencia en CPU

Offered By: The Machine Learning Engineer via YouTube

Tags

Machine Learning Courses LLaMA (Large Language Model Meta AI) Courses Quantization Courses Inference Courses Language Models Courses OpenVINO Courses LLMOps Courses

Course Description

Overview

Save Big on Coursera Plus. 7,000+ courses at $160 off. Limited Time Only!
Explore a 32-minute video tutorial on LLMOps, focusing on using the OpenVino Toolkit to quantize the LLAMA3.2 3B model to 4-bit integer format and perform CPU inference. Learn how to convert the LLAMA3.2 3 billion parameter model to OpenVino IR format, apply 4-bit integer quantization, and execute inference on CPU using Chain of Thought (CoT) prompts. Access the accompanying Jupyter notebook for hands-on practice and in-depth understanding of the process. Ideal for data scientists and machine learning enthusiasts looking to optimize large language models for efficient deployment.

Syllabus

LLMOps: OpenVino Toolkit quantizar 4int LLama3.2 3B e Inferencia CPU #datascience #machinelearning


Taught by

The Machine Learning Engineer

Related Courses

Introduction to Artificial Intelligence
Stanford University via Udacity
Natural Language Processing
Columbia University via Coursera
Probabilistic Graphical Models 1: Representation
Stanford University via Coursera
Computer Vision: The Fundamentals
University of California, Berkeley via Coursera
Learning from Data (Introductory Machine Learning course)
California Institute of Technology via Independent