YoVDO

LLMOPs - Inference in CPU with Phi3 4k Instruct ONNX 4-bit Model Using C#

Offered By: The Machine Learning Engineer via YouTube

Tags

ONNX Courses Data Science Courses Machine Learning Courses C# Courses Quantization Courses Inference Courses LLMOps Courses Phi-3 Courses

Course Description

Overview

Save Big on Coursera Plus. 7,000+ courses at $160 off. Limited Time Only!
Explore CPU-based inference using a 4-bit quantized Phi 3 4K Instruct model in ONNX format with C# in this 24-minute video tutorial. Learn how to implement and optimize large language model operations (LLMOPs) for data science and machine learning applications. Gain hands-on experience with the provided code repository, which demonstrates practical implementation techniques for efficient inference on CPU hardware. Discover the potential of leveraging quantized models to enhance performance and reduce computational requirements in natural language processing tasks.

Syllabus

LLMOPs: Inference in CPU Phi3 4k Intruct ONNX 4bits in C# #datascience #machinelearning


Taught by

The Machine Learning Engineer

Related Courses

Caffe2: Getting Started
Pluralsight
Despliegue de modelos de IA en IoT Edge con ONNX
Coursera Project Network via Coursera
Flux - The Elegant Machine Learning Library for Julia
The Julia Programming Language via YouTube
How to Convert Almost Any PyTorch Model to ONNX and Serve It Using Flask
Abhishek Thakur via YouTube
Productionizing Machine Learning with Apache Spark, MLflow and ONNX - Cloud Deployment Using SQL Server
Databricks via YouTube