YoVDO

LLMOPs - Inference in CPU with Phi3 4k Instruct ONNX 4-bit Model Using C#

Offered By: The Machine Learning Engineer via YouTube

Tags

ONNX Courses Data Science Courses Machine Learning Courses C# Courses Quantization Courses Inference Courses LLMOps Courses Phi-3 Courses

Course Description

Overview

Save Big on Coursera Plus. 7,000+ courses at $160 off. Limited Time Only!
Explore CPU-based inference using a 4-bit quantized Phi 3 4K Instruct model in ONNX format with C# in this 24-minute video tutorial. Learn how to implement and optimize large language model operations (LLMOPs) for data science and machine learning applications. Gain hands-on experience with the provided code repository, which demonstrates practical implementation techniques for efficient inference on CPU hardware. Discover the potential of leveraging quantized models to enhance performance and reduce computational requirements in natural language processing tasks.

Syllabus

LLMOPs: Inference in CPU Phi3 4k Intruct ONNX 4bits in C# #datascience #machinelearning


Taught by

The Machine Learning Engineer

Related Courses

Beginning Game Programming with C#
University of Colorado System via Coursera
Programming with C#
Microsoft via edX
DEV206.1x: Introduction to XAML and Application Development
Microsoft via edX
Introduction to Game Development
Michigan State University via Coursera
Designing Advanced Applications using XAML
Microsoft via edX