LLMOPs - Inference in CPU with Phi3 4k Instruct ONNX 4-bit Model Using C#
Offered By: The Machine Learning Engineer via YouTube
Course Description
Overview
Explore CPU-based inference using a 4-bit quantized Phi 3 4K Instruct model in ONNX format with C# in this 24-minute video tutorial. Learn how to implement and optimize large language model operations (LLMOPs) for data science and machine learning applications. Gain hands-on experience with the provided code repository, which demonstrates practical implementation techniques for efficient inference on CPU hardware. Discover the potential of leveraging quantized models to enhance performance and reduce computational requirements in natural language processing tasks.
Syllabus
LLMOPs: Inference in CPU Phi3 4k Intruct ONNX 4bits in C# #datascience #machinelearning
Taught by
The Machine Learning Engineer
Related Courses
Caffe2: Getting StartedPluralsight Despliegue de modelos de IA en IoT Edge con ONNX
Coursera Project Network via Coursera Flux - The Elegant Machine Learning Library for Julia
The Julia Programming Language via YouTube How to Convert Almost Any PyTorch Model to ONNX and Serve It Using Flask
Abhishek Thakur via YouTube Productionizing Machine Learning with Apache Spark, MLflow and ONNX - Cloud Deployment Using SQL Server
Databricks via YouTube