LLMOPs - Inference in CPU with Phi3 4k Instruct ONNX 4-bit Model Using C#
Offered By: The Machine Learning Engineer via YouTube
Course Description
Overview
Explore CPU-based inference using a 4-bit quantized Phi 3 4K Instruct model in ONNX format with C# in this 24-minute video tutorial. Learn how to implement and optimize large language model operations (LLMOPs) for data science and machine learning applications. Gain hands-on experience with the provided code repository, which demonstrates practical implementation techniques for efficient inference on CPU hardware. Discover the potential of leveraging quantized models to enhance performance and reduce computational requirements in natural language processing tasks.
Syllabus
LLMOPs: Inference in CPU Phi3 4k Intruct ONNX 4bits in C# #datascience #machinelearning
Taught by
The Machine Learning Engineer
Related Courses
Introduction to Artificial IntelligenceStanford University via Udacity Natural Language Processing
Columbia University via Coursera Probabilistic Graphical Models 1: Representation
Stanford University via Coursera Computer Vision: The Fundamentals
University of California, Berkeley via Coursera Learning from Data (Introductory Machine Learning course)
California Institute of Technology via Independent