LLMOPs: Multimodal Prompting and Inference with Phi-3 Vision 128K Instruct on CPU - ONNX 4-Bit Quantization in C#
Offered By: The Machine Learning Engineer via YouTube
Course Description
Overview
Explore multimodal prompting and inference on CPU using Phi 3 Vision 128K Instruct model quantized to 4 bits in ONNX format with C# in this 23-minute video tutorial. Learn how to implement LLMOPs (Large Language Model Operations) for data science and machine learning applications. Access the accompanying code on GitHub to follow along and practice the demonstrated techniques. Gain insights into optimizing inference for resource-constrained environments and leveraging advanced language models for vision-based tasks.
Syllabus
LLMOPs: Inference en CPU Phi3 Vision 128k Intruct ONNX 4bits in C# #datascience #machinelearning
Taught by
The Machine Learning Engineer
Related Courses
Caffe2: Getting StartedPluralsight Despliegue de modelos de IA en IoT Edge con ONNX
Coursera Project Network via Coursera Flux - The Elegant Machine Learning Library for Julia
The Julia Programming Language via YouTube How to Convert Almost Any PyTorch Model to ONNX and Serve It Using Flask
Abhishek Thakur via YouTube Productionizing Machine Learning with Apache Spark, MLflow and ONNX - Cloud Deployment Using SQL Server
Databricks via YouTube