YoVDO

LLMOPs: Multimodal Prompting and Inference with Phi-3 Vision 128K Instruct on CPU - ONNX 4-Bit Quantization in C#

Offered By: The Machine Learning Engineer via YouTube

Tags

LLMOps Courses Data Science Courses Machine Learning Courses C# Courses Computer Vision Courses Quantization Courses ONNX Courses Phi-3 Courses

Course Description

Overview

Save Big on Coursera Plus. 7,000+ courses at $160 off. Limited Time Only!
Explore multimodal prompting and inference on CPU using Phi 3 Vision 128K Instruct model quantized to 4 bits in ONNX format with C# in this 23-minute video tutorial. Learn how to implement LLMOPs (Large Language Model Operations) for data science and machine learning applications. Access the accompanying code on GitHub to follow along and practice the demonstrated techniques. Gain insights into optimizing inference for resource-constrained environments and leveraging advanced language models for vision-based tasks.

Syllabus

LLMOPs: Inference en CPU Phi3 Vision 128k Intruct ONNX 4bits in C# #datascience #machinelearning


Taught by

The Machine Learning Engineer

Related Courses

Caffe2: Getting Started
Pluralsight
Despliegue de modelos de IA en IoT Edge con ONNX
Coursera Project Network via Coursera
Flux - The Elegant Machine Learning Library for Julia
The Julia Programming Language via YouTube
How to Convert Almost Any PyTorch Model to ONNX and Serve It Using Flask
Abhishek Thakur via YouTube
Productionizing Machine Learning with Apache Spark, MLflow and ONNX - Cloud Deployment Using SQL Server
Databricks via YouTube