YoVDO

LLMOps: Comparison of OpenVino, ONNX, TensorRT, and PyTorch Inference

Offered By: The Machine Learning Engineer via YouTube

Tags

LLMOps Courses Machine Learning Courses PyTorch Courses Inference Courses OpenVINO Courses TensorRT Courses ONNX Courses

Course Description

Overview

Save Big on Coursera Plus. 7,000+ courses at $160 off. Limited Time Only!
Explore the world of model conversion and inference optimization in this 40-minute video tutorial. Learn how to convert a machine learning model to ONNX, OpenVino, and Tensor-RT formats, and compare their inference performance on both CPU and GPU against native PyTorch inference. Gain practical insights into LLMOps techniques for data science and machine learning applications. Access the accompanying notebook on GitHub to follow along and experiment with the demonstrated concepts.

Syllabus

LLMOps: Comparison Openvino, ONNX, TensorRT and Pytorch Inference #datascience #machinelearning


Taught by

The Machine Learning Engineer

Related Courses

Large Language Models: Application through Production
Databricks via edX
LLMOps - LLM Bootcamp
The Full Stack via YouTube
MLOps: Why DevOps Solutions Fall Short in the Machine Learning World
Linux Foundation via YouTube
Quick Wins Across the Enterprise with Responsible AI
Microsoft via YouTube
End-to-End AI App Development: Prompt Engineering to LLMOps
Microsoft via YouTube