LLMs Fine Tuning and Inferencing Using ONNX Runtime - Workshop
Offered By: Linux Foundation via YouTube
Course Description
Overview
Explore an end-to-end example of fine-tuning and inferencing Large Language Models (LLMs) using ONNX Runtime in this comprehensive workshop. Dive into the process of adapting latest LLMs like LLAMA, Mistral, and Zephyr for real-world applications. Learn how to leverage existing technologies for quick and simple setup. Gain hands-on experience using AzureML with the Azure Container for PyTorch (ACPT) environment, which includes cutting-edge tools like Deepspeed for distributed training and LoRA for efficient fine-tuning. Discover the capabilities of ONNX Runtime as a cross-platform inference and training machine-learning accelerator, understanding its potential for faster execution and portability across frameworks and devices.
Syllabus
Workshop: LLMs Fine Tuning and Inferencing Using ON... Abhishek Jindal, Sunghoon Choi & Kshama Pawar
Taught by
Linux Foundation
Tags
Related Courses
Learning Machine Learning with .NET, PyTorch and the ONNX RuntimeMicrosoft via YouTube Using Apache OpenNLP with OpenSearch K-NN Vector Search
Linux Foundation via YouTube Accelerating High-Performance Machine Learning at Scale in Kubernetes
CNCF [Cloud Native Computing Foundation] via YouTube Real-Time Inference of Neural Networks: A Guide for DSP Engineers
ADC - Audio Developer Conference via YouTube MLOPS: Inferencia ViVIT ONNX Model en Azure ML Managed EndPoint (AKS)
The Machine Learning Engineer via YouTube