YoVDO

Really Long Context LLMs - 200k Input Tokens

Offered By: Trelis Research via YouTube

Tags

Hugging Face Courses Inference Courses RunPod Courses

Course Description

Overview

Save Big on Coursera Plus. 7,000+ courses at $160 off. Limited Time Only!
Explore the capabilities of long context large language models in this 25-minute video from Trelis Research. Learn about the Yi 34B 200k model, compare different long context models, and understand the differences between base and chat fine-tuned versions. Discover how to perform passkey retrieval tasks using Yi 6B and Claude models. Examine the Yi 34B model's performance with 107k context length. Get hands-on guidance for inferencing Yi models using Runpod, and learn about Yi function-calling models. Access comprehensive resources for long context models and gain valuable insights into the latest advancements in LLM technology.

Syllabus

Really long context length large language models
Video overview
Yi 200k context model
Which long context models are actually good?
Base model vs Chat fine-tuned Yi model
Passkey Retrieval on Yi 6B
Passkey retrieval for Claude
Yi 34B performance at 107k context
Inferencing Yi models with Runpod
Yi Function-calling models
Long Context Model Resources
Video Summary


Taught by

Trelis Research

Related Courses

Epic Web UI DreamBooth Update - New Best Settings - Stable Diffusion Training Compared on RunPods
Software Engineering Courses - SE Courses via YouTube
How to Train Stable Diffusion on Your Photos on a Remote GPU - Using RunPod and Dreambooth
AI Tutorials with Kris Kashtanova via YouTube
Train Stable Diffusion on Your Own Photos - Updated Tutorial
AI Tutorials with Kris Kashtanova via YouTube
ComfyUI Master Tutorial - Stable Diffusion XL - Install on PC, Google Colab and RunPod
Software Engineering Courses - SE Courses via YouTube
Stable Diffusion- Training SDXL 1.0 - Finetune, LoRA, D-Adaptation, Prodigy
kasukanra via YouTube