YoVDO

Why Dolly Is Just the Beginning for Open LLM Models

Offered By: Scala Days Conferences via YouTube

Tags

Scala Days Courses ChatGPT Courses Fine-Tuning Courses

Course Description

Overview

Save Big on Coursera Plus. 7,000+ courses at $160 off. Limited Time Only!
Explore the significance and potential of open Large Language Models (LLMs) in this 25-minute conference talk from Scala Days 2023 Seattle. Begin with a primer on the purpose and importance of LLMs, contextualized by the impact of OpenAI's ChatGPT. Delve into the historical development of increasingly large generalized LLM models. Examine the Dolly project, showcasing how it democratized ChatGPT-like capabilities with open models. Learn about Dolly 2.0, the world's first truly open instruction-tuned LLM, and discover how it was fine-tuned for just $100 using a small 15K dataset. Explore other significant open LLM models like Hugging Face's Open Assistant and Mosaic MPT. Understand the balance between powerful proprietary models like GPT-4 and the advantages of fine-tuning smaller open models on your own data, potentially creating a competitive edge where your data becomes your intellectual property.

Syllabus

Denny Lee - Why Dolly is just the beginning for open LLM models | Scala Days 2023 Seattle


Taught by

Scala Days Conferences

Related Courses

ChatGPT et IA : mode d'emploi pour managers et RH
CNAM via France Université Numerique
Generating New Recipes using GPT-2
Coursera Project Network via Coursera
Deep Learning NLP: Training GPT-2 from scratch
Coursera Project Network via Coursera
Data Science A-Z: Hands-On Exercises & ChatGPT Prize [2024]
Udemy
Deep Learning A-Z 2024: Neural Networks, AI & ChatGPT Prize
Udemy