Why Dolly Is Just the Beginning for Open LLM Models
Offered By: Scala Days Conferences via YouTube
Course Description
Overview
Explore the significance and potential of open Large Language Models (LLMs) in this 25-minute conference talk from Scala Days 2023 Seattle. Begin with a primer on the purpose and importance of LLMs, contextualized by the impact of OpenAI's ChatGPT. Delve into the historical development of increasingly large generalized LLM models. Examine the Dolly project, showcasing how it democratized ChatGPT-like capabilities with open models. Learn about Dolly 2.0, the world's first truly open instruction-tuned LLM, and discover how it was fine-tuned for just $100 using a small 15K dataset. Explore other significant open LLM models like Hugging Face's Open Assistant and Mosaic MPT. Understand the balance between powerful proprietary models like GPT-4 and the advantages of fine-tuning smaller open models on your own data, potentially creating a competitive edge where your data becomes your intellectual property.
Syllabus
Denny Lee - Why Dolly is just the beginning for open LLM models | Scala Days 2023 Seattle
Taught by
Scala Days Conferences
Related Courses
TensorFlow: Working with NLPLinkedIn Learning Introduction to Video Editing - Video Editing Tutorials
Great Learning via YouTube HuggingFace Crash Course - Sentiment Analysis, Model Hub, Fine Tuning
Python Engineer via YouTube GPT3 and Finetuning the Core Objective Functions - A Deep Dive
David Shapiro ~ AI via YouTube How to Build a Q&A AI in Python - Open-Domain Question-Answering
James Briggs via YouTube