YoVDO

StarCoder - The LLM to Make You a Coding Star

Offered By: Sam Witteveen via YouTube

Tags

LLM (Large Language Model) Courses Text Generation Courses Code Completion Courses

Course Description

Overview

Explore the StarCoder suite of models in this informative video, examining their development through a collaboration between Hugging Face and other contributors. Learn about the base models trained with 15 billion parameters and for a trillion tokens, focusing on open-source code modeling. Discover StarCoder's unique ability to generate continuous code and fill gaps in existing code. Investigate various applications, including a VS code plugin similar to Copilot and a model for detecting personally identifiable information. Delve into different versions like the base model and StarCoder StarChat Alpha, a fine-tuned version for improved text generation. Gain insights into the model's impressive 8,000-token sequence length, comparable to GPT-4's base model. Follow along as the video covers topics such as the StarCoder blog, tech assistant prompts, different model variations, the code completion playground, and running StarChatAlpha locally.

Syllabus

Intro
StarCoder Blog
Tech Assistant Prompt
Different Models
StarCoder Space: Code Completion Playground
StarChatAlpha
Code Time: StarChatAlpha Running Locally


Taught by

Sam Witteveen

Related Courses

Google BARD and ChatGPT AI for Increased Productivity
Udemy
Bringing LLM to the Enterprise - Training From Scratch or Just Fine-Tune With Cerebras-GPT
Prodramp via YouTube
Generative AI and Long-Term Memory for LLMs
James Briggs via YouTube
Extractive Q&A With Haystack and FastAPI in Python
James Briggs via YouTube
OpenAssistant First Models Are Here! - Open-Source ChatGPT
Yannic Kilcher via YouTube