StarCoder - The LLM to Make You a Coding Star
Offered By: Sam Witteveen via YouTube
Course Description
Overview
Explore the StarCoder suite of models in this informative video, examining their development through a collaboration between Hugging Face and other contributors. Learn about the base models trained with 15 billion parameters and for a trillion tokens, focusing on open-source code modeling. Discover StarCoder's unique ability to generate continuous code and fill gaps in existing code. Investigate various applications, including a VS code plugin similar to Copilot and a model for detecting personally identifiable information. Delve into different versions like the base model and StarCoder StarChat Alpha, a fine-tuned version for improved text generation. Gain insights into the model's impressive 8,000-token sequence length, comparable to GPT-4's base model. Follow along as the video covers topics such as the StarCoder blog, tech assistant prompts, different model variations, the code completion playground, and running StarChatAlpha locally.
Syllabus
Intro
StarCoder Blog
Tech Assistant Prompt
Different Models
StarCoder Space: Code Completion Playground
StarChatAlpha
Code Time: StarChatAlpha Running Locally
Taught by
Sam Witteveen
Related Courses
Intro to Deep Learning with PyTorchFacebook via Udacity Natural Language Processing with Sequence Models
DeepLearning.AI via Coursera Deep Learning
Universidad AnĂ¡huac via edX Create a Superhero Name Generator with TensorFlow
Coursera Project Network via Coursera Natural Language Generation in Python
DataCamp