YoVDO

Competition-Level Code Generation with AlphaCode - Paper Review

Offered By: Yannic Kilcher via YouTube

Tags

Code Generation Courses Competitive Programming Courses Language Models Courses

Course Description

Overview

Explore a comprehensive review of DeepMind's AlphaCode, an AI system designed to solve competitive programming problems. Delve into the system's architecture, including its use of language models, large-scale sampling, and innovative filtering and clustering techniques. Examine how AlphaCode performs at the level of an average competitor in real programming competitions. Analyze the paper's structure, key components, and fascinating empirical results. Gain insights into the challenges of AI-assisted programming and the potential future implications for software development and problem-solving.

Syllabus

- Intro
- Paper Overview
- An example problem from competitive programming
- AlphaCode system overview
- Filtering out wrong solutions
- Clustering equivalent generated programs
- Model configurations & engineering choices
- Adding privileged information to the input & more tricks
- Experimental Results very interesting!


Taught by

Yannic Kilcher

Related Courses

Microsoft Bot Framework and Conversation as a Platform
Microsoft via edX
Unlocking the Power of OpenAI for Startups - Microsoft for Startups
Microsoft via YouTube
Improving Customer Experiences with Speech to Text and Text to Speech
Microsoft via YouTube
Stanford Seminar - Deep Learning in Speech Recognition
Stanford University via YouTube
Select Topics in Python: Natural Language Processing
Codio via Coursera