RAG for Code Generation - AI Hacker Cup Example
Offered By: Weights & Biases via YouTube
Course Description
Overview
Dive into the world of LLM-powered competitive programming through an in-depth analysis of Retrieval Augmented Generation (RAG) for code generation agents. Presented at the NeurIPS HackerCup AI Competition (HAC) 2024 lecture series, this 52-minute video explores how RAG enhances agent-based strategies for complex coding challenges. Examine the specific challenges of competitive programming with LLMs and learn about designing RAG architectures for robust code generation. Discover the implementation of AST-based similarity search for rapid code retrieval and the integration of structural and semantic similarity in a multi-stage retrieval process. Explore techniques for enhancing few-shot learning with enriched example programming scenarios and promoting AI self-reflection and iterative improvement. Gain insights into how advanced agentic systems leverage existing problem solutions, employ multi-agent strategies, and apply cutting-edge techniques to push the boundaries of AI agents in competitive programming.
Syllabus
RAG for Code Generation, an AI Hacker Cup example
Taught by
Weights & Biases
Related Courses
Stanford Seminar - Enabling NLP, Machine Learning, and Few-Shot Learning Using Associative ProcessingStanford University via YouTube GUI-Based Few Shot Classification Model Trainer - Demo
James Briggs via YouTube HyperTransformer - Model Generation for Supervised and Semi-Supervised Few-Shot Learning
Yannic Kilcher via YouTube GPT-3 - Language Models Are Few-Shot Learners
Yannic Kilcher via YouTube IMAML- Meta-Learning with Implicit Gradients
Yannic Kilcher via YouTube