Towards Monosemanticity: Decomposing Language Models with Dictionary Learning
Offered By: Unify via YouTube
Course Description
Overview
Explore a comprehensive presentation on "Towards Monosemanticity: Decomposing Language Models With Dictionary Learning" from Anthropic's research team. Delve into the concept of polysemanticity in neural networks and learn how sparse autoencoders can extract more interpretable, monosemantic features. Discover how this approach enhances understanding of language model behavior compared to analyzing original polysemantic neurons. Gain insights into the latest advancements in AI research, including techniques for improving model interpretability and reasoning. Connect with additional resources such as The Deep Dive newsletter and Unify's blog for further exploration of AI deployment and industry trends. Engage with the AI community through various social media platforms and join discussions on cutting-edge developments in machine learning, deep learning, and natural language processing.
Syllabus
Towards Monosemanticity Explained
Taught by
Unify
Related Courses
Microsoft Bot Framework and Conversation as a PlatformMicrosoft via edX Unlocking the Power of OpenAI for Startups - Microsoft for Startups
Microsoft via YouTube Improving Customer Experiences with Speech to Text and Text to Speech
Microsoft via YouTube Stanford Seminar - Deep Learning in Speech Recognition
Stanford University via YouTube Select Topics in Python: Natural Language Processing
Codio via Coursera