Exploration with Limited Memory - Streaming Algorithms for Coin Tossing, Noisy Comparisons, and Multi-Armed Bandits
Offered By: Association for Computing Machinery (ACM) via YouTube
Course Description
Overview
Dive into a 24-minute conference talk exploring streaming algorithms for coin tossing, noisy comparisons, and multi-armed bandits with limited memory. Learn about the naive algorithm, median elimination, and sample complexity before delving into the streaming coin tossing problem. Discover how this perspective twist relates to memory limitations and compare it with the naive approach. Explore noisy comparisons and multi-armed bandits, understanding key concepts and notations. Gain insights into budgeting techniques and analyze the GAME-OF-COINS algorithm. Conclude with an overview of the Top-k Coins Algorithm and a comprehensive summary of the presented concepts.
Syllabus
Intro
A Naive Algorithm
Median Elimination (Even-Dar et al., 2002, 2006)
Sample Complexity
A twist on perspective: Memory
Streaming Coin Tossing Problem
Comparison with the Naive Algorithm
Motivating Question
First Attempt: Proof Sketch
Noisy Comparisons and Multi-Armed Bandits
Concepts and Notations
First Idea
Main Idea: Budgeting
Analysis: GAME-OF-COINS
Top-k Coins Algorithm
Conclusion and Summary
Taught by
Association for Computing Machinery (ACM)
Related Courses
Inside TensorFlow - TF-AgentsTensorFlow via YouTube Provably Efficient Reinforcement Learning with Linear Function Approximation - Chi Jin
Institute for Advanced Study via YouTube How Slot Machines Are Advancing the State of the Art in Computer Go AI
Churchill CompSci Talks via YouTube CS885: Multi-Armed Bandits
Pascal Poupart via YouTube Game Theoretic Learning and Spectrum Management - Part 2
IEEE Signal Processing Society via YouTube