Singular Learning, Relative Information and the Dual Numbers
Offered By: Institute for Pure & Applied Mathematics (IPAM) via YouTube
Course Description
Overview
Explore a 49-minute lecture on "Singular Learning, Relative Information and the Dual Numbers" presented by Shaowei Lin from the Topos Institute at IPAM's Theory and Practice of Deep Learning Workshop. Delve into the fundamental concept of relative information (Kullback-Leibler divergence) in statistics, machine learning, and information theory. Discover the definition and axiomatic properties of conditional relative information and its applications in machine learning, including Sumio Watanabe's Singular Learning Theory. Examine the rig category Info of random variables and conditional maps, as well as the rig category R(e) of dual numbers. Learn how relative information can be constructed through rig monoidal functors from Info to R(e). Gain insights into potential connections with information cohomology and operad derivations.
Syllabus
Shaowei Lin - Singular Learning, Relative Information and the Dual Numbers - IPAM at UCLA
Taught by
Institute for Pure & Applied Mathematics (IPAM)
Related Courses
Introduction to Algebraic Geometry and Commutative AlgebraIndian Institute of Science Bangalore via Swayam Introduction to Algebraic Geometry and Commutative Algebra
NPTEL via YouTube Basic Algebraic Geometry - Varieties, Morphisms, Local Rings, Function Fields and Nonsingularity
NPTEL via YouTube Basic Algebraic Geometry
NIOS via YouTube Affine and Projective Geometry, and the Problem of Lines
Insights into Mathematics via YouTube