Understanding Probabilistic Data Structures with UFO Sightings

Explore the fascinating world of probabilistic data structures through the lens of UFO sightings in this engaging conference talk from NDC Oslo 2023. Dive into the concept of probabilistic data structures, which offer faster and more compact solutions for handling large datasets at the cost of some precision. Learn about common types of these structures, with a particular focus on Bloom Filters, MinHash, and Top-K. Witness a practical demonstration of Top-K in action as it analyzes the most frequently used words in over 112,000 UFO sighting reports. Gain insights into how these powerful tools can be applied to your own projects, potentially uncovering unexpected patterns in large datasets. By the end of this 55-minute presentation, acquire the knowledge needed to begin implementing probabilistic data structures in your applications, whether you're dealing with extraterrestrial encounters or more earthly big data challenges.

Understanding Probabilistic Data Structures with 112,092 UFO Sightings - Guy Royse - NDC Oslo 2023