Hyper Speed! When Big Data Blooms

Explore the world of big data processing and learn how to handle massive volumes of information at incredible speeds in this NDC London 2023 conference talk. Discover the power of Bloom Filters, an often-overlooked data structure that enables processing of up to 65,000 JSON payloads per second. Delve into topics such as Cross-Site Scripting (XSS), Content Security Policy, and JavaScript control. Gain insights into violation reporting, scaling up data processing, and implementing probabilistic data structures. Examine real-world examples and advanced techniques like Counting Bloom Filters, Cuckoo Filters, Count-Min Sketch, and HyperLogLog. Master the art of efficient data handling and processing to tackle the challenges of big data in modern applications.

Intro
XSS (Cross-Site Scripting)
Content Security Policy
Controlling JavaScript
Control Everything
Knowledge is Power
Violation Reporting
Scale Up
Handling Volume
Bloom Filters to the Rescue!
Hash Functions
Probabilistic Data Structure
Setting up your Bloom Filter
Calculating Values
Calculating w
Real World Examples
Counting Bloom Filter
Cuckoo Filter
Count-Min Sketch
HyperLogLog
The Bloom Filter