How to Capture 100G Ethernet Traffic at Wire Speed to Local Disk

Explore the challenges and solutions for capturing 100G Ethernet traffic at wire speed to local disk in this conference talk from linux.conf.au 2020. Dive into hardware and software considerations, including special NIC requirements, page cache performance issues, and storage architecture optimizations. Learn about creative solutions to overcome limitations, such as Sub NUMA Clustering setup and BIOS configurations. Discover insights on high-volume data capture, approaches to receiving 100G traffic, and performance testing using the "fio" tool. Gain valuable knowledge for deploying efficient 100G traffic capture systems in various industries and regulatory environments.

How to capture 100G Ethernet traffic at wire speed to local disk
High Volume Data Capture results in Two Problems
Approaches to receive 100G Traffic
Special 100G Hardware Required? The only known NCs that support 100G with bulking are the Melanox NICS
Page cache performance issues
The Storage Architecture 2 Sockets with 384 Gbyte of memory each and a 20 Core processor
Sub NUMA Clustering Setup with 4 Nodes
BIOS issues with SNC SNC spits the Skylake processor into two halves each with their own memory controller and PCle links
Tests were done using the "fio" tool
Single Thread Performance