Building Apache NiFi 2.0 Python Processors - Conf42 Python 2024

Explore the world of Apache NiFi 2.0 Python Processors in this conference talk from Conf42 Python 2024. Dive into the latest features of NiFi 2.0.0, focusing on Python processors and their applications in data processing and generative AI. Learn about extracting company names, handling GTFS data, working with web VTT files, and integrating with WatsonX SDK. Discover how to monitor systems, generate synthetic data using Faker, and download Wikipedia pages in various formats. Watch a live demo showcasing these capabilities and gain insights into the future of data processing with Apache NiFi and its integration with generative AI technologies.

intro
preamble
about tim
flank stack weekly by tim spann
future of data - nyc + nj + philly + virtual
generative ai
rapid innovation in the llm space
cloudera generative ai stack
apache nifi and real-time genai
readyflow gallery
cloudera + llms
nifi 2.0.0 features
python processors
extract company names
get compound gtfs data
extract text from web vtt
watsonx sdk to foundation
system / process monitoring
generate synthetic records w/ faker
download a wiki page as html or wikiformat text
get gtfs data
other python processors
demo
thank you