Adding Generative AI to Real-Time Streaming Pipelines - Conf42 LLMs 2024

Explore how to integrate generative AI into real-time streaming pipelines in this conference talk from Conf42 LLMs 2024. Dive into the rapid innovation occurring in the LLM space and discover enterprise-wide use cases for AI models. Learn about ecosystem partnerships and the Cloudera generative AI stack. Understand how dataflow pipelines can assist with unstructured data processing using NiFi. Examine cloud ML/DL/AI/vector database services and new features in NiFi 2.0.0. Investigate Flink SQL integration with Cloudera machine learning models, Hugging Face, and Google Gemini. Explore real-time generative AI SQL using SSB UDF JS/Java and the potential of Gemma. Gain insights into Python processors and watch a comprehensive demo showcasing the practical application of these concepts in streaming pipelines.

intro
preamble
tim spann
rapid innovation in the llm space
enterprise wide use cases for an llm
which model and when?
ecosystem partnerships
cloudera generative ai stack
cloudera + llm
dataflow pipelines can help
unstructured data with nifi
cloud ml/dl/ai/vector database services
nifi 2.0.0 features
flink sql - cloudera machine learning models
flink sql - nifi - hugging face google gemini
ssb udf js/java + genai = real-time genai sql
gemma
python processors
more articles
demo
thank you