Temporal Databases for Streaming Architectures

Explore the concept of temporal databases in streaming architectures through this conference talk from Strange Loop. Dive into the development of Crux, an open-source document database with bitemporal graph queries. Learn how Crux was conceived from real-world consulting experiences in global system integrations and financial services projects. Discover the overarching goals of Crux as an "unbundled," pluggable, and layered database with bitemporal ACID transactions. Understand the importance of bitemporality in separating transaction time from valid time, and its role in maintaining consistent temporal views of data in streaming architectures. Examine the design choices made to support a Datalog query engine on top of Key/Value stores, the use of semi-immutable log storage, clustering with Kafka, and the implementation of Clojure for creating a layered and extensible system. Gain insights into future directions and plans for collaboration with the open-source community. Presented by Jeremy Taylor and Jon Pither from JUXT LTD, this 35-minute talk covers topics such as streaming architectures, Kafka, logs, temporality, transaction time, valid time, temporal modeling, stream processing tools, and various database operations.

Introduction
Overview
Streaming Architectures
Kafka
Logs
Temporality
Transaction Time
Valid Time
Temporal Modeling
Main Question
Stream Processing Tools
Window Limitations
Unbundled Approach
Case Study
Long Story Short
Why We Chose CLIP
Key Operations
Transaction Logs
CLI Exodus
Screenshot
New Console
Database View
Transaction ID
Table View
Document Attributes
Ticket Prices
Ballot Time History
Streaming Queries
PointinTime Queries
Unsession