Best Practices for Multi-Engine Metrics Management Based on Apache Calcite

Explore best practices for multi-engine metrics management based on Apache Calcite in this 53-minute conference talk presented by Xie Jiajun, a Bytedance Senior R&D Engineer and Apache Calcite active committer. Discover the challenges of maintaining numerous indicators in data analysis, including segment reuse, engine-specific SQL, and aperture change synchronization. Learn about Bytedance's innovative solution using Apache Calcite, introducing virtual columns for column-level views and SQL Define Functions for SQL fragment reuse. Understand how these new syntax capabilities effectively reduce indicator management costs, simplify modifications, and improve logical organization of complex data types. Gain insights into typical use cases and implementation principles for streamlining multi-engine metrics management in large-scale data environments.

Best Practices For Multi-Engine Metrics Management Based On Apache Calcite