EINNET - Optimizing Tensor Programs with Derivation-Based Transformations

Explore a conference talk from OSDI '23 that introduces EINNET, a novel approach to optimizing tensor programs for deep neural networks. Delve into how EINNET leverages derivation-based transformations and automatically creates new operators to significantly expand the optimization space beyond traditional methods. Learn about the performance improvements achieved by EINNET, outperforming existing tensor program optimizers by up to 2.72x on NVIDIA A100 and 2.68x on NVIDIA V100 GPUs. Discover the potential impact of this research on boosting execution performance of DNNs in real-world applications. Access the publicly available EINNET implementation and gain insights into the future of tensor program optimization for machine learning and artificial intelligence.

OSDI '23 - EINNET: Optimizing Tensor Programs with Derivation-Based Transformations