Lightning Talk: Triton Compiler - Thomas Raoux, OpenAI

Lightning Talk: Triton Compiler - Thomas Raoux, OpenAI
Triton is a language and compiler for writing highly efficient custom deep learning primitives. The aim of Triton is to provide an open-source environment to write fast code with higher productivity than CUDA, but also with greater flexibility than other existing DSLs. Triton has been adopted as a fundamental component of Torch inductor to synthesize efficient kernels targeting GPUs. This has multiple advantages compared to traditional library usage. It allows for the creation of a wide variety of fusions, it can be tuned independently, and it has a smaller memory footprint. This talk will present the Triton compiler and describe the process that enables it to generate lightning-fast kernels with minimal user effort.

[@EricCraw4d]

This is a very helpful presentation. One suggestion for the 2024 conference would be for the speaker to repeat the question before answering, for the benefit of those watching online.