Copy of Exploring DataFusion + Comet w/Spark (how much work to add 3.5?) - Part 2
Vložit
- čas přidán 26. 08. 2024
- Similar to our attempt with Gluten (on going) lets explore how much work adding Spark 3.5 support to DataFusion + Comet would be :)
Additional context:
DataFusion is a very interesting rust based library for performing operations on Apache Arrow records and Comet ( github.com/apa... ) aims to extend this to Apache Spark. At first glance it is similar in concept to gluten ( github.com/oap... ) & blaze ( github.com/bla... )
Previous video:
• Initial Exploration of...
Yesterday, When searching some docs about Spark Debugging. I saw your presentation On Spark Summit, that was incredible! Now, Im reading your book about High Perf Spark - 15% on it! Very good book. Probably one of the best Spark Developer on the Earth! ❤ Keep it up!
Oh thank you that's so awesome :)