Copy of Exploring DataFusion + Comet w/Spark (how much work to add 3.5?) - Part 2

Sdílet
Vložit
  • čas přidán 26. 08. 2024
  • Similar to our attempt with Gluten (on going) lets explore how much work adding Spark 3.5 support to DataFusion + Comet would be :)
    Additional context:
    DataFusion is a very interesting rust based library for performing operations on Apache Arrow records and Comet ( github.com/apa... ) aims to extend this to Apache Spark. At first glance it is similar in concept to gluten ( github.com/oap... ) & blaze ( github.com/bla... )
    Previous video:
    • Initial Exploration of...

Komentáře • 2

  • @SebastianDangg
    @SebastianDangg Před 3 měsíci +1

    Yesterday, When searching some docs about Spark Debugging. I saw your presentation On Spark Summit, that was incredible! Now, Im reading your book about High Perf Spark - 15% on it! Very good book. Probably one of the best Spark Developer on the Earth! ❤ Keep it up!

    • @HoldenKarau
      @HoldenKarau  Před 3 měsíci +1

      Oh thank you that's so awesome :)