Polars vs Spark - Larger Than Memory Datasets

Sdílet
Vložit
  • čas přidán 26. 08. 2024
  • Polars (Rust based) is faster than Apache Spark on larger than memory dataset. dataengineerin... #rust #polars #python #spark #dataengineering

Komentáře • 4

  • @maksimhajiyev7857
    @maksimhajiyev7857 Před 5 měsíci +1

    No so many people really understood what really happens , this is a great job comparing and doing this R&D , I was playing with RUST for a while and I am sure it is future for AI and cluster processing .

  • @ma34529
    @ma34529 Před 7 měsíci +1

    Good stuff, you earn yourself a subscriber.

  • @mattmartin5136
    @mattmartin5136 Před 5 měsíci +1

    Great explanations here

  • @ixample
    @ixample Před 7 měsíci +1

    Use the best tool for the job, but not too many tools. I like the rifts on your posts.