If Kafka has a UX problem, does UNIX have the answer? (with Luca Pette)

Sdílet
Vložit
  • čas přidán 27. 08. 2024
  • One of the recurring themes in the big data & data streaming worlds at the moment is developer experience. It seems like every major tool is trying to answer this question: how do we make large-scale data processing feel trivial?
    In some places the answer is any library you like as long as it’s Python. In other realms, a mixture of Java and SQL shows promise. But as this week’s guest-Luca Pette-would say, the Unix design metaphor has plenty to give and keep on giving.
    So in this episode of Developer Voices we look at TypeStream - his Kotlin project that provides a shell-like interface to data pipelines, and is gradually expanding to make integration pipelines as simple as `cat /dev/kafka | tee /dev/postgres`.
    --
    Luca on Twitter: / lucapette
    Luca on LinkedIn: / lucapette
    Kris on Twitter: / krisajenkins
    Kris on LinkedIn: / krisjenkins
    TypeStream homepage: www.typestream...
    TypeStream installation guide: docs.typestrea...
    Crafting interpreters: craftinginterp...
    …by Bob Nystrom: / munificentbob
    NuShell: github.com/nus...
    #podcast #apachekafka #bigdata

Komentáře • 6

  • @towel9245
    @towel9245 Před 8 měsíci +5

    The largest scale of data I ever deal with is kilobytes of json 😅, but this was still great to learn about!

  • @ruggerorebellato
    @ruggerorebellato Před 8 měsíci +11

    I'm writing this comment so that in few years, i come here to show that i already knew this would blow up. 👍🏻

    • @JOHNSMITH-ve3rq
      @JOHNSMITH-ve3rq Před 6 měsíci

      Way ahead of you!! Surprisingly good content!!!

  •  Před 8 měsíci +1

    very fascinating, congratulations, Luca! I will definitely give it a shot.

  • @thenwhoami
    @thenwhoami Před 8 měsíci +2

    Thank you for the talk!