If Kafka has a UX problem, does UNIX have the answer? (with Luca Pette)
Vložit
- čas přidán 27. 08. 2024
- One of the recurring themes in the big data & data streaming worlds at the moment is developer experience. It seems like every major tool is trying to answer this question: how do we make large-scale data processing feel trivial?
In some places the answer is any library you like as long as it’s Python. In other realms, a mixture of Java and SQL shows promise. But as this week’s guest-Luca Pette-would say, the Unix design metaphor has plenty to give and keep on giving.
So in this episode of Developer Voices we look at TypeStream - his Kotlin project that provides a shell-like interface to data pipelines, and is gradually expanding to make integration pipelines as simple as `cat /dev/kafka | tee /dev/postgres`.
--
Luca on Twitter: / lucapette
Luca on LinkedIn: / lucapette
Kris on Twitter: / krisajenkins
Kris on LinkedIn: / krisjenkins
TypeStream homepage: www.typestream...
TypeStream installation guide: docs.typestrea...
Crafting interpreters: craftinginterp...
…by Bob Nystrom: / munificentbob
NuShell: github.com/nus...
#podcast #apachekafka #bigdata
The largest scale of data I ever deal with is kilobytes of json 😅, but this was still great to learn about!
I'm writing this comment so that in few years, i come here to show that i already knew this would blow up. 👍🏻
Way ahead of you!! Surprisingly good content!!!
very fascinating, congratulations, Luca! I will definitely give it a shot.
Thank you for the talk!
You're welcome! 🙂