Apache Spark 2.4 on Kubernetes example with GKE - cluster mode

Sdílet
Vložit
  • čas přidán 26. 08. 2024
  • Shows running our classic wordcount example on Apache Spark 2.4 on Kubernetes using GKE

Komentáře • 6

  • @StrangerBaba86
    @StrangerBaba86 Před 2 lety +1

    Wonderful... We have spark jobs running on dataproc .. is it really nice to run them on gke ?? Kindly suggest

  • @raxit9879
    @raxit9879 Před 5 lety +1

    Hey Holden ! It’s very cool demo !!😊 I came across your channel while looking for resources on open source contributions!!! I am going through your code reviews on Spark and it’s quite awesome !! I am a graduate student and I am keen to involve in the very same direction and learning a lot from your content !!👍🏻 !! At last just a small curiosity out of the box 😬.... you pretty much use Ubuntu 18.04 for most of your code reviews !! Did you use Budgie UI in Ubuntu here or is it a different os?

    • @HoldenKarau
      @HoldenKarau  Před 5 lety +1

      Raxit this one is a slightly customized variant of Ubuntu from my employer called gLinux. On my desktop I run stock Ubuntu, but they look pretty similar.

  • @fortheknowledge145
    @fortheknowledge145 Před 5 lety

    Hey Holden, nice job with good information. Do we have any video on How to setup kubernetes cluster for Spark? Or anything on kubernetes setup required to run my Spark application. I ve been used to work with yarn, and have little knowledge on kubernetes. Thanks.

  • @jamesbeedy1
    @jamesbeedy1 Před 5 lety +1

    Awesome Demo!

  • @vikramkrishnan6414
    @vikramkrishnan6414 Před 5 lety

    Very nice and informative. Is there a git repo, I could download the code from to play with it myself?