Apache Kafka vs message queue explained

Sdílet
Vložit
  • čas přidán 1. 09. 2022
  • How Apache Kafka compares to a traditional message queue?
    In this video, we will go over key features provided by Apache Kafka and see how it compares with traditional message queue systems.
  • Věda a technologie

Komentáře • 57

  • @relbis-labs
    @relbis-labs  Před 9 měsíci

    Want to see more videos like this? Let us know what topics you are interested in.
    Looking for tailored consultations and mentorship sessions? Reach out to us via email at info@relbis.com.

  • @Perthorn
    @Perthorn Před 10 měsíci +5

    perfect comparison, much better video than dozens I found here on YT, thanks a lot!

  • @tyronefrielinghaus3467
    @tyronefrielinghaus3467 Před 8 měsíci +8

    Please, please, ditch the intrusive music....makes it REALLY HARD to concentrate.

  • @francodagostino2143
    @francodagostino2143 Před 11 měsíci +6

    I think that in the "Kafka consumer limit" it should be mentioned that the limit exists within a consumer group, and you can have multiple consumer groups.

    • @relbis-labs
      @relbis-labs  Před 10 měsíci +1

      Good point! Thank you for the feedback!

  • @dhanraajpatil9990
    @dhanraajpatil9990 Před rokem +79

    Amazing video, Please remove the music.

    • @relbis-labs
      @relbis-labs  Před rokem +1

      Will work on it. Thank you for honest feedback!

    • @TonyBologna999
      @TonyBologna999 Před rokem +1

      Wow, the music is ridiculous. What - am I supposed to get up and dance while learning about message queues?

    • @relbis-labs
      @relbis-labs  Před rokem +10

      Why not? Movement helps learning!

    • @crazychase443
      @crazychase443 Před měsícem +1

      I loved the music!

  • @kalmanjudin1336
    @kalmanjudin1336 Před rokem +1

    This is exactly what I needed! Subscribed for more.💥💥💥

  • @yogeshkurane123
    @yogeshkurane123 Před 11 měsíci

    Thanks for sharing!

  • @yulia0g
    @yulia0g Před rokem

    great video, thank you!!!

  • @kalaimaranmadhavan4182
    @kalaimaranmadhavan4182 Před rokem +1

    The best video which I saw once and understand this concept. Want more videos like this

  • @msieurkris
    @msieurkris Před rokem +2

    Quick and clear, good job !

  • @saralightbourne
    @saralightbourne Před rokem +3

    very nice visualisation, thank you a lot! and unlike other people, i personally like the music, quite soft and inconspicuous~

    • @relbis-labs
      @relbis-labs  Před rokem +1

      Huge thank you for taking your time and sharing your thoughts! I am very happy that you liked the music!

  • @pillibabu1890
    @pillibabu1890 Před rokem

    PLz provide full course Apache Kafka with diagram
    it is awesome

  • @user-zg1mw4id1t
    @user-zg1mw4id1t Před rokem +1

    It's very useful for me, great job!😄

    • @relbis-labs
      @relbis-labs  Před rokem

      Thank you for the feedback! Really appreciate it!

  • @thesadanand6599
    @thesadanand6599 Před rokem +1

    nice... Keep the code simple😊

  • @kiran36992
    @kiran36992 Před 8 měsíci +1

    Even in traditional pub sub, multiple subscribers possible. IBM MQ, AWS SNS ....

  • @ucminhnguyen3356
    @ucminhnguyen3356 Před 5 měsíci

    At second 4:30, why is that after message 2 fails to be received by consumer 2 and then the process is restarted, the message is sent to consumer 1 instead of consumer 2? I thought that each consumer only reads messages from only 1 partition?

    • @relbis-labs
      @relbis-labs  Před 5 měsíci

      In this case, consumer # 2 stops due to an error and does not recover. After that consumer #1 takes over processing of messages.
      Sorry for the confusion.

  • @dhineshs6210
    @dhineshs6210 Před 2 měsíci

    Good explanation

  • @hahachannel7323
    @hahachannel7323 Před 6 měsíci

    very useful

  • @ChrisAthanas
    @ChrisAthanas Před rokem +5

    Music is super annoying please remove during the lesson

  • @sumitbabel5415
    @sumitbabel5415 Před 4 měsíci

    Very nice

  • @KishoreKumar-ur3br
    @KishoreKumar-ur3br Před 7 měsíci +1

    i think the information presented for queue broadcasting is incorrect. Messaging model is either point-to-point or pub-sub. When messaging model is pubsub, we require a message broker inbetween the producer and consumer. The message broker creates copy of the message and it is put into the subscribing MDB(Message Driven Bean). Is it not ?

    • @relbis-labs
      @relbis-labs  Před 7 měsíci +1

      @KishoreKumar-ur3br,
      We appreciate your question! 🤝
      In this video, we are talking about a traditional message queue. Publish-subscribe messaging pattern uses a different approach.
      We understand that many modern message brokers support multiple messaging models/patterns. However, this video is not comparing Apache Kafka with a specific implementation of a message broker. The purpose of this video is to compare Apache Kafka with a traditional message queue.
      You can find the definition of a message queue using the following links:
      - aws.amazon.com/message-queue/#:~:text=A%20message%20queue%20is%20a,once%2C%20by%20a%20single%20consumer.
      - en.wikipedia.org/wiki/Message_queue
      Please feel free to follow up and comment, if something is not clear. 👍

    • @SO-jp6gh
      @SO-jp6gh Před 4 měsíci

      Yes, Kafka vs. MQTT Pub/Sub would be a better comparison. Maybe you could create that video next?

  • @marcgentner1322
    @marcgentner1322 Před 23 dny

    What is a consumer a server or a cache db?

    • @relbis-labs
      @relbis-labs  Před 22 dny

      Consumers are applications that process events.
      See this page for details: kafka.apache.org/documentation/#:~:text=Producers%20are%20those%20client%20applications%20that%20publish%20(write)%20events%20to%20Kafka%2C%20and%20consumers%20are%20those%20that%20subscribe%20to%20(read%20and%20process)%20these%20events

  • @alyeldweny6396
    @alyeldweny6396 Před rokem +2

    Thanks for the video, but It will be nice if you remove the music

    • @relbis-labs
      @relbis-labs  Před rokem

      Thank you for your feedback! Will definitely work on improving the music part.

  • @alphabasic1759
    @alphabasic1759 Před rokem +3

    This is all such nonsense. The major queue products support the same functionality as Kafka. It’s entirely a matter of how you choose to configure them.

  • @francogb
    @francogb Před rokem +2

    Nice work! Please remove the music

  • @alexzhang9318
    @alexzhang9318 Před 5 měsíci +1

    BGM is troubling and distracting.

    • @relbis-labs
      @relbis-labs  Před 5 měsíci

      Appreciate the feedback! Will be fixed in next videos.

  • @ycce17
    @ycce17 Před 3 měsíci

    Background music is too loud and shady

    • @relbis-labs
      @relbis-labs  Před 3 měsíci

      My apologies. New videos will not have this problem!

  • @jenskeckstein1616
    @jenskeckstein1616 Před rokem +3

    Good video .. horrible music 🙊

  • @ievgen6209
    @ievgen6209 Před rokem +2

    imo, these comparisons are wrong

  • @shabi9
    @shabi9 Před rokem +2

    remove the music please

  • @user-zq8bt6hv9k
    @user-zq8bt6hv9k Před rokem +1

    keep your code simple, don't use kafka

    • @relbis-labs
      @relbis-labs  Před rokem

      Why not?

    • @user-zq8bt6hv9k
      @user-zq8bt6hv9k Před rokem +1

      @@relbis-labs there is no reason to use it. We lived without Kafka for decades, we survived. I've used Kafka in the past, even used it for personal projects. Discovered it was a worthless overcomplicated tool.

    • @relbis-labs
      @relbis-labs  Před rokem +1

      A lot of people who use it have a lot of reasons to do so. As in any engineering discipline, we must use the right tool for the job.
      Still really appreciate you sharing your thoughts and your opinion, even if it does not align with our point of view. Having diverse opinions helps everyone to learn and grow.