Stream vs Batch processing explained with examples

Sdílet
Vložit
  • čas přidán 18. 11. 2021
  • Many people mix up stream and batch processing. Or use stream processing to do a batch job. Here are examples for both which I went through with my students so you know the difference :)
    ►Learn Data Engineering with my Data Engineering Academy:
    learndataengineering.com
    ►LEARN MORE ABOUT DATA ENGINEERING:
    -Check out my free 100+ page data engineering cookbook on GitHub:
    github.com/andkret/Cookbook
    ►PLEASE SUPPORT WHAT YOU LIKE:
    Just use this link whenever you buy something from Amazon:
    www.amazon.com/shop/plumberso...
    (As an Amazon Associate I earn from qualifying purchases from Amazon)
    This is free of charge for you but super helpful for supporting this channel.

Komentáře • 10

  • @KeanNguyenMaldini
    @KeanNguyenMaldini Před 9 měsíci

    thank sir for your explanation

  • @danielmdev
    @danielmdev Před 2 lety +1

    Thanks for taking the time to share your knwoledge

  • @vishalreddy7185
    @vishalreddy7185 Před rokem +2

    Thanks for clear information

  • @fkaziz
    @fkaziz Před 2 lety +4

    Hello Andrea, I have been working as a BI consultant towards reporting and analytics for last 8 years. Now, I want to move into Cloud Data architect position, where I am responsible for client engagement, designing solution, and project delivery. At the same time, I don't want to dive into neck deep development. Can you suggest a best route for me please?

    • @andreaskayy
      @andreaskayy  Před 2 lety +1

      As an architect you need a Brad knowledge of tools platform design and engineering skills. What's your experience there?

  • @0x007A
    @0x007A Před 2 lety +13

    This explanation about message queues in streaming/event-driven versus batch/scheduled processing has been very helpful.