Refactor First
Refactor First
  • 68
  • 323 375
Kafka Streams - Aggregate, Transform & Join With Windowing In 20 MINS | Spring Cloud Stream
In this video will look into how we can do Aggregation, Transformation and Joining using Spring Cloud Stream Kafka Streams
We will look into right from producing the message to a Kafka topic, then aggregating a Kafka stream, transforming it, and then finally joining two Kafka Streams.
You can always read about this in the article here: refactorfirst.com/spring-cloud-kafka-streams-aggregate-join-windowing
You can support me by buying me a coffee : www.buymeacoffee.com/amrutprabhu
-----------------
Gear I use :
-----------------
Sony Alpha a6000 : Amazon India : amzn.to/3RM7QMJ
Germany : amzn.to/3G1Iw24
US : amzn.to/3cpKZ9E
UK : amzn.to/3J0g5Ry
Razer Microphone : Amazon India : amzn.to/3aQxI9C
Germany : amzn.to/3DRRrAh
US : amzn.to/3ITKu3Q
UK : amzn.to/3v3RHbU
---- Chapters ---------
00:00 - Introduction
00:27 - Creating Spring Cloud Streams Kafka Project
01:22 - Kafka Stream Dependencies
01:38 - Kafka Streams Pipeline Example Overview
03:06 - Sending Message to Kafka Topic (Kafka Producer)
04:14 - Kafka Producer Properties
05:21 - Viewing Messages In The First Kafka Topic
06:10 - Kstream or Kafka Stream Transformation
06:58 - Spring Cloud Kafka Stream Properties
07:35 - Kafka Streams Serializer and Deserializer
09:14 - Viewing Kstream or Kafka Streams Transformation Output
10:02 - KStreams Or Kafka Streams Aggregation
12:41 - Spring Cloud Kafka Stream Aggregator Properties
14:06 - Viewing Kafka Stream Aggregation Output in Kafka Topic
15:47 - Kstream Or Kafka Stream Join Operation
17:30 - Spring Cloud Kafka Stream Joining Properties
18:44 - Custom Serializer Deserializer
19:40 - Viewing Kafka Stream Joining Output in Kafka Topic
21:06 - Conclusion
Music Credits:-
Sappheiros - Rain
----------------------------
Social Media
CZcams czcams.com/users/sappheiros
Spotify goo.gl/hE9MDJ
Twitter SappheirosMusic
Instagram sappheirosmusic
Facebook SappheirosMusic
Discord discord.gg/Pk87yN9
soundcloud.com/sappheirosmusic/rain1
--------------------------------------------------
zhlédnutí: 2 691

Video

How To Use Redis and Redis Insight With A Spring Boot Application
zhlédnutí 1,5KPřed rokem
In this video, we will look at how you can use Redis inside a Spring Boot application. We will be making use of Redis Stack and explore its search and indexing capabilities. We will also look at the a browser client called Redis Insight to explore the contents of Redis. Finally we will also look into how we can store JSON documents inside Redis and search based on the JSON fields. You can also ...
How I Communicate with S3 Bucket In A Spring Boot Application Using Spring Cloud AWS S3
zhlédnutí 4KPřed rokem
In this video we will look into how we can communicate with an AWS S3 bucket using Spring Cloud AWS S3. We will explore the various dependencies required and also look at the entire setup and code walkthrough. We will also write an integration test with Testcontainers and LocalStack. You can also read about this along with the GitHub link to the code: refactorfirst.com/spring-cloud-aws-s3-local...
How To Do Distributed Tracing With Opentelemetry in Spring Boot
zhlédnutí 9KPřed rokem
In this video we will look into how we can capture distributed traces that are generated as part of communication between service. We will use Opentelemetry standards to export the traces from a Spring boot Application and the visualize the traces on a Jaeger dashboard. We will start the Jaeger dashboard using the docker image using docker compose. You can also read about this along with the Gi...
How to Connect Spring Boot 3 With MongoDB
zhlédnutí 1,1KPřed rokem
In this video, we will will look into how we can communicate with MongoDB using Spring Boot 3. We will start our own MongoDB instance using docker compose and then save and retrieve data from MongoDB. We will also explore how to use ProblemDetails Object to report errors from an API. You can also read about this along with the GitHub link to the code: refactorfirst.com/spring-boot-with-mongodb-...
How FIDO2 Passwordless Authentication Works With Keycloak
zhlédnutí 4,1KPřed rokem
In this video we will look into how we can do passwordless login using the FIDO2 WebAuthn passwordless authentication. We will explore how you can use your laptop to authenticate yourself to any website that provides FIDO2 authentication. We will then look at how you can do the same using your mobile device. You can also read about this along with the GitHub link to the code: refactorfirst.com/...
How To Use AWS Lambda Snap Start With Spring Cloud Function and Terraform
zhlédnutí 582Před rokem
In this video we will look into how we can run an AWS Lambda with Spring Boot and Spring cloud Functions. We will create a Lambda and API gateway using terraform and then check the performance of a Spring Boot Application by enabling Snap Start option on the Lambda function. You can also read about this along with the GitHub link to the code: refactorfirst.com/kick-start-spring-boot-application...
How To Add Network Problems with Toxiproxy
zhlédnutí 973Před rokem
In this video we will look into how we can introduce some network problems to see how our application would react to it. We would add a latency in the connection and then a timeout to simulate network problems scenarios. You can support my content via : www.buymeacoffee.com/amrutprabhu You can also read about this along with the GitHub link to the code: refactorfirst.com/create-network-problems...
How to Deploy An Application With Skaffold
zhlédnutí 728Před rokem
In this video we will look at how you can use Skaffold to deploy a Spring Boot Application on a Kubernetes cluster. We will build our docker image with JIB plugin and use a Helm chart to deploy our application on to a Kubernetes cluster. You can also read about this along with the GitHub link to the code: refactorfirst.com/deploy-application-on-kubernetes-with-skaffold-helm-jib You can support ...
How To Implement GraphQL Query & Mutation in a Spring Boot Application
zhlédnutí 1,3KPřed rokem
In this video we will look into implementing GraphQL query and mutation operations in a Spring Boot application. We will first define a Query, implement it and then execute the queries. Finally we will create an Integration test for the entire setup. You can also read about this along with the GitHub link to the code: refactorfirst.com/spring-boot-with-graphql Spring Boot Application Testing Ma...
How to Fetch Secrets from AWS Secrets Manager in a Spring Boot Application
zhlédnutí 6KPřed rokem
In this video we will look into working with AWS Secrets Manager in a Spring Boot application. You will get to learn the following: - How to pull database credentials from AWS Secrets Manager in a Spring Boot Application. - How to use LocalStack with Spring Boot Application. - How to write integration test using Testcontainers for LocalStack and MySQL. You can also read about this along with th...
How To Remote Debug Java Application In A Kubernetes Pod With IntelliJ Or VSCode
zhlédnutí 6KPřed rokem
In this video we will look into how we can debug a Java application running in a Kubernetes Cluster using IntelliJ Idea or VSCode ( Visual Studio Code). You can also read about this along with the GitHub link to the code: refactorfirst.com/how-to-remote-debug-java-application-on-kubernetes You can support me by buying me a coffee : www.buymeacoffee.com/amrutprabhu Gear I use : Sony Alpha a6000 ...
How to Use DynamoDB In A Spring Boot Application
zhlédnutí 3,9KPřed rokem
In this video we will look into how we can communicate with a DynamoDB instance using a Spring Boot application. We will looking into defining a Primary Composite Key and then query the data using either the primary key or the partition key. You can also read about this along with the GitHub link to the code: refactorfirst.com/using-dynamodb-with-spring-boot You can support me by buying me a co...
How to Send Push Notifications with Spring Boot Using Websockets and STOMP
zhlédnutí 39KPřed rokem
In this video we will be looking at how we can send a push notification to a client using spring boot application. We make use of WebSockets and STOMP protocol to send notifications to with all the clients or to specific client. You can also read about this along with the GitHub link to the code: refactorfirst.com/spring-boot-websockets-stomp-notifications You can support me by buying me a coff...
How to Fix Keycloak Logout Issue With Spring Cloud Gateway - Part 3
zhlédnutí 2,9KPřed rokem
In this video we will be looking at how we solve the Keycloak logout issue with Spring Cloud Gateway Application. We will be using OAuth2 OpenId Connect (OIDC) mechanism to authenticate the user and then trigger a logout to log out the user the from the spring session as well as the Keycloak session. How To Integrate Keycloak With Spring Cloud Gateway : czcams.com/video/TrASdBQu2_k/video.html H...
How To Create Kubernetes Controller Using Spring Boot
zhlédnutí 3,4KPřed 2 lety
How To Create Kubernetes Controller Using Spring Boot
How to Create a Kubernetes Custom Resource Definition (CRD) - Part 1
zhlédnutí 7KPřed 2 lety
How to Create a Kubernetes Custom Resource Definition (CRD) - Part 1
3 Ways to Build Docker Images For Spring Boot Application
zhlédnutí 2,8KPřed 2 lety
3 Ways to Build Docker Images For Spring Boot Application
How to Monitor Spring Boot Application With Prometheus and Grafana
zhlédnutí 18KPřed 2 lety
How to Monitor Spring Boot Application With Prometheus and Grafana
How To Create CryptoCurrency With Smart Contract
zhlédnutí 192Před 2 lety
How To Create CryptoCurrency With Smart Contract
How To Use Spring Cloud Stream With Kakfa
zhlédnutí 5KPřed 2 lety
How To Use Spring Cloud Stream With Kakfa
How to Connect Kafka With Spring Boot
zhlédnutí 1,6KPřed 2 lety
How to Connect Kafka With Spring Boot
How To Integrate Circuit Breaker And Retry In A Spring Boot Application Using Resilience4J
zhlédnutí 9KPřed 2 lety
How To Integrate Circuit Breaker And Retry In A Spring Boot Application Using Resilience4J
How to Integrate Spring Cache With Ehcache 3 In A Spring Boot Application
zhlédnutí 9KPřed 2 lety
How to Integrate Spring Cache With Ehcache 3 In A Spring Boot Application
How To Externalize Configuration With Spring Cloud Config Server
zhlédnutí 3,6KPřed 2 lety
How To Externalize Configuration With Spring Cloud Config Server
How To Integrate Jaeger Distributed Tracing With Spring Boot
zhlédnutí 6KPřed 2 lety
How To Integrate Jaeger Distributed Tracing With Spring Boot
How To Integrate Keycloak RBAC With Spring Gateway And Resource Server - Part 2
zhlédnutí 7KPřed 2 lety
How To Integrate Keycloak RBAC With Spring Gateway And Resource Server - Part 2
How To Integrate Keycloak With Spring Cloud Gateway - Part 1
zhlédnutí 16KPřed 2 lety
How To Integrate Keycloak With Spring Cloud Gateway - Part 1
How To Do Distributed Tracing With Spring Cloud Sleuth In Spring Boot
zhlédnutí 1,7KPřed 2 lety
How To Do Distributed Tracing With Spring Cloud Sleuth In Spring Boot
How To Use Micronaut Framework In Java? JPA Example With MySQL.
zhlédnutí 3,1KPřed 2 lety
How To Use Micronaut Framework In Java? JPA Example With MySQL.

Komentáře

  • @hamedhatami4831
    @hamedhatami4831 Před 6 dny

    How inconvenient is on Spring as compared to Quarkus OpenTelemtry enablement!

  • @AbhishekKumar-rr8ov
    @AbhishekKumar-rr8ov Před 23 dny

    Refactor First - This is working fine if microservices is communicating each other with Rest API , but if microservices is communicating via GRPC its not working. Please suggest. Thanks in advance.

  • @victorwanderley52
    @victorwanderley52 Před 29 dny

    Great video. Thank you so much!

  • @ashoks609
    @ashoks609 Před měsícem

    Hi I have question B3 header with custom traceid-spanid generated and sent from UI is not overriding auto generated one. Is there way to do that ? Thanks

  • @dishijain
    @dishijain Před měsícem

    Thanks worked very well with IntelliJ + GCP cluster deployment.

  • @dautofreitas8318
    @dautofreitas8318 Před měsícem

    Thank you, excellent video.

  • @user-yf8jf3fo2x
    @user-yf8jf3fo2x Před měsícem

    i am loosing traceId between 2 services with this way, context not propоgated ( i use feign)

  • @cooltechie2193
    @cooltechie2193 Před měsícem

    Can u guide me how to monitor rmq using prometheus and grafana

  • @HimanshuSharma-bq8oo
    @HimanshuSharma-bq8oo Před měsícem

    It is not working for me. I am using Spring version 2.3.1.RELEASE and Java version 1.8 Application is starting but AWSSecretManager classes are not loading. Please help.

  • @josvanoorschot6072
    @josvanoorschot6072 Před měsícem

    Excellent job!

  • @saidmzee4107
    @saidmzee4107 Před 2 měsíci

    hello how can I make prometheus to not include its requests on the total number of requests made to the application, to only scrape the requests that have hit the application endpoints and not /actuator/prometheus

  • @GautamKumar-dg8qc
    @GautamKumar-dg8qc Před 2 měsíci

    Thanks for this good content. I have one doubt, suppose in your case each retry is making 3 calls to the server, but this 3 is counted 1 as one for the circuitbreaker, what if I wanted to count the retries also in the circuitbreaker. means one call = 3 retries = 3 failurecall in circuitbreaker.

  • @user-qz1cz5xy5r
    @user-qz1cz5xy5r Před 2 měsíci

    Nice work thanks keep up

  • @reynaldiichsanrahmawan724
    @reynaldiichsanrahmawan724 Před 3 měsíci

    Can I test it on postman? If so, how?

  • @francoisgs1
    @francoisgs1 Před 3 měsíci

    Hi my new mic has a TRRS jack (3 black lines) but can see the sound is received by mic but cant hear from my mac? any suggestions? thanks

  • @elmahdiaitlmahfoud2309
    @elmahdiaitlmahfoud2309 Před 3 měsíci

    hello sir, why the producer is publishing messages every 1second in "first-topic"

  • @muppedaanvesh
    @muppedaanvesh Před 3 měsíci

    Clear explanation, thank you! 👏🏻

  • @PrajwalM-ex8uc
    @PrajwalM-ex8uc Před 3 měsíci

    Very Nice video, I have a question, is it possible to display the spring boot application's logs as well in the jaeger UI? How can we achieve it?

  • @francisco.amorim
    @francisco.amorim Před 3 měsíci

    Does the second port support an egpu?

  • @user-zn8dm8cp5t
    @user-zn8dm8cp5t Před 4 měsíci

    what if there is no authentication required or if the authentication is handled in the gateway?

  • @sequ3nce515
    @sequ3nce515 Před 4 měsíci

    Привет) Хорошее видео, спасибо. Посмотрел ещё парочку других. Специально оставил комментарий на русском, чтобы было понятно насколько разнородная может быть аудитория :)

  • @dimiro1
    @dimiro1 Před 4 měsíci

    I found this particular video useful

  • @Abhay.Bhandari
    @Abhay.Bhandari Před 4 měsíci

    I have followed same steps but in my case generatePerson method is called again and again. Result is not getting stored in cache probably. Even there is no error in console. Why? What are the possibilities for where I am doing wrong?

  • @joaopaulodasilvajpaulosi1304

    I keep getting the following error Failed to publish metrics. Server responded with HTTP status code 404 and body 404 page not found

  • @lighninggamerz6571
    @lighninggamerz6571 Před 4 měsíci

    One thing I would like to know is using aws-secretsmanager-jdbc library if the application is using old password and now if secrets rotation happens how application works without restarting it ? I mean how application establishes the connection with new password without restarting ?

  • @phanhuudong1607
    @phanhuudong1607 Před 4 měsíci

    Can kafka push notifcation to moblie ? How to do that ?

  • @larsfischer2679
    @larsfischer2679 Před 4 měsíci

    Very useful demonstration, also works with Keycloak 24.

  • @DanielS.-km8gf
    @DanielS.-km8gf Před 4 měsíci

    That was awesome!

  • @Demon_KD
    @Demon_KD Před 5 měsíci

    Can you please suggest any udemy course to learn this kstreams, joins, ktables.

  • @sharadawasthi3258
    @sharadawasthi3258 Před 5 měsíci

    Excellent explanation - easy to learn!

  • @soumyagarg3735
    @soumyagarg3735 Před 5 měsíci

    What should be the hostname in the case where my application is deployed on kubernetes pod on gcp as clusterIp type of Instance such that it does not have a external ip address.

  • @tomjosi742
    @tomjosi742 Před 5 měsíci

    took me a while to figure about the docker thing. after doing little research though i was able to figure it out. great video keep it up .

  • @pankajbohra8637
    @pankajbohra8637 Před 5 měsíci

    How test using postman

  • @sumansaurabh6501
    @sumansaurabh6501 Před 5 měsíci

    Getting different traceId in both my application.

  • @eduardoholzmann853
    @eduardoholzmann853 Před 5 měsíci

    have some reference for use it with postman API? i need implement this with Flutter

  • @buntykumar7270
    @buntykumar7270 Před 5 měsíci

    Very informative video

  • @girishanker3796
    @girishanker3796 Před 6 měsíci

    Great video

  • @BasitSeyl3r
    @BasitSeyl3r Před 6 měsíci

    how test user can answer private message?

  • @pranavmahajan4190
    @pranavmahajan4190 Před 6 měsíci

    Mitra ekadam mast tutorial aahe. Thanks

  • @tejeswarsahu5578
    @tejeswarsahu5578 Před 6 měsíci

    Is there a way to connect with u via email if possible... just wanted to take some suggestions about these kind of video recordings.. Thanks for all these knowledge

  • @BeingDeveloperWithAB
    @BeingDeveloperWithAB Před 6 měsíci

    Will this work in stateless rest API and separate UI client

  • @JohnWindberg
    @JohnWindberg Před 6 měsíci

    How about configuring log exporting to the otel-collector? I'm not having any luck getting that working.

  • @dotherap
    @dotherap Před 6 měsíci

    Man, with all due respect, you have to go easy on the word 'particular'. Otherwise great video!

  • @himanshumahajan2405
    @himanshumahajan2405 Před 6 měsíci

    Hi Nice video. I have some doubts - 1. Can we do batch processing with KafkaStreams in Spring Cloud Stream ? 2. Is it possible to read and write to topics with different broker address ? 3. For scalable systems, does it support multithreading ? Because I tried consumer: concurrency property, doesn't seem to work.

  • @AadhithyanA
    @AadhithyanA Před 6 měsíci

    In this tutorial, user is manually registering at the user side, OK that's fine. Here I had a issue that when the user is created by "ADMIN" and that user is supposed to login, it tells like "invalid username or password"!!!. please help me to solve!!. Thanks in advance.

  • @Arjun-tg1go
    @Arjun-tg1go Před 6 měsíci

    You have covered wide range of topics in your channel.. kudos to you! 👍🏼 One suggestion if I may, use some graphic for the topic you are covering at the beginning so that it lays the foundation and then you can get into the code.

  • @nenuanenenuane6645
    @nenuanenenuane6645 Před 7 měsíci

    thanks this is what i was looking for 😊

  • @khairinaatiqah3959
    @khairinaatiqah3959 Před 7 měsíci

    your explanation helped me alot. thank you!

  • @RahulDutta-pt8xl
    @RahulDutta-pt8xl Před 7 měsíci

    Hi, is there a way to send specific user a message without using spring security and login? I tried it but it’s not working.

  • @scottamolinari
    @scottamolinari Před 8 měsíci

    I haven't looked into this yet, but how would you set FIDO2 up with users already in the system? How to get their public key into Keycloak?