Microservice | Distributed log tracing using Spring Cloud Sleuth & Zipkin | PART-7 | Javatechie
Vložit
- čas přidán 27. 08. 2024
- This tutorial will walk you through the steps of building a spring boot project with Microservice architecture also we will learn Real time integration of
1.spring cloud eureka
2.Spring cloud API Gateway
3. Hystrix
4.cloud config server
5. ELK Stack Centralize logging
6. Spring Cloud Sleuth & Zipkin (Distributed log tracing)
#javatechie #SpringBoot #Microservice
#SpringCloud #Sleuth #zipkin
GitHub:
github.com/Jav...
Blogs:
/ javatechie
Facebook:
/ 919464521471923
Guys if you like this video please do subscribe now and press the bell icon to not miss any update from Java Techie
Disclaimer/Policy:
--------------------------------
Note : All uploaded content in this channel is mine and its not copied from any community , you are free to use source code from above mentioned GitHub account
Your videos are very concise and easy to understand.
Thanks for spreading knowledge.
Thanks buddy 😊
you are doing brilliant work sir. thanks
Nice one. Thanks for preparing this
Thanks a lot for this brief yet practical explanation!
Awesome Video Basant. You are doing invaluable service to developers community. Thank you so much.
Thanks buddy 😊
Great explaining. able to understand the concept
nice One 🎉
love to see your videos sir, keep doing..!
Very helpful and interesting topic.Thanks
Awesome Video
Nice explanation and thanks for your efforts
Very nice explaination!
You're very kind hearted man... Love your videos
😀 thanks Ahmad
Nice explanation. Thank you
Awesome 👍👏
Very nice video 👌
Excellent
Great explanation!
Thank you very much
Also in real time I think Kafka Messaging Queue will push the data to Zipkin server and Zipkin will store it in some databases like Elasticsearch/Mongo/Cassandra
well explained..Thanks .
🎯 Key Takeaways for quick navigation:
00:00 *Understanding Google Cast*
00:29 *Microservices communication*
00:58 *Importance of separate applications*
04:55 *Log Tracing Using*
05:18 *Doesn't Support*
05:42 *Service Name*
05:55 *Dependency Updates*
06:11 *Spring and Dependencies*
06:28 *Enabled to Import*
06:39 *Good Two Products*
06:56 *Cloud and Register*
07:09 *Fine Payment Services*
07:22 *Good Base Here*
07:35 *Base and Care*
07:49 *Give the Path*
08:04 *Registered Services*
08:30 *Services President Tried*
08:42 *Good Care Service*
09:03 *Service Not Able*
09:18 *Click Switch Off*
10:16 *Last When Is*
10:50 *Trace Your Service*
11:01 *Service Differences*
11:14 *Trace Your Services*
11:30 *Microservices Variations*
11:52 *Service Stability*
12:05 *Feel Good Service*
12:28 *Track the Requests*
12:42 *Click Off Services*
12:55 *Payment Service Request*
13:07 *Follow Service History*
13:21 *Dependency Satisfaction*
13:35 *Order and Payment Services*
13:49 *Multi-Microservices*
Made with HARPA AI
God bless you man
While both involve deduction in some sense, they operate in different domains and contexts. Data science focuses on deriving insights from data through statistical analysis and machine learning techniques, while Spring Sleuth is specifically designed for tracing and monitoring the flow of requests through a distributed system.
nice.. thank you..
really outstanding learned some decent stuff.
great video mannn. thanks
Please keep playlist link in the description. Becomes very helpful when randomly ending on a video from a search
Its there in video description utsav
Really Appreciated !! Thanks a lot
Learn a lot from you sir thank you. Can you also do a tutorial about this project, to deploy as a docker container?
Awesome video man, really helpful!
Thanks
Hi Sir its very useful to see Microservices Ecosystem integrated. For this series could you please add OAuth2 for Security. Please do a video on OAuth2 sir and a video for this series.
Yes am trying jwt to integrate in same microservice series
Thank you so much sir🙏
thnx bro
Could you please make one video on dynatrace or any other production like monitoring tool. It would be very helpful.
It's paid buddy. If i could get some free trial then definitely i will give a try
Please make one video on splunk framework.
I think u could have even showed tracing failed request also ,any ways good tutorial 😊
Please provide video for Eureka as service discovery and zuul as api gateway
Vivek already uploaded please go through my microservice playlist
Awesome . Awesome learning with Java Techie ..Thank you .
can we use Ribbon for the LOAD balancing ? are you planning to implement the same ?
Yes we can use ribbon as I did poc with one instance so didn't added this concept yet .but if required I will plan to add one tutorial on same
In other group I think of
Hello @Java Techie, your tutorials help a lot from a learning perspective. Thanks for posting such constructive and hands-on tutorials.
Just one query regarding this tutorial, Is it possible to check the request payloads on the Zipkin UI portal while tracing the request when the request is traversing from around various microservices using the sleuth and Zipkin. Please let us know. Thanks in advance.
No we can't view payload use elk and check complete request payload in kibana log
@@Javatechie sure. Thanks.
You are doing great job, which one to prefer ELK or Sleuth for distributed logging
Both having different purposes
Elk used for centralize logging where sleuth used for distributed tracing
Very much helpful video. Thanks a lot Basant!!! But have a doubt, Can we implement Sleuth alone for just getting those metadata in logs?
No we need to push those metrics from our app to sleuth
When use only spring cloud sleuth it not show trace id and span id right ?
@basant - I guess you added the same tutorial twice in the playlist. Can you please correct or did you miss to add any other tutorial.
@basant Is trace id equivalent to Correlation ID?
Great content man. 👍
Please help me with one query : Why traceId and spanId is same for orderService ?
Try attempting multiple time you will find your answers buddy
Hi Basant, I've been watching many of your videos and those are very helpful. Thank you.
My question is, Will sleuth-zipkin work across kafka ? Elaboratively, one microservice is pushing data to kafka and other microservices are reading the data from kafka. Will this approach for distributed tracing work in that case? If not, then can you please suggest how can we work around. I've heard Jaeger has capability to do it. Please make tutorial on that .🙏
Am not sure whether we can use this distributed tracing using Kafka or not .
@@Javatechie sir if you know some other approach then please create video for that also
Sure I will try to explore about this
What will happen if the Zipkin server is down, is logs transactions will be lost? Can we see them once Zipkin is up?
Excellent, How can we identify or relate (span -> microservice version) which microservice instance is creating the problem.
Like : SpanId : ftyytyuiyi -> Microservice A : v1
SpanId : dsfsdffs -> Microservice A : v2
So we can add sleuth/ zipkin within elk stack ..so that in addition we get microservice flow logs for debugging
Is my above statement correct ?
Yup correct
Thank you so much for great videos.. what happens when other external services not implemented zipkins or sluth ..
Second question is does we able to see external services logs if they are implementing same log trace plugins
Nice
May I know how to get all the log messages in one place in Microservices
Use elastic logstash and kibbana . already i uploaded it please checkout my microservice playlist
Hi bro, I am able to work with Zipkin. But I am running multiple instances of Order and Payment services on different ports. In Zipkin, it is showing only IP and not on which port my requests are getting redirected by Eureka. How to get Ports also in Zipkin dashboard?
Zipkin won't show your port . It will show your service name based on service name you can find out port in your Eureka server
@@Javatechie But at timestamp 2:00 you said that we'll be able to find exactly which instance of our service will go down, whether it is 9090 or 9091. How to find that out for a request?
Hello Sir it's great video ,just wanted to know how can I trace my request if i will be using Kafka in between of microservices??
You need to check in Kafka tool or lenses ui
Thanks.
The Examples/scenarios are for synchronous model..will it work for asynchronous and non spring boot applications?
What is the purpose of sleuth dependency?
can you create one video please for one flow from controller to database to show in the zipkin trace
Zipkin used to track microservice api call not application flow
@@Javatechie ok..actually need to trace JPA repository what is the method it called when flow start
Create your custom metrics using reflection api or use spring app around advice on repository later
Does it matter if I use in spring.zipkin baseUrl instead of base-url in the application properties?
can you add tutorial to containerize this project using Kubernetes.
centralized logging vs distributed logging
Need help regarding new relic logs how to push the logs to new relic
I am not aware that relics will check and update you
Can we create a custom span ID. ? If yes, then how ?
I believe we can but will check and update
@@Javatechie I am not able to find any related documentation for it. Kindly update if you find something.
How to hold historical logs on zipkin ui
Bro can you make a video to implement message queue for the above project .i have do the project but i want to add message queue approach
How can I persist all log for long time
Hello sir, In the production environment I wanted to see the number of microservices hit and payload for each request. How do I get it?
Use ELK or check in splunk
Thank you for your response. So, In splunk we can track the total number of hits for each service.
What is ELK?
Buddy please search in my channel you will get both the content
Zipkin jar is not running in windows. Can anyone help me out?
What error you are getting
@@Javatechie BeanCreation Exception with name ArmeriaServer. I am using zipkin- server-2.23.2-exec.jar and amazon correto jdk 11
Not getting you why you want to sync AWS with zipkin
@@Javatechie am not using aws. Amazon correto is a jdk which am using
How to secure zipkin?
Am not sure but I believe we need to create zipkin server manually then need to enable security by adding spring security starter dependency
2020-09-05 22:00:29.298 INFO [order-service,,,] 8076 --- [ restartedMain] c.e.S.SlauthDemoOrderServiceApplication : Started SlauthDemoOrderServiceApplication in 7.371 seconds (JVM running for 7.986)
i am getting response in this format ..service name is printing , but Traceid and other metadata are not printing.
But in Zipkin UI i am getting all those metadata.
Spring boot version ?
Am not sure about it in each spring version something gona changed by developer
So please checkout the spring boot official documentation if you are using latest version
@@Javatechie spring boot version is 2.3.3
Can you plz share zipkin jar . I have searched all the way in the google but no luck ☹️
Directly get it from Maven central repository
But in real time it should be a separate spring boot project i guess
docker exec -it javatechie ls /data/spring-related-tutorials
Excellent