Interview QA | Spring Batch - Fault Tolerance Using Skip Policy & Listener | Java Techie

In this tutorial, we will deep dive further to understand how to manage fault tolerant and notify to the user about failure reason in spring batch application using skip and listener concept
Fault Tolerance is a concept which wen implemented allows application system to continue operating despite failures or malfunctions
Spring boot microservice Live course Just started (Recordings available)
Hurry-up & Register today itself!
COURSE LINK : javatechie5246.ongraphy.com/
PROMO CODE : Java40
Spring Batch video link : • IQ | Spring Batch for ...
GitHub:
github.com/Java-Techie-jt/spr...
Blogs:
/ javatechie
Facebook:
/ javatechie
guys if you like this video please do subscribe now and press the bell icon to not miss any update from Java Techie
Disclaimer/Policy:
--------------------------------
Note : All uploaded content in this channel is mine and its not copied from any community ,
you are free to use source code from above mentioned GitHub account

[@rasmiranjan7738]

Great Learning stuff.Keep Going 🎉 and good job❤❤

[@rajenderprasad1193]

As usual. Great content and explanation 🎉

[@maheshd3506]

Your all videos are awesome,any spring related info I will watch your videos

[@RN-jo8zt]

Thanks for clean and simple🥇

[@sharmarahul17]

Thanks for the great content. 👍

[@JackSon-lj3on]

Thank you so much 🎉

[@dedraniaamir8772]

Thanks for this great content. Can you please make a series on different design patterns with interview questions on design patterns?

[@lachphalleak2459]

Thanks for your kindness ❤❤❤

[@2RAJ21]

thank you

[@pr1838]

Hi JavaTechie,Need a reference or video for spring batch reading the data from multiple tables with multiple queries.
And also how commit count will update in multi threading in step batch execution table...if you give answer or any video it will be helpful

[@soulfulGirl_]

I tried the same think but I am using JobBuilder and StepBuilder here its inserting all records except the faulty one with out making use of skip policy and all for me I am using new version of spring-Boot i.e 3.0 , is this changed in newer version?

[@Javatechie]

No there is no change in the version. Add a break point in skipListner and validate or check are you mapped correct exceptions to skip or not

[@thranduillord001]

SkipListener should be SkipListener.
If taskExecutor option is used in the step, then skipLimit applies per thread. How to use an aggregate count for skipLimit?

[@DS-ol1ic]

The demo, shows how to skip failed and reload the corrected data. Actually it will process the whole file again, write the failed ones from pervious run, for those exists in database due to previous load successfully, it will through exceptions and get caught by skip listeners.
Assume the file has million records, skip limit is 100, and 90 record failed in the 1st run. After corrected the data file and run it again, the 2nd run will have 1 million - 90 errors and it will exceed the skip limit.
So why not in the skip listener redirect the errors to another error table in database, and load again only from the corrected errors?

[@ayushgupta-pj5sq]

in my case I am using row mapper in reader to change the object fetched from DB and in itemProcessor I am again sending something else to writer then what should I provide in StepSkipListener in place of customer?

[@Javatechie]

Your object which you are getting from dB

[@sureshmanne7245]

23:25 You may have shown one more exception skipping, is it comma separated list of exception names on line 10?

[@Javatechie]

You can forcefully throw some exception and validate it

[@sanjeevsingh-gc3vv]

I have a doubt, it will insert only failed data that's fine,
But it will process all the record na ...
Since rest all records are already present, it will not insert again, processer will process all those, right?

[@udhayasankar113]

Is it possible to use multi resource item reader along with spring partitioning concept and in partitioning video u used jpa writer ..can i use jdbc writer instead?

[@Javatechie]

Yes you can use jdbc writer

[@ElonMusk-wo7zf]

@@Javatechie Can write to DB through Repository writer from reading multiple files ? And using Multi-resource item writer???

[@udhayasankar113]

@@Javatechie anything needed in addition when we use jdbc writer?

[@ElonMusk-wo7zf]

Great explanation! Can you do video on Restart a Step -> startLimit(), allowIfComplete(),preventRestart()? Confused how it works. And None made tutorials on that.

[@Javatechie]

Okay sure will do that

[@rasikabramhapurikar9904]

I have query if without any fault tolerance , i got error at 10th line of 1000 rows..then what will be output? Is spring batch insert 9 rows or all rows are rollback?

[@Javatechie]

It will insert 9th row and when you will fix your file and reupload then it will start processing from line number 10

[@rasikabramhapurikar9904]

@@Javatechie thank you sir for reply ..

[@80pawangupta]

Its really great one but I just have a question how does spring batch can be handled with List of Object from reader to processor to writer into DB. DO you have any good refrences ?

[@Javatechie]

Please check out my spring batch video i have explained with internal flow

[@sumitudgiri8967]

@Javatechie my skiplistener is not getting invoked. Bean is getting created

[@Javatechie]

Please add a break point and check if it's called from config or not

[@mohanlal8692]

Please do a video for read the uploading excel file using spring batch , it will be much help full because nowhere such eg or experiment is not there

[@sureshmanne7245]

There is a spring batch video from this channel, do check it

[@govindkerkar]

U said that if u run batch again with data present , it will nt insert records...how batch knows which records to insert qnd not ? Is it bcs of id column taken from csv to table id ?

[@Javatechie]

In our case table id and csv column both are same

[@govindkerkar]

@@Javatechie ok so if id column is auto generated then it insert duplicate records and we shd add some logic in processor to check for duplication? Is it correct ?

[@pratikkasar1882]

I am Using Skiplistener in async batch processing and I see that SkipListener is not getting called. If i change the batch to normal processing then the listener is getting called. Any reason behind that?

[@Javatechie]

It shouldn't be the case if you can create a constructor and check whether the listener bean is creating or not that will be easy to identify

[@pratikkasar1882]

@@Javatechie thank you. I ll definitely try. Bdw your videos are very informative and helpful

[@pratikkasar1882]

I checked by adding sysout statement while creating a bean. its printing that the bean is getting created but the methods are not getting called for the skiplistener. Please help

[@Javatechie]

Okay let me check

[@ainigma100]

First of all thank you for the video@@Javatechie! The SkipListener is not called if you have configured taskExecutor inside your step() method