System Design round of Data Engineering

Data Engineering Mock Interview - Second Round
Join Sai Vineel, an experienced Data Engineering professional with over 8 years of experience, and Manoj for an exciting and informative Data Engineering mock interview session.
If you're preparing for a Data Engineering interview, this is the perfect opportunity to enhance your skills and increase your chances of success. The mock interview simulates a real-life scenario and provides valuable insights and guidance. The topics covered include discussion on SQL vs NoSQL, Git Practices, Deployment methodology in the Data Engineering etc.
It covered questions from Apache Spark, SQL, Airflow, File Formats, ETL pipelines, data modelling, database technologies, cloud platforms, and more. You'll get to see how professionals tackle technical questions and problem-solving challenges in a structured and efficient manner.
By watching this mock interview, you'll learn effective strategies to approach technical questions and problem-solving scenarios, gain familiarity with the data engineering interview process and format, enhance your communication skills and ability to articulate your thoughts clearly, identify areas of improvement, receive expert feedback on your performance, boost your confidence, and reduce nervousness for future interviews.
This mock interview suits all levels of experience, whether you're a fresh graduate, a career changer, or a seasoned professional looking to improve your interview skills. Don't miss out on this invaluable learning experience! Subscribe to our channel and hit the notification bell to be notified when the mock interview is released. Stay tuned for a deep dive into the world of data engineering.
Subscribe now and be the first to watch the Data Engineering Mock Interview with Sai & Manoj.
🔅 To book a Mock interview - topmate.io/ankur_ranjan/15155
🔅 LinkedIn - / thebigdatashow
🔅 Instagram - / ranjan_anku
🔅 Sai Vineel(Interviewer) 's LinkedIn profile - / saivineel
🔅 Manoj (Interviewee)'s LinkedIn profile - / manoj-t-dataengineer
Chapters:
00:00 - Introduction
06:24 - Medalian Architecture
08:14 - Protobuf File Format
09:18 - How do you ensure Data Quality?
11:56 - Data Modeling Question
19:15 - Why do we need to Denormalize the data?
22:02 - Designing data Pipeline & various scenario-based question
29:29 - Key difference between LakeHouse and Data Lake
31:59 - What is SCD2? When it is useful?
33:44 - Project Deployment from one environment to another environment
34:31 - When you trigger your pipeline, how does it execute?
35:33 - Key consideration from SQL to NOSQL
37:27 - Challenges faced in Pyspark
38:45 - Day-to-day data engineering task
40:35 - How do you ensure the pipeline does not repeat a similar kind of failure?
42:43 - Best Practice for versioning control
44:44 - When to use RDBMS and when to use NoSQL?
#dataengineering #interview #interviewquestions #bigdata #mockinterview

[@CodeNCareer]

The quality and variety of questions wa amazing here, got to learn many things related to designing part. Kudos to @ankur jain for providing such good content and thanks to Sai and Manoj for sharing their valuable insights.

[@TheBigDataShow]

Thanks for the kind words and compliment but my name is Ankur Ranjan not Jain😊

[@manojt7012]

Thanks for acknowledging and complementing it

[@Samirgamerff6396]

​

[@maneeshkbishnoi5481]

Very well curated interview, covered various aspects in detail for typical DE interviews. Thanks Ankur for arranging this. Appreciated 👏🏻

[@TheBigDataShow]

Thank you Maneesh

[@manojt7012]

Thanks Anjur and Sai for this opportunity🙏... I hope people could relate and learn something out of this interview.
@viewers do let me know your thoughts in reply. I would be glad to hear the feedbacks!

[@user-bk4ox1fd2g]

E❤❤😮😊

[@ChahatalitalpurChahatali-bk2ww]

A8j4I😅,j​❤❤❤3w7jygfhvfuk

[@AbhishekKumar-sg9nk]

Just practicing:
Order should be fact table( this is one time data--- load strategy would be append)
Dimension tables
And customer, (SCD 1 strategy will be enough since customer details are generally forward update)
Product(scd 2 /3 since product price can update and we can also use past data)
Payment (append strategy since it will contain new data every time)

[@sharankarthick3364]

Various topics covered! Very insightful!!!

[@TheBigDataShow]

Thank you for your kind words. Keep learning:)
We have more than 25 Data Engineering More Interviews on our channel. Do watch it in your free time and let us know your thoughts.

[@louisxuan-em6lk]

thanks for mock interview of data engineer👍👍👍

[@TheBigDataShow]

Most welcome

[@savirawat6671]

@thebigdatshow can you please conduct an interview for data engineering manager role❤

[@TheBigDataShow]

We have already recorded it. We are going to premiere the video in a few days. Please check our Data Engineering Mock interview playlist. You will be able to find the video. Check the thumbnail & click on notify.

[@sunilgurram9670]

please conduct mock interview for GCP data engineering as well there is a huge demand for GCP

[@TheBigDataShow]

We are planning in some days