- 332
- 2 138 471
Andreas Kretz
Germany
Registrace 18. 04. 2017
Hi my name is Andreas Kretz. I teach Data Engineering at LearnDataEngineering.com. My Academy at learn data engineering will tech you everything to become a Data Engineer or use Data Engineering in your current job.
On this channel I talk about tools, techniques and topics that I experience in my day to day work.
As an Engineer you figure out how to ingest, process and store data to enable Data Scientists, Analysts or customers to do awesome stuff. Using tools like AWS, GCP, Apache Spark Apache Kafka, MongoDB, Python, Databricks, Apache Airflow and many more.
That's what data engineering, the plumbing of data science is all about.
On this channel I talk about tools, techniques and topics that I experience in my day to day work.
As an Engineer you figure out how to ingest, process and store data to enable Data Scientists, Analysts or customers to do awesome stuff. Using tools like AWS, GCP, Apache Spark Apache Kafka, MongoDB, Python, Databricks, Apache Airflow and many more.
That's what data engineering, the plumbing of data science is all about.
The Ultimate Data Store for Effortless Data Analysis?!
Frustrated with complex and slow data analysis tools? How great would it be then to have an open-source, super fast, and easy to install analytical database at hand, right? And all you need is a Python runtime!
In this livestream I intend to learn more about this from Mehdi Ouazza, Data Engineer & Developer Advocate at motherduck.com.
We will hear about the benefits of DuckDB, dive into practical use cases to get an in-depth understanding, and much more!
Join us, ask your questions and let's have a good time :)
▶︎ Check out DuckDB: bit.ly/3W9qTF0
▶︎ MotherDuck: bit.ly/4f4zEb5
▶︎ browse through their GitHub: bit.ly/4bxaDC4
▶︎ and try out the live demo: bit.ly/3L9IZAn
#datascience #bigdata #dataengineering #dataanalysis #datastore #database
In this livestream I intend to learn more about this from Mehdi Ouazza, Data Engineer & Developer Advocate at motherduck.com.
We will hear about the benefits of DuckDB, dive into practical use cases to get an in-depth understanding, and much more!
Join us, ask your questions and let's have a good time :)
▶︎ Check out DuckDB: bit.ly/3W9qTF0
▶︎ MotherDuck: bit.ly/4f4zEb5
▶︎ browse through their GitHub: bit.ly/4bxaDC4
▶︎ and try out the live demo: bit.ly/3L9IZAn
#datascience #bigdata #dataengineering #dataanalysis #datastore #database
zhlédnutí: 362
Video
Three real world data pipelines in action - workflow automation with Stonebranch
zhlédnutí 40KPřed 15 dny
In this video, I explore three real-world data pipelines used by major companies, thanks to Stonebranch's workflow automation platform. See how data is transferred, validated, and processed across AWS, Azure, SAP, Databricks, Snowflake, Informatica and more. Stonebranch is a great alternative to Airflow, but it also works together with Airflow. ▶ Success Stories: bit.ly/3RIaaWW ▶ Data Engineeri...
Will AI replace Data Engineers?
zhlédnutí 730Před měsícem
▶︎ Check out the details in my free Data Engineering Cookbook: bit.ly/3SKqmq7 ▶︎ Learn Data Engineering at LearnDataEngineering.com: bit.ly/3R13ao0 #dataengineering #dataengineer #bigdata
Why Data Engineers are like Super Mario 🍄 #dataengineering
zhlédnutí 666Před měsícem
If a Data Engineer would be a superhero who would it be in your opinion? And why? Let me know in the comments! 😃 You want to start your own Data Engineering journey? Then check out my Academy trusted by almost 2,000 students 👉 learndataengineering.com/p/academy #DataEngineer #LearnDataEngineering #BigData #DataScience #shorts
The importance of the flow state - #dataengineering
zhlédnutí 561Před měsícem
How difficult is it for you to get in the flow state while working? Or do you find it super easy because you have a great trick or tool? Let me know in the comments! #DataEngineer #LearnDataEngineering #BigData #DataScience #shorts
The difference between data ingestion & extraction - Data Engineering Explained 🎓
zhlédnutí 589Před měsícem
Learn about the different concepts of data ingestion and data extraction. Start your own Data Engineering journey now with Academy 👉 learndataengineering.com/p/academy #dataengineer #dataengineering #datascience #bigdata #learndataengineering #shorts
My favorite function in #dataengineering !
zhlédnutí 794Před měsícem
It really blew my mind 🤯 when I got into Python and pandas. Here's why! Elevate your skills and dive into 'Python for Data Engineers' with my Academy course 👉 learndataengineering.com/p/python-for-data-engineers #DataEngineer #LearnDataEngineering #BigData #DataScience #Python #shorts
The Synthetic Data Revolution?
zhlédnutí 20KPřed 2 měsíci
Synthetic data gets used for many purposes, from development and testing to training of ML models and more. In this stream I intend to learn more about this from Mario Scriminaci who's the Chief Product Officer at mostly.ai Join us, ask your questions and let's have a good time :) Check out Mostly.ai's ▶︎ Free Python DataLLM: github.com/mostly-ai/datallm/ ▶︎ Download the pre-trained Data LLM mo...
Testing the new Personalized AI Assistant for my Data Engineering needs
zhlédnutí 381Před 2 měsíci
You.com asked me to try out their Personalized AI Assistant for my Data Engineering needs. It works accurately and transparently and provides you with several AI modes for individual prompts and needs. As an example I used Smart mode to get a quick code example on how to load a CSV file into a Spark dataframe (👉 bit.ly/3Qg156Y). Then I went into Research mode, which really impressed me (👌 bit.l...
Pro tip for anyone who wants to get into Data Engineering!
zhlédnutí 800Před 2 měsíci
As a beginner in the Data Engineering realm it is super easy to get lost in the abundance of tools and learning platforms out there. Here's a pro tip on how to avoid that! You want to start your own Data Engineering journey? Then check out my Academy trusted by almost 2,000 students 👉 learndataengineering.com/p/academy #DataEngineer #DataEngineering #LearnDataEngineering #BigData #DataScience #...
PySpark equals Databricks? #dataengineering
zhlédnutí 1,4KPřed 2 měsíci
Do PySpark and Databricks depend on each other? Not necessarily! But here's why it makes totally sense to use them together... Looking for a great Databricks training to work through? Then check out my Academy course Data Engineering on Databricks 👉 learndataengineering.com/p/data-engineering-on-databricks #DataEngineer #DataEngineering #LearnDataEngineering #BigData #DataScience #databricks #a...
Cloud or local machine - which to choose? #dataengineering
zhlédnutí 602Před 2 měsíci
Many people struggle choosing between the cloud and their local machine... Let me tell you something: you can succeed on both! Learn Data Engineering Academy 👉 learndataengineering.com/p/academy #dataengineer #dataengineering #datascience #bigdata #learndataengineering #shorts
How to get a Data Engineering job? Data Engineering Explained 🎓
zhlédnutí 808Před 2 měsíci
Learn about the main two options you have to land a Data Engineering job if you have zero experience! Start your own journey now with my Learn Data Engineering Academy 👉 learndataengineering.com/p/academy #dataengineer #dataengineering #datascience #bigdata #learndataengineering #shorts
What are the different database types? Data Engineering Explained 🎓
zhlédnutí 722Před 2 měsíci
Get to know the main two types of databases and learn about their differences! Learn basics like this and much more in my course "Choosing Data Stores" 👉 learndataengineering.com/p/choosing-data-stores This course is part of my Data Engineering Academy: learndataengineering.com/p/academy Here you find 30 beginner friendly trainings and hands-on projects that help you on your Data Engineering jo...
What is Data Engineering?
zhlédnutí 573Před 2 měsíci
Data Engineering explained in a nutshell 🎓 Learn basics like this and much more in my Data Engineering Academy 👉 learndataengineering.com/p/academy #dataengineer #dataengineering #datascience #bigdata #learndataengineering #shorts
Turn off your auto stop in the settings and it won't emergency brake - problem solved. However, I would not recommend that. You can turn off all of the auto safety features in the settings. But I wouldn't do that if I were you. I was on a busy road and traffic ahead of me slowed down. I started to change lanes and the car literally stopped me. Just as I stopped moving into the next lane a car that was speeding screamed by me. The driver was going so fast that he was not in my line of sight when I checked to see if the lane was clear. Had I moved partially into the adjacent lane he would have hit me and I probably would have been cited because it would be difficult to prove he was speeding. The safety features of the car literally saved me from a serious accident. This guy was going so fast, it was impossible to see him coming up on my position, but the car saw it and stopped me from changing lanes. I suggest that you use the auto cruise and if it slows down, just take over for a minute and switch it back on after you pass the obstruction. This is a quick and easy fix. Most of the time, when the car slows down, I WANT to shut the cruise control off and take over. I hop this helps you.
Lovely Episode! thank you guys!
Great to hear! Check out the plumbers of data science podcast channel on CZcams for more episodes
Never use auto pilot. Never use cruise control.
Thanks for sharing.
You're welcome! Hope you got something good out of it 🙂
pi lllpp😊ppp😊pp😊0😊😊00😊😊😊😊00😊0😊😊00😊😅
What if you're a new graduate with a CS degree?
Weird I have no issues with autopilot. Maybe you should schedule a service. Maybe theres something wrong with your camera? Mine addapts fine to signs.
Omnamashibaya*omgurucaranesharana❤❤❤❤❤❤❤❤❤
😊
❤❤❤❤❤❤❤❤❤🌹🌹🌹🌹🌹🌹🌹🌹🌹🍓🍓🍓
Do you have rough estimates on how much a single pipeline costs to run on AWS, say?
Thanks much for this insight. We hardly find data engineering videos in the CZcams space. Appreciated!
I've only had mine for a week but I can already say that I completely agree with you. Autopilot is useless and I'm only using cruise control on the highway when there's no traffric or in slow moving queue. Apart from those use cases it's also more a source of frustration than anything else. But I love how it drives (with me driving), how it looks inside and out, how good the sound system is and how efficient it is.
any rattles inside of the car while driving?
Zero
Great I wasn’t waiting for OpenAI to open up additional connectors. How much more data do they want? 😅
Comfort and suspension is much better than a Mercedes A-class.
I had a Seat Leon 2020, the ACC and lane-keep were great in it, until I totaled the car 3 weeks ago. Now I had 2 loner cars, brand new VW Golf and a brand new Skoda Octavia. The lane keep in those things are terrible. It ping pongs between lanes and is constantly warning you to "drive in the middle of your lane" when you are 2cm too much to the left or right. A biiiiggg step back. Currently I'm waiting for delivery of a new Tesla M3. I really hope they fix those wipers and Autopilot soon. In US it might work great when you have FSD (supervised) but I really hope the EU team will get on it soon as I have my lease runs for 4 years. Thanks for your informative video!
Very clear and detailed explaination! Thanks
Thanks! Tomorrow I have a new and exciting video scheduled 😉
Why would somebody want autopilot, people are so lazy... If you dont want to drive take a bus.
I need to learn snowflake with scratch how do I start? Any suggestion pls
Look into my data engineering academy. I have everything there including snowflake, plus dbt with snowflake
have you removed the wheel covers and just added some covers for the screws and center? or added something else? looks great! cheers
Yeah, you can get these from Amazon. It's the same size as on a Model S.
at last a good review from a European
Stupid decision. Pdf is better. Offline is more convenient to read and print.
Uhm... this car's interior is not premium either. In fact I think it looks even cheaper than the 2023 model. Still I'm getting one of these as the ride is just insanely comfortable. Its relatively quick. The seats are amazing and the cabin is so silent in comparison to many other offers out there.
Maybe Professor X (Charles Xavier)? Data engineers possess the ability to "read minds" in a way by interpreting and understanding complex, incomplete and unclear requirements, then get value out of blurry data sets.
I don't see it being able to replace data engineers. Data engineers do more than just sling code
Exactly what I explained
In my company, people aren't allowed to use any AI, because of data leak fear
Nice explanation
Thanks!
I hear you
Tesla recommends a higher tire pressure to increase mileage. If you want a smoother ride and increased traction adjust the pressure to the tire manufacturers' recommended pressure. For long trips I adjust to the higher pressure, for local driving, I sacrifice mileage for better road isolation and handling.
Didn't understand can you make another video making this clear
❤❤ One big dislike for so many interruptions
Tesla wipers has been shit since 2018 when I got my first Model S. They've been shit on my 2020 3 and are still shit on my 2024 MYP. I don't think they'll ever fix it. I'll use intervals or just click the button. Autopilot works really well for me though, but phantom braking does happen and it's terrifying every time. I'll still buy a Tesla next time which is why I'm watching this. Thinking about upgrading the 3 to the Highland 3.
very helpful, thank you so much
Bruh why'd you steal my thumbnail?
The autpilot issue has more to do with german roads i think 😂 i have had the same issues with different cars in Germany the lines are sucks
If you didn't have a family car for longer trips, would you have gotten the Y instead?
How is it as a family cat. I think that’s a missed opportunity.
I have matrix headlights on the older (pre-highland) model 3. You can set the speed to current / manual and ignore the speed signs. Autopilot works great in Australia.
Auto pilot works very nicely in US. Thanks for the video tho.
What is synthetic data?
Here's a nice definition that I found on the internet: "synthetic data is, as the name suggests, artificial data generated to mimic real data. Typically, synthetic data is generated using sophisticated Generative AI techniques to create data similar in structure, features, and characteristics to the data found in real-world applications."
@@andreaskayy0:09
Thank you for the video Mr Andreas, please can we do spark jobs in the transformation connector? Thanks.
Maybe one day the US will be fortunate enough to get the Matrix headlights.