The World's Largest Computer Crash Just Happened...
Vložit
- čas přidán 4. 09. 2024
- Hello guys and gals, it's me Mutahar again! This time we take a look at how a sole company known as Cloudstrike pushed a little update today that crashed computers at massive companies today putting the entire world on hold. How could something this wild have happened? Let's find out! Thanks for watching!
Like, Comment and Subscribe for more videos!
Bro chose a thumbnail like he was the culprit behind the crash 💀
😂
he felt mischievous
😂
Bro I think I remember a long time ago probably years now he said he doesn't chose the thumbnails he let's youtube auto-generate it and just chooses that one lmfao.
That's why they always look funny af
Fr!!
"You can't hack a system if the system doesn't work! "
- Cybersecurity intern pushing the update
Truly genius.
Definitely one of the updates of all time
this made me chuckle! Thanks!
Saw some comments on Reddit -
_Cant have cyber-security issues if you remove the users 😉_
Who would win?
Hackers all over the world VS Todd the underpaid intern with one content package
technically the truth 🤷♂
This thumbnail feels illegal
@@AUTTPHANBURGERSAUCE-g8j thank you!!! ❤❤
Fr
😂😂😂😂😂😂😂😂😂😂😂😂😂😂😂
Lol
@EmperorMAP_Pride niqqa
This is perhaps one of the closest things we got to Y2K.
I remember Y2K even though I was a child I remember everyone being freaked out about it. Everyone was preparing for the collapse of civilization in the oncoming apocalypse.
Here we are in 2024, no warning no panic, just a random weekday, AND SOCIETY COLLAPSED (not really but yeah the closest we're going to get to Y2K)
And we recovered a day after. We were, quite literally. Caught by surprise.
this is worse than Y2K because there's no excuse for whatever just happened compared to that
@@shadowsoulless6227 society did kind of collapsed not in apocalyptic way but like we cant do a lot of stuff, Hospitals dont work, airports dont work, and also in australia the court system is paralysed and cant do much.
Basically Y2K was supposed to be about twice as bad as this one
So yeah this is catastrophic. The only reason I typed this is because I prevent Windows from automatically downloading in metered connection.
I almost got hired at CrowdStrike as a software engineer for Windows sensors. Clearly, they should have hired me
Fr, You would've never let this happen smh
bro you should have put some sort of DEI in your resume to get hired💀
clearly
I don't know brother
It sounds more like you saved yourself from being thrown under the bus for this.
@@achint4473 Cringe
It's my 3rd day as an IT Service Engineer at a giant company that has crowd strike on thousands of devices. I have no access tools to help so everything is falling apart around me right now.
Naturally I'm watching youtube.
A reply bot has been detected on this comment, please ignore it and report it. Don't interact with the bot it feeds off your attention! 30035
This is almost like the zombie outbreak that happened on Leon’s first day on the force
@@stee.bee69 Umbrella Corp moment.
Same here. Waiting on the IT dept to give me my credentials so I can do work on our segment of laptops. So it will now probably take a long time to get everything instead of a few days 😬.
💀😶
I was at the Airport when the system crashed. The CROWD at the airport got together and started a STRIKE. Crowdstrike stayed true to their name.
😂
@Joseph_1441 no one's gonna fall for your rage bait 😐
@@PaperCheetah Stop engaging with them
@Joseph_1441cool that’s hype asf
@@PaperCheetah You literally just "fell for it", they are bots and grow based on how much people engage with them, any reply will do it
To make it absolutely clear: All they had to do to prevent all this was test the update on a few Windows machines before pushing the update worldwide.
This is a multi-billion-dollar company and they didn't even test their critical software for even the most obvious bugs before shipping it out to half the world's IT systems. This is incompetence on an incredible scale.
And no one who is actually reposible for this going to get in trouble just some low level tech who told them they should not do it this way
EXACTLY!
almost every software companies ever lmao including video game companies.
They're likely going to get sued into bankruptcy for this at worst, and lose an extreme amount of business at best.
Either way, Cloudstrike is going to have a bad time, and they deserve it.
this is literally what the video says :)))))) bud thought he made something
CrowdStrike: can't have a virus if you can't turn on the system
*forehead tap*
😂😂😂 golden
You're not wrong.
P E R F E C T I O N
Bingo!
G E N I U S
I shit you not, as somebody who works in IT within the healthcare sector, this shit was DIABOLICAL LMAO
Bros been taken by the bot replies
@@ItsYeetsupI've been invaded LMAO
same lmao
Fr
Our inhouse systems were not touched. Not only do we not use the Crowdstrike software, we have backups on backups in case something like this happens. The worst we're having issues with our cloud vendors not getting data back.
Meanwhile, my boss is telling me to "look busy" with a blue fucking screen on my computer. We can't do shit right now bro! What do you mean look busy?!
Just read some papers
😂😂😂 look busy
I’d go walk between places. What else could I do?? 🤷🏻♀️
Reads papers..
Boss's tism kicks up
LOOK BUSIER!!!! BREATHE HEAVIER!!
Your boss is a mindless drone in panic mode, just go for a walk and they probably wont even notice you're gone unless its a very small office team lol
Quit your job
I'm a registered nurse at the largest hospital in my state. It was a complete nightmare trying to chart, check orders, scan and give meds, etc.
Luckily, we had Epic Rover installed on our hospital iPhones so we still had chart access through this. It was super slow but we managed.
There are rumors that people died because ventilators and life support shut off. This isn't true. Ventilators, IV drips, etc. have been and probabaly always will be manually programmed for this very reason.
Yeah, I could imagine that having medical equipment being accessible by outside computers could lead to some less then savory results with the existence of hackers
Can confirm as somebody that works in a hospital, All ventilators / IV pumps are standalone individual devices that do not connect to any type of internet, anything done to them has to be manual. If the computer in them stops working it has to be shipped out to be repaired or someone has to come out to repair it. I think the only things we have that connect with the internet are the vitals machines which sends the vitals information to the computer, our glucometers don't have Wi-Fi but whenever you plug them into charge they download the information into the system.
@@AtZ-2424There was a Grey’s Anatomy episode about this
Really?
Hmm if you're from my state that deployment for Epic Rover was barely 2 years ago. It was so bugged for us in patient transport I was constantly on call with IS and had to have several hotfixes to do my job. Kinda insane it was this used this way.
Me waking up this morning for my IT job managing 6 different corporate environments remotely. My inbox didn't work at all, and then was flooded with thousands of emails.
Jesus heckin' Christ this is not going to be a fun day for me at all.
So did you try turning it all off and back on?
Best of luck bro
Me waking up this morning reading the news with my coffee, having a near panic attack fearing for my work as an IT admin for several hospitals. Then realizing that it's my first of three weeks of vacation and sighing in relief 😂
Godspeed sir.
No wonder you're on CZcams right now, rather than doing that 😂
Same. I work for an international IT company and I am 1 of very few people who gets to play in 11 different ERP systems [dont get me started on that] and all the related tools which are different for each. I figured I'd have a really terrible day or really easy day if nothing worked. Oh and we use bit locker.
As a network engineer for a state government, this has been my time to shine.
Applying the fix to bring our hundreds of systems back up has been frustrating but it always reinforces why good IT practices are so important.
Oh, and every PC has bitlocker enabled. It's been an absolute nightmare
Username checks out?
You would rather not have full-disk encryption on the machines?
@EmperorMAP_PrideI can only imagine how sad you are in peraon
So lucky our company doesn't use CrowdStrike. I also work in IT and I thought today was about to be hectic 😂
Idk what you're getting paid, but you earned a raise!!
Here’s how I found out about this. I went to my local speedway and they posted all over the pumps “CLOSED, SYSTEM IS DOWN DUE TO MICROSOFT” and I knew I immediately had to come to mutahar
HA! Same thing happened at my Speedway, but I found out cause I work with banks!
Me working at speedway with nothing to do in the store cause of this right now.
we all here come to mutahar
Yeah he's generally one of my sources of tech related entertainment after getting over LTT.
@@sirfantasy7140 You not wrong, the one I went to had this guy walking in circles for a good minute.
I'm a truck driver that hauls AC liquid asphalt. I pulled up on the scale this morning to get loaded and their computers were down. They had to hand write the bill of lading and manually weigh me out. It was literally like 10 minutes faster of a process than having to wait for them to plug it into the computer and spit it out. 10/10, would recommend again.
True. Technology is not always good.
Right, it may have taken 10 minutes less for you but perhaps hours of more time for the rest of the process to be completed. That hand written bill and weight reading still needs to end up in a database somewhere as the data is likely used elsewhere.
@@mike406 I'm sure it is, but that's a them problem not a me problem. As long as I have to correct paperwork and hazmat handoff signature from the terminal to show to DOT if I'm stopped for an inspection I'm gone like Donkey Kong.
@@mike406 Except it can be put in a database without using the internet.
I work at a Credit Union, today was insane, only those working from home had almost full access to our systems. The amount of people calling in blaming us for this situation is ridiculous 💀
@EmperorMAP_Pridewhy did you wrote that using Mutaharese?
the fact anyone has full access from home just proves the software was never needed to begin with.
It's still your fault for paying for useless bloatware that doesn't work.
@@MrAllmightyCornholioz ignore emperor,it's a bot
Not surprised CZcams deletes mine and other people's comments but never touches the vile stuff written by these bots..
Imagine, I was sitting in a plane on my way to Berlin and half way there the pilot decided to fly back to my hometown Vienna because of the crash.
Everyone was confused af
Omg Luigikid
Confusion²
Wait did that happen or are you just saying imagine
Luigikid‼️
I was trying to go to Berlin today to see a friend I haven't seen in 2 years just to get this BS
"We test our updates in production "
-Crowdstrike probably
I wonder if they pay beta testers
That's how Chuck Norris does it.
@EmperorMAP_Pride no problem. I will just report you. You are welcome.
"I too like to live dangerously" - Austin Powers at Crowdstrike
Yes, but almost as bad as that every system that was affected also just trusts their updates without testing
It's surprising that it wasn't a ransomware that did it this time but instead from a cybersecurity company that made a faulty coding error. That is crazy.
thats what i thought this morning, especailly because on one of the computers in order to roll back software(before i knew it was a crowstrike issue) the computer wanted admin credentials for US Bank login. We are not us bank. Once I found out what was really going on my mouth dropped literally
Really makes you think just how vulnerable our infrastructure really is. Now that the testing is complete, lets see how long it takes for bad actors to capitalize.
@@uss-dh7909It genuinely astounds me how this shit ever gets not tested xD.
I think the term you are looking for is denial of service.
Psychologist: "Front view Mutahar isn't real, it can't harm you."
Front view Mutahar:
@Joseph-14411psychopath
He did it
DO I REDEEM OR NOT PYSCHOLOGIST SIR? DO I?
The lens flare over his left shoulder is the only thing preventing you from being vaporized instantly from viewing Mutahar in full frontal glory
Because of this, the factory I work at couldn't print labels for all the crates... And within 30 mins, all the new hires, myself included, got sent home.😂
half the world probably got sent back home today 😂
Some of mine got sent home too, i didnt get that lucky cuz all i had to do is leave a note "not registered in the system" after finishing testing the product
Sick!
@@qweetqci damn that sucks
Do you still get paid?
Woke up, took a shit, watched a John Hammond video and learned my work day was gonna be rough.
I think I watched that same video! 😂
Your mood for the day is set 😂
I work in IT for a very large enterprise.
The day started with a co-worker telling me about how this massive CrowdStrike bug is causing massive failures all over the world.
Meanwhile, all our systems were fine.
Why?
... We check every single update we push to our users in advance in virtual machines, and then later on actual work machines before pushing them out to users.
So, this was found, and not pushed.
Either that or we weren't using CrowdStrike at all.
Either way our incredibly important infrastructure was completely fine. We had barely any tickets. Calmest Friday I've seen in a while.
Edit: Yeah looks like we weren't using Crowdstrike.
Didn't realize it basically checked for updates at boot.
Wondering if something could've been done by using the DNS server to essentially say there's no IP to resolve to.
I'm sure there's a logical reason it couldn't be done even in a testing environment, but leaving that sort of testing to a third party like CrowdStrike really sounds like it was waiting to happen.
I don't know anything about computers, and my first thought was, didn't they even try it before sending out the update 😂
@@CrockbackColumbo exactly, how the f this bypass so many eyes.
@@CrockbackColumbo and it was supposedly a NULL pointer, literally one of the main beginner techniques that they teach you IN GOD DAMN C+ 101 lmao.
If you don't have the software suite licensed and deployed, then you wouldn't have CrowdStrike on your system at all. It is an Endpoint Protection Suite that must be manually deployed or automated through a script pushed by a cdn or server of some sort in nature. Just like BitDefender or Trend Micro.
Must be nice. We have to work over the weekend and our on call agent can’t even take a nap without the pager going off.
The one day where "have you tried turning it off and on again" isn't applicable 😂😂😂
But, have you tried? 😂😂😂
Except I have already seen a post where one of the ways to fix it was to reboot 15 times in a row :} so yeah "have you tried turning it on and off again?"!!!!
I hate to "Well, actually" but turning your PC off and on again repeatedly is one way to get into Windows recovery environment so you can boot in safe mode...I still like the joke though lol
@gff33-14 Reported your moon runes. Keep your hands off the children.
"we are living through a historical moment"
STOP WITH THE HISTORICAL MOMENTS FOR LIKE 2 WEEKS PLS UNIVERSE
Do you think this a coincidence? People are scrutinizing the botched secret security "blunder", trump just gave an hour and half speech...they don't want people talking right now.
LOOK AT THIS HISTORICAL COMMENT SUCH A HISTORICAL MOMENT
THIS WILL GO DOWN IN HISTORY!!!
@@jeffrrey6791I said wow, what an historic moment
You need a virtual machine for preventing a historical moment
I feel bad for people in hospitals affected by this or people whose flights got delayed. But at the same time I can't help but notice both how ridiculously fragile the world's infrastructure is, and that your average person is completely tech-inept and has no idea what Windows even is LET ALONE how to fix their computer!
And what we don't know yet: there are a s**tload of HVAC and facility management stuff, industrial control software ,etc that only run on Win. Often with outsoruced support. It can easily take weeks to sort this out and I don't even want to think about the total damage :(
I know enough about technology to know it’s going to be a shitty work shift tonight
There we probably around at least 10 emergency room devices that were affected in the hospital I was scheduled to go to today (IT healthcare worker). I really hope nobody died because of that...
This affected one of my patients negatively and massively delayed care. Our lab was so behind and doing things manually. I didn't get crucial labs back until HOURS later. Laboratory diagnostics are so important in guiding medical interventions. Oh and our tube system was down. Half the computers on my unit were worthless. This surely cost some people their lives.
@@reaperinsaltbrine5211 Now I say its much low level Linux stuff out there down to stuff like routers and decoders, no front end outside an web page or app. Here user base to fix it is much smaller. Now these systems is simpler but its still a lot of variations.
The IT team for the company I work for was crazy, the manager of IT called in his whole team a little after midnight last night and had them drive to all our locations and fix the problem before the morning shift started. Only a few remote users were left by shift start, and since all remote users were using virtual machines on-site, it wasn't as much of a pain. Also from what I heard from the IT person who came to our location, they just had a script they would run once they booted Windows in safe mode that would fix the issue. IT got to go home early (except for the IT manager who stayed to take care of any other IT-related issues) after not sleeping last night.
Bro your IT team deserves a raise for that, that's some heavy dedication to the job!
Considering I work at the airport, I noticed something was fucked last night. The moment I stepped into my office, ready to clock out for the night, and saw all 15 of our machines blue screening...yeah nope I turned around and peaced out.
That’s got to be a sight to see
And I’m guessing your reaction was
“Well that’s the night shifts problem”
Psst it meant you could clock off 5 minutes early
Based.
smart.
Bro was at ground zero
"the fur suits were not involved" somehow makes me less confident that this will get fixed quickly
We need the white foxes to save us from the black bears
e621 and furaffinity probably having record-low traffic today because everyone is stuck in the office trying to salvage this shit
@@CaptainPhantom6bruh
Right above your comment is a Furry commenting on their perspective of what happened
crowdstrike already rolled back the update... sucks for the ground troops though that have to reset their windows fleet.
These are the kinds of mistakes you read about in textbooks as examples of what not to do...
But it's absolutely terrifying that one company, making one update, can cause this much damage.
Truly. Between this and Boeing/Airbus duopoly, I am terrified as what these companies will "oopsie poopsie" next
Yeah one of my customers was going to go on a month long cruise but the plane was delayed because of this and the boat wouldn't wait for them.
If Microsoft pushed a bad update (and they have), it would be worse. This only affects Crowdstrike users. Home users and people who don't have Crowdstrike are not affected. It's a simple fix.
What is more terrifying is that so much infrastructure is relying on these systems. It's like an amusement park for skynet. lol
@@dropkickpherby6994 idk, but I do know this, I wouldnt want to be the whistleblower, because Boeing whistleblowers tend to um, all have expire dates
I used to work in a SOC that used CrowdStrike among other things. I got fired for arguing with management about their choice of tools being bad. Talk about feeling validated.
😂
You should email them "i told you so" 😂
@@sisamusudroka3000 in the Madseason voice :D
@@sisamusudroka3000 Can't even read it lmao
Even i mock the clients choices of tech they make us work on but.....its clients choice so why do i care.
I work in IT, so does my boyfriend, it's been going on since at least 10 last night
As one of my coworkers said, "this is what Y2K was supposed to be"
Yup I've been up since midnight 😢
@@The13thRoninbuuuut it’s so much cheaper to pay 2 people in a third world country 4 dollars a day than Edward the college educated professional software dev 47.25 an hour for a guaranteed product!
@@alarictheredboi276yearsago4 Did you factor in the cost of the lawsuits after you crash one billion computers worldwide?
@@alarictheredboi276yearsago4 Ya, that college graduate who barely scraped by with his degree through calling in favors would _totally not_ push an update he didn't fully understand, and this isn't another example of having too much infrastructure centralized.
Too bad those companies who double checked this update themselves, and caught the flaw so they didn't push the update also suffered from this. Oh wait...
Well Y2K is back in fashion...
I work at FedEx. This shut down our entire operation at pretty much every hub for over an hour. It's not just the office computers, it was also the stuff that manages things that help the facility run, the miles of belts that run through our facilities used to sort packages, various systems to verify flights and packages, and so on. So if your package going through FedEx is late for the next week or 2, that's why.
Bro yes I work for fedex express and this crash had us sweating
Well shucks
Jesus man that sucks.
I need my package my bro
For real my guy, I might need my shit
I can't even imagine the chaos that this misstep has caused. The magnitude of such a mistake is just enormous. The fix is indeed like y2k all over again. Really puts into perspective the fallout from even a small error in this hyper-connected world.
I work in corporate IT for an enormous company, I logged into work today, not realizing anything happened at all. You would’ve thought the world was ending if you were to listen to users. The high-level IT guys were pretty chill about what was going on once we realized. Honestly, we are more pissed that we seem to take more caution with our changes than they do, than anything else. I cannot adequately convey how unacceptable this is. Last week, my team nearly hunted down a product owner who wanted to push a change to production without testing for sport. We didn’t let him, we made him test it with us present, the update failed, as did the rollback. I cannot imagine the shitstorm that would’ve happened if we allowed this update to go out without testing it and it had crashed. That drop doesn’t even make it to the bucket of how big this crowd strike fuck up is.
At my company (one of the biggest international companies) it rolled out to random machines worldwide. I've been up since midnight. As just a taste, almost a thousand domain controllers were down. Not counting workstations, servers, ect..
"They don't take more caution than we do"... I'll take that bet.
We couldn't log in, had to write down our work hours on paper.
It happened ro us an hour past noon Philippines local time. We got startled because it started happening at first seemed randomly then it spread to the entire company. Then when we learned the AV update caused this we were annoyed specially when they gave us the resolution steps. Its so simple but heavy on leg work. Its kinda funny but annoying specially for the guys supporting this.
I also work corporate IT for a large company, and all I can think about is how many contracts they will lose over this. How many man hours will be wasted over this? It's massive!
Am I the only one exhausted with constant "unprecedented and historical" moments?
I feel this in my GenX soul 😂😂
A reply bot has been detected on this comment, please ignore it and report it. Don't interact with the bot it feeds off your attention! 74203
@@AUTTP-v4n W reply bot
Let us millennials have one half of a decade as normal please... I just can't take this anymore
@@thecompanioncube4211aw boohoo, baby cant handle life doing what its always done
I work in a blood bank at a major hospital and our blood banking and testing system is completely down. What a disaster.
wow.... fuck. a lot of patients gonna sue
Same, we have to reject patients because of it, we can't even give them an appointment time because that relies on Epic scheduling too
Damn. IT should've made the server push updates manually
@@NightridingDoom We do, thankfully, have a really detailed downtime procedure so everything is being recorded. But communication between us and the patient's care team is going to be difficult. They cant see our testing or if the test is still valid so its gonna be a whole lot of calls. Im off, but Im hearing all about it from my coworkers. Hope its up soon otherwise Ill be the one of two people to input everything over the weekend.
I really wish journalists emphasized how this affects healthcare too. Delayed flights are one thing, but patient lives are a different beast all together
Bro. I’m an it ops director for a hospital. Thank fucking god this shit didn’t affect us. That going to each workstation comment sent chills down my spine
the annoying bit? legally, it shouldn't be able to as almost every hospital database/computer SHOULD NOT be connected to the internet for reasons just like this and privacy breaches.
@@nathanielbass771 unfortunately, some of our fucking beds needs network connection. lol. Almost all of our medical equipment connects to the internet
I have lost count of how many historical moments I've gone through in this decade alone...
The last few have been comparatively _sleepy._
@@E4439Qv5 lag spike, all rubberbanding onto us now.
You have tiktok brain that's why you lost count
Watching John Oliver talk about how many bad things existed when Obama was at the end of his second term is almost a lullaby compared to today. So naïve, he hadn't even heard the dulcet tones of the opposing party's candidate yet.
Too many to actually believe it's historic let alone a coincidence. 🤔
Nothing more heartbreaking than coming into the office, witnessing a sea of bluescreens and then seeing yours boot up fine because you disabled auto update and shut it down before leaving on Thursday
Everyone else got a free morning and I i had to actually do my job 😂
Your "autoupdate disable" is not a thing that saved you. Because this driver is not provided by Microsoft, but by CrowdStrike via separate maintenance channel.
You probably just got late (which is kinda confirmed by you seeing sea of blue screens before you booted your PC) and CrowdStrike already disabled buggy patch on their side.
Or you just got lucky in some other way.
@@DimkaTsv Well, every PC that was off during the time they pushed the update booted up fine, at least at my work
As for the rest of them, though...
Y2K took 24 years, that's CRAZY
You know Quasimodo predicted all of this
I literally just watched a video about y2k
it's not about system clock, it's about the serious mishap
A reply bot has been detected on this comment, please ignore it and report it. Don't interact with the bot it feeds off your attention! 10359
24? you mean 25 years? its been 25 years since 1999
As a QA engineer, this is beyond my worst nightmare (though I've never worked for a company that has this kind of worldwide reach, nor do I want to). But mostly...HOW??? How was this not caught? I really want to know the details on the release validation and testing process...if they even have one.
Words are, the code was not updated but a datafile, which itself is tested.
The problem is, the signing process in the deployment pipeline failed, thus turning the otherwise correct file into a file containing only null values.
I'm not sure if it was all true, but regardless, a lack of canary channel and/or post-deployment testing is still a concern. Not to mention the actual code that didnt do validation on the datafile reading, which probably sitting there for a while.
imagine being the one who sign off that update and pressed the deploy button😂
Fired
Homer Simpson should be fine, this is how some of the episodes start.
I'm not imagining it being a guy.
What do you mean? That person probably doesn't exist anymore.
They've murdered *so* many hospital patients.
LOL with that light glare from behind it looked like MUTA saw Windows messed up again so he jumped on the video MID SHAVE 😂
A reply bot has been detected on this comment, please ignore it and report it. Don't interact with the bot it feeds off your attention! 21588
it wasnt actually windows, it was crowdstrike messing up big time
@@MinkSquared no no i know that but since it was only affecting Windows and MUTA is openly against that OS and always prefer Lunix thats why i said it.
Everywhere: CPU crashes due to update.
Japan: "our fax machine still works fine, what are talking about?".
lmao
What CPU? Intel? AMD? ARM?
Old tech ftw 😊
Germany and Japan's fax machines coming in clutch
I work in retail, every single one of our registers crashed. people could not buy ANYTHING so they gave up and just dumped their shopping carts full of stuff around the store and I had to put everything away from like 10 trolleys. I was the true victim of this crash 😔
thats yo job tho
@@stereotistik well usually my job is helping at the registers lol. But they just gave up on those and we were understaffed so it was the worst possible day it could have happened 😭
Honestly, monopoly laws should come into play here or new ones should be written because it is absolutely INSANE that almost every Air Service in the US and UK use the exact same security solution from the same company. One bad update and it knocked out all commercial air traffic in the western hemisphere. This was an accident, but you KNOW homeland security was absolutely shitting themselves before they discovered this was an actual bug and not an attack, and its still a very clear vulnerability.
At the very least there should be a law that states leaders in certain industries considered to be vital to the economy and infrastructure, like finance and transportation, should be required by law to have a certain percentage of their servers in more than one OS. If even 20% or 30% of the servers at the banks and airports were on Linux instead of Windows this wouldn't have nearly been as severe of an incident.
NAh...I think it's mostly just upper management buying buzzword BS...instead of asking someoen who actually in IT :/
And also they should not force push update in the large scale. I'm also view it as company's security department fault. The crash is instant if they just try the update in their department before push to the whole organization, they would know it instantly. The Crowdstrike ever make unix kernel panic (~Windows bsod) 2 month ago. But luckily that time, it's OS side fault. As user did not update OS at the same time, it is not affected mac/unix user in large scale. But this Crowdstrike/Security software often force real-time update lol when they're the on at fault, we're doom at the same time.
Monopolies ARE illegal in the U.S, but too many companies that HAVE become monopolies (Google/CZcams, for example) are extremely powerful, have hefty pull in politics via lobbying, and often are backed up by politicians and play a big role in society, to some extent.
Let's just hope someone in the upper ladder will notice that it's probably best not to use the same system everyone else is.
I feel like they have like 23% of the market in that type of software. But alot of big companies happen to use it. 23% is a good strong number but I wouldn't say that's a monopoly.
Shit gets serious when hospitals had to scale back operations and in some cases close the emergency first aid location
Lol same happened at my hospital, 😅
Dam that's scary
From my experience, ER is full of quacks who couldn't become real doctors so I imagine they don't need much of an excuse to close up early. At least, in the US
I work for one of the big tech companies here in Seattle. This caused so much chaos that it really revealed how fragile these companies are when something like this happens.
yeah it's like with AWS issues. you're at the mercy of the provider as far as their uptime. There needs to be more competition in the space.
When I heard about crash, I knew Papa Muta would be here to explain it to my dumb ass.
Daddy dystopian
Not an IT gal, but it’s absolutely FUCKED up the train system in the UK. I just wanna visit my grandma guys 😭
Your granny will live dw
@@heisenberg3206 Well, my grandpa is currently in the hospital with Covid
@@cdgonepotatoes4219 he will recover dw
@@cdgonepotatoes4219who asked?
@@rory9659 Who asked for your parents to conceive you?
5:58 Bro casually deleting all drivers 😂
A reply bot has been detected on this comment, please ignore it and report it. Don't interact with the bot it feeds off your attention! 87880
Well, if your computer doesn't start it can't get viruses :o)
Linux users: no drivers? Skill issue
I work in IT support and let me tell you we have a hundred pending calls at the moment. All requires a Bitlocker and a Startup repair while on Safe mode. This is definitely one of the worst days of my life.
Ugh. My primary job is IT. I'm currently working my 2nd job on my off days. I chose a bad time to quit smoking, hahahaha
Good luck man
YUUUP I work at a very small FedEx location and half of our systems required a bitlocker code and safe mode boot, have to locate and delete C-00000291 in system32 but the KICKER is that it is password protected and the ONLY way to get the password is to have it provided from a VERY small department. The bad thing is that most people are computer illiterate and I am certain that most of the calls being made to that department, they haven't even acquired their bitlocker code.... meanwhile I have been on the precipice of completion for hours and simply cannot get the information I need :(
@@josephwilliams1915 well keep it up! Quitting is hard but super worth it. Get 500 pieces of chewing. Gum. Every time you get the urge, chew a piece of gum. Eventually it will hurt to chew the gum. Keep chewing the gum when you get the urge so you associate pain either the nicotine urge. Ez!
Same, I've been up since midnight. My team handles automation the impact just to our systems has been insane
"5. If you're using Bitlocker jump off a bridge" fucking killed me lmao
that was hilarious
I hear MS is pushing Bitlocker to be on by default. The nightmares that should give people.
watching Muta in low pixel and low resolution camera is both a blessing and a curse
@@Zeyek1 😂
@EmperorMAP_Pridedude.. seek help
@@dertythegrower It's a bot, don't pay attention to them, just report and move on
I work in the LAX airport. I was forced to stay 4 hours overtime until morning shift came to relief us. It was a nightmare.
If you weren't paid, you should get some lawyer involved.
@@erc3338 overtime is always paid for.
CrowdStrike Intern: It was a virus
CrowdStrike scientist: THE UPDATE WAS THE VIRUS!
Yeup... I am 42 today and this is what I was greeted with in the morning on my birthday. Life.
Happy birthday friend. :)
happy birthday
Imagine boarding a flight while every monitor you walk past at the gate is BSOD’d lol
im at Atlanta airport and screens are literally bsoding and boot looping
"If we die, we die"
You're locked in and can't leave
Didn't have Crowdstrike in our office so we were safe, but that first hour when there were worldwide mystery BSODs before anyone realized the cause was Crowdstrike, was a stressful hour of paranoia and conspiracy.
My guy, when it started happening at my work, there were genuinely people thinking it was some sort of russian hacker attack to shield their invasion of a NATO country. Good man, we make cardboard packaging. What would they CONCEIVABLY gain by disrupting the Heineken cardboard packaging supply...
@@dontshanonau1335 decreasing morale by attacking beer infrastructure....
I was in an airport while it happened. Felt like actual purgatory being stuck in a humid crowd for hours.
How was the nightmarish experience?
Hopefully you could sit down, right?
I remember waiting at a small airport so packed we couldn't even sit on the floor, let alone on a seat. Everyone was within a foot of someone else.
If I had to deal with this outage during that, I would never fly again.
I work in IT for a government research facility and today was interesting to say the least. We manage over 1000+ devices and were split up into multiple smaller groups to go floor by floor, building by building going through the recovery process. It was the most tedious task I have ever done in my career. I never realized how many people use the gimmickiest mice and keyboards ever.
I help with my college IT team, woke up to 8-9 missed calls from the server team, glad to know I’m not the only one affected by this
I work at a freight forwarding company in the Philippines, and this crash just caused one of our major ports to halt its operations for hours. It's pretty bad.
What about the Gcash systems? My girlfriend there has been panicking a bit because she needed to pay someone ontime & it was weirdly affected all afternoon yesterday.
Here's the issue, we have to manually go into EVERY computer to put in the fix... However, to put in the fix we have to access our ya know access credentials, where we are also blue screened and not able to get... So were stuck in-between a rock and a hard place.
But this goes to show that most of our infrastructure should NOT be reliant on ONE single company, in any fashion. I mean remember AT&T, how 1/4th of everyones data was down? Or how 100s of millions just got their data stolen? What happend in Canada when a a SINGLE phone company went down, and 1/3rd of the population was screwed, and then this, half the world got molly woped. We. Should. Not. Be. Reliant. On. One. Company.
You will be reliant on Central Bank Digital Currency starting later this year, & you will not be happy.
I feel this. My company uses cyberark with MFA to get your personal Admin credentials. What a pain. The only real solution here is to have a local admin account on the PC. Which regulatory bodies will cry about to you in audits. We had to implement LAPS so that every computer has a local user account with a unique 16 character password that rotates every 30 days. So you aren't going to simply go computer to computer. Yo I have to search and recover the LAPS set password for every single PC to get in. Also combine that with bitlocker required on all computers.
It's almost like monopolies are bad.
Heh, I used to be in IT for a large company, IIRC around 50k users. When they build the machines they put a local account on them from the start, but the users don't get that account info, and you can't give it to them either. So even with a local account, booted into safe mode, a tech is still going to have to visit a LOT of PCs in person. Geographically, this encompasses the western half of the entire United States. :)
@@stringercorrales6627 well screw that tbh
I had to reschedule a dentist appointment to get a molar removed that broke at the gumline because their X-Ray machines don't work thanks to the crash.
I've never seen this before in my life, man.
why in the world does an X-ray machine run windows? XD
lol 🤣
Chill homie, this shit happens.
they didnt make you pay right? that would make me mad
This was a fun thing to clock into. My first week at Amazon has been fucked
A reply bot has been detected on this comment, please ignore it and report it. Don't interact with the bot it feeds off your attention! 52786
Are you still getting paid?
GGs
That’s a sign from god telling you to quit if anything
@@devalous8281no.. it isnt
This event illustrates how screwed we can be when our systems go down. Imagine what will happen if the Internet went away for a week or so.
linux is there for you, the problem is stupid windows and stupid antivirus messing things up because you have full access and administrator privileges with automatic updates to everything, even drivers
Being a registered gen-z, I can confirm that our default program *give_up_and_die.exe* and the optional *world_ending_depression.exe* will successfully execute when we stop getting our regular ping of doapmine from an online web server.
As for the iGen that came after us, they got stuck in a boot loop after waking up since their storage space is so small (thanks Apple) that they gotta boot from the network... and if the network is down... ._.
ace combat 7, Offline scenario
@@joedylan6311last hope moment without the ost
Ex-Y2K developer here. It was an issue for *some* companies and institutions (mostly banks) but it was nowhere near the issue the media blew it up to be, causing panic around the world. It was just a lot of leg work editing COBOL source code and some database rejigging.
😶
Also major airports and hospitals being stalled is a very big deal.
@EmperorMAP_Pride Wood chipper. Now
"it was nowhere near the issue the media blew it up to be"
That's because we took care of the problem before it became one.
The "I love you" virus was much much bigger than this
This situation truly emphasizes how even the smallest errors can have large-scale effects, especially in our technologically dependent world.
I work in IT Support. I was working the night shift when all of a sudden I got kicked out of my remote desktop and calls started pouring in. The rest of my shift SUCKED.
Did you try turning it off & back on?
Dude I work as night Audit at a hotel. I was cooked. It started as soon as I got into work and continued until I left and then some
IT guy: Working peacefully
Computers across the globe: adios
yup this was my day today
jesus that thumbnail
A reply bot has been detected on this comment, please ignore it and report it. Don't interact with the bot it feeds off your attention! 79848
😂😂
he looks cursed
bro looking at that last Pringle chip
I think that Sonichu medallion is starting to affect him, guys
Currently doing IT, but our local branch doesn’t use Crowdstrike, so I just spent a chunk of my day looking at the chaos unfold.
I work at a video game market research firm. We have 150 plus computers that use This software. I picked the worst day to sleep in.
I also am IT. pray for me
IT for a video game market research firm? That sounds pretty legit. Hiring? 😂
@@TheMetalGaia can't tell if you're being sarcastic but we just finished a round of hiring lol
Good luck man
I may be interested 👀 any networking positions?
@@courtlandbudd7462 lol I work in IT, not currently looking but the company sounds interesting
"CrowdStrike" sounds like the name of a vulnerability that would have mass impact...
Maybe that's the point?
Clocked in this morning, immediately was pulled into a meeting and then was told to clock back out. This is crazy
I work as a student worker at the IT department at my university. All computers that were turned on in the entire campus had blue-screened. Apparently my superiors were on the campus at 3-4 in the morning!! We had to go into the recovery tool and restart the computer in safe mode to fix it, by deleting the corrupted file in CrowdStrike's driver files. It's funny because for the past few months we just transitioned to using CrowdStrike from our old antivirus software. We had literally spent the past few months installing CrowdStrike on all the computers on the campus, and then this happens, lol
This is what I think of when the Senior Dev tells me why Interns work in test not prod.
Banks, news organisations and airports go down. Amazed how people stayed so calm especially with geopolitics atm
Its the 2020s. Shit happens
Eh, not as bad as country wide "peaceful protests" per say. It sucks, but it was what it is. We shut the world down for months over a cold, this is nothing...
@@Valkbg Exactly, it would take something otherworldly to amaze people nowadays.
Plus, it's Friday, we chill on Friday haha
It's actually nice to see. Turns out that modern society isn't as weak as people sometimes claim.
One of the fixes, that my company just finished, is go into the driver's, and force revert them to the previous version. Takes a solid ten minutes per machine.
I know someone that works in a hospital, and they said almost all of their computers were down. They had to cancel all surgeries that weren't urgent.
Dude, anxiety shit is messing with me so much atm but that “Hello fellow Zoom meeting friends” intro caught me off guard enough to crack me up even through a small panic attack. I fucking adore Muta’s content.
How fitting that NSync plays over the speakers in the gym just as Muta mentions Y2K.
In New Zealand which is almost a cashless society public transport systems, supermarkets, banks. POS Terminals at retailers and restaurants, Parliament systems went down for the whole of Friday night.
That's terrible. I'm so glad I don't go out on Friday nights so I had no idea. I'm about to walk into work and see if our Infinity system was affected or not...
Is it better now? Idk if I should bother going to new world atm with this going on
@@-_-NiX-_-99-_- not sure about Woolworths but their systems were affected from an email from our IT. EFTPOS was affected but their issues has been resolved already
I am a caregiver, computers were down so we couldnt properly log times and passes for medications. Imagine how much worse it is for other industries especially in the medical field.
"Some Customers were Affected" my soggy asshole
Oh look, three tools you can use without a computer. Clipboard, paper and pen.
@@zerotodona1495Don't be a dick, it makes things exponentially more difficult. Just because it CAN be done doesn't mean it should be/needs to be.
If you are dying on the table and they need a specific, obscure drug to save you it is much better if they can just quickly search it on a computer VS reading through a pole of books to maybe find what is needed.
Or is your Boomer pride so dominant you'd rather just die out of principle?
Tsk Tsk, do better.
This kind of thing happened a few years ago in Canada. Rogers, one of the "Big 3" Telecom companies in the country, pushed an update to their servers. And the person doing that, didn't properly check the update before uploading it. The update brought down all of their servers, and this affected not just phones, internet and TV, but POS debit/credit machines as well. There's a couple YT videos out there showing what happened and how it happened.
The flip side is the fix was server side and not client side so it was "easier" to fix and things were only down for about a day.
I remember that!
Yeah. The reasons debit cards went down is because Interac uses Rogers servers and when Rogers goes down debit cards go down but credit cards work most times since they don't use Interac debit. Interac should switch to a better ISP tbh since about a year ago all debit card purchases went down because Rogers went down for about a day
Mutahar is Canadian and he has talked about that
@@rabikhan589 ...I'm a dumb... right forgot about that.
I went to my local barber shop and they said they can’t cut my hair because of this - this is a catastrophe!
Are the clippers on WIFI?
😂😂😂😂😂😂😂😂😂 @@not_glad
@@not_glad welcome to the 2020s where mankind is dependent on the Internet
@not_glad card payments require Internet these days.
If you were close with ur barber he would trust u to pay later if u didn't had cash
When Muta says Crowdstrike because of the janky set up, it almost sounds like CloudStrife lol
Lol, he calls it cloudstrike in the description
@@weeviler Limit Break did a bit more damage than intended
edit: apparently fake, kudos to the dude who made it. and is even spreading further currently. lots of simple things that didnt directly disprove it till you went out of that specific thing.
the guy who shoved the update out actually explained what was the cause. he did a code "optimization" on his first day, tested it only on 1 computer and then shipped it. a lot of these kind of software in my knowladge are always doing layered tests to see if the build broadly works across a good set of different setups to prevent this. the fact he only did it on 1 without coordinating with anyone is baffling to me.
wow thats insane. IM very new to IT and even I know thats a terrible idea.
Who wants to take bets on whether this guy still has a job.
@@unexplained_entity7514 spoilers
the tweet of him talking about is fuck up, he was already fired and waiting for his termination docs.
What's his twitter handle?
@@gabrielasanchez2028 vinceflibustier
I work on a firstline IT support desk for a governmental body - we didn't get a single ticket for this. It was eerily silent most of the day 😭. Our desk being so quiet yet watching the news explode was like Yoda feeling billions of people die at once while you're just sat in the office miles away, chilling.
@@Iron_Stigmata At my company thankfully the update had not fully rolled out so there was only (my guess) a couple thousand machines, servers, domain controllers, ect... effected globally. I feel really bad for the first level tech support people. Even up at the application team level it's been crazy. Got woken up at midnight. Lol
@@djstringsmusic2994 as a supervisor of a first level desk, I appreciate the respect 😂. I'm glad this one missed us. Normally it's like being in the trenches when this sort of thing happens.
Same! 💀😂
@@sytonicflux It's worse than that. Most crops have varieties sensitive to different conditions. But everyone grows bananas which are genetic clones. One vulnerability damages every banana plant across the planet, unless you kept some in quarantine (eg. disconnected/shutdown PCs).
Front facing Muta jumpscare aside, I was kinda expecting him to cover this. The only reason I knew of CrowdStrike before was when they were the main sponsor for 24 Hours of Spa, which uh... with a name like that sponsoring a well known and dangerous racing event known for a lot of crashes, that really puts the fear of God in anyone.
Same lol and from Merc's car in F1 which has a crowdstrike logo on it
@@theairaccumulator7144 Probably not for much longer. 😂
Mutuhar’s having a field day with all this computer craziness going on this week alone.
WiFi and Mobile Data went completely off in our county for two days. Least stressful two days in the past month. Busted out the blue ray and watched some nostalgic DVDs.
Hey Microsoft, Y2K called saying you're 24 years late to the party. Lol
This isn't Microsoft, this is CrowdStrike a security software company.
@@captainblood9616 yea but it affected only Windows users that have Crowdstrike. Apple users are safe 😇
@@toxicgracie3772 But that's not Microsoft's fault though they didn't tell Crowdstrike to release a faulty update.
@@toxicgracie3772 thank god i do not have crowdstrike, i never installed it anyway
@@toxicgracie3772 I'd rather go through this occasionally than ever use a mac
I had a feeling something was going on today. Went to the gas station and then the grocery store and they both had signs up about their "computer" or "Microsoft", respectively.
I'm so glad I disabled auto-update.
Same, never liked auto update
Unless you got Crowdstrike, normal consumer products should be fine
Me too. I ran into a few web page error's that seemed off to me.
Turning off auto update didn't stop it.
Crowdstrike manually sent the update through a separate channel lol. That's why everyone got pwned at the same time.
it wasn't a microsoft update that caused it, crowdstrike pushed an automatic update.
This kind of shit is exactly why entire infrastructures should NOT be totally dependent on computers to perform basic functions.
You know, this reminded me: the State of Tennessee upgraded all of their computer systems back in April - from DOS to Windows. (That is not a joke - they were still using CHUI DOS.)
Everyday Cyberpunk becomes closer to reality
Idk between the intensive scale of banks, flights, and especially healthcare I'd say computers are completely warranted. Now, relying on exclusively one company for all of the above is definitely where I'd draw the line
@@warlordofbritannia netrunners
@@HastelloyC276
I’ll go further: furry netrunners
Microsoft: "But we NEED to have a monopoly so we can give people the best service!"
Also Microsoft: *BSOD's the entire world at once*
United States: Lawsuits go brrrrrrrrr
Technically MS wasn't at fault (beyond the philosophical arguments about OS kernel design generally) but it definitely exposed a single-point-of-failure in a wide swath of systems.
This was CroudStrike's fault entirely and not Microsoft's... Did you even look into this or are you just regurgitating nonsense that the news told you. Google it. CroudStrike.
This also could happen to kernel level anti-cheats. Such as the one for Call of Duty and Siege. Keep that in mind.
That's why siege was down!
that's why i dont play such games
It actually happened to me. The anti cheat software of Valorant was fighting with signalrgb in my system. It didn't let it run but didn't stop it fully maybe. Whatever happened my system was looking like a rave party. Uninstalled Valorant and everything went back to my normal dual color wave.
Kernel level? Popcorn kernel? 😊
i think something like this can happen with just about any software