Re: IT outages are reported across the world
 

:LOL:

Re: IT outages are reported across the world
 

Don't worry it couldn't happen to your password manager !

I read on CD earlier people on Win11 were getting BSODs,,,

I hope everything is better now!!

Re: IT outages are reported across the world
 

Faulty update to Anti-Virus software.

The update was released by Crowdstrike overnight, so most systems failed this morning.

Basicially they crashed with the good old Blue Screen of Death.

The fix apparently involves one file.

Re: IT outages are reported across the world
 

In all seriousness though, shouldn't we have seen at least one Government minister providing reassurance on this global catastrophe? Millions of people affected (many with no idea about the impacts) and not even a peep out of the Government :mad:

Perhaps they've forgotten they are now in charge.

Re: IT outages are reported across the world
 

I’m reading that to fix it you have to boot into safe mode and delete a single .sys file. But also that there is no remote fix, because without safe mode the PC just goes into an endless loop of reboots. So corporate users big enough to have in-house IT support will get up and running again soon enough, but private and small business users are screwed unless they buy support or are confident enough to find and follow online instructions. Many will be able to do this, many more will not.

I predict there will be a class-action lawsuit against Crowdstrike before the week is out.

---------- Post added at 17:07 ---------- Previous post was at 17:03 ----------

Not being a windows expert (or even a windows user) I can’t vouch for the veracity of this, but I am seeing multiple posts across the interwebs saying the manual fix is:

1. Boot Windows into Safe Mode or WRE.
2. Go to C:\Windows\System32\drivers\CrowdStrike
3. Locate and delete file matching "C-00000291*.sys"
4. Boot normally.

Re: IT outages are reported across the world
 

That looks reasonable.

Re: IT outages are reported across the world
 

I am surprised that any global updates are not pushed out in waves to assess impact of initial deployments.

Re: IT outages are reported across the world
 

Well that was a day and a half !!!!

---------- Post added at 20:22 ---------- Previous post was at 20:21 ----------

That is the fix from crowdstrike and it works just fine

Re: IT outages are reported across the world
 

Contactless payments were fine at Troon which was the extent of my IT use for the day.

Does seem slightly worrying that a minor error can have such significant consequences.

Re: IT outages are reported across the world
 

Not jealous much.

Although, at halfway a couple of my bets are still live.

Re: IT outages are reported across the world
 

More to the point, you would think they would check a machine still works after being updated (and rebooted) before pushing it out to anyone.

Re: IT outages are reported across the world
 

A reboot wasn’t required to trigger, the csagent.sys file faulted in non paged and put machines into a boot loop

Our biggest headache was walking people on physical laptops through deleting the file as bitlocker caused some fun

AVD & w365 we just restored

Servers we automated the fix

Re: IT outages are reported across the world
 

I must admit as a Linux user this was me yesterday :)

https://x.com/i/status/1814235168363987221

Re: IT outages are reported across the world
 

Yes, of course, pre-roll out testing is a given and I do not understand why this was not done for a enterprise-grade production deployment.

What is flawed is the lack of a phased roll out to assess impact of new delivery. I am guessing that this update came via a Crowdstrike update process rather than Microsoft Update. This is why Microsoft is not really getting the heat for this.

I do not think Linux or MacOS would have been taken down this easily although I may be wrong.