IT outages are reported across the world
19-07-2024, 13:33
|
#16
|
|
Grumpy Fecker
Join Date: Jul 2007
Location: Warrington
Age: 65
Services: Every Weekend
Posts: 16,951
|
Re: IT outages are reported across the world
Quote:
Originally Posted by Kursk
It is de rigueur on this forum to blame the Government for everything. I am hoping to boost my popularity and reputation by getting in first.
|
|
|
|
|
19-07-2024, 14:10
|
#17
|
|
Do I care what you think
Join Date: Jul 2006
Location: Cardiff South Wales
Age: 74
Services: V6 ,Virgin L. Phone Broadband.sky go Netflix
Posts: 5,043
|
Re: IT outages are reported across the world
Don't worry it couldn't happen to your password manager !
__________________
No point in being pessimistic. You know it won`t work.
|
|
|
|
|
19-07-2024, 14:30
|
#18
|
|
An Awesome Dude
Join Date: Mar 2009
Posts: 4,811
|
Quote:
Originally posted by Sirius
From what i heard it did not affect personal PC's running windows.
|
I read on CD earlier people on Win11 were getting BSODs,,,
I hope everything is better now!!
|
|
|
|
|
19-07-2024, 16:01
|
#19
|
|
Dr Pepper Addict
Cable Forum Team
Join Date: Oct 2003
Location: Nottingham
Age: 62
Services: Aquiss FTTP (900M), Sky Q TV, Sky Mobile, Flextel SIP
Posts: 29,563
|
Re: IT outages are reported across the world
Faulty update to Anti-Virus software.
The update was released by Crowdstrike overnight, so most systems failed this morning.
Basicially they crashed with the good old Blue Screen of Death.
The fix apparently involves one file.
__________________
 Baby, I was born this way.
|
|
|
|
|
19-07-2024, 17:02
|
#20
|
|
-.- ..- .-. ... -.-
Join Date: Mar 2008
Location: Island of Strangers
Posts: 2,957
|
Re: IT outages are reported across the world
Quote:
Originally Posted by Sirius
|
In all seriousness though, shouldn't we have seen at least one Government minister providing reassurance on this global catastrophe? Millions of people affected (many with no idea about the impacts) and not even a peep out of the Government 
Perhaps they've forgotten they are now in charge.
|
|
|
|
|
19-07-2024, 17:07
|
#21
|
|
Trollsplatter
Join Date: Jun 2003
Location: North of Watford
Services: Humane elimination of all common Internet pests
Posts: 38,047
|
Re: IT outages are reported across the world
Quote:
Originally Posted by Paul
Faulty update to Anti-Virus software.
The update was released by Crowdstrike overnight, so most systems failed this morning.
Basicially they crashed with the good old Blue Screen of Death.
The fix apparently involves one file.
|
I’m reading that to fix it you have to boot into safe mode and delete a single .sys file. But also that there is no remote fix, because without safe mode the PC just goes into an endless loop of reboots. So corporate users big enough to have in-house IT support will get up and running again soon enough, but private and small business users are screwed unless they buy support or are confident enough to find and follow online instructions. Many will be able to do this, many more will not.
I predict there will be a class-action lawsuit against Crowdstrike before the week is out.
---------- Post added at 17:07 ---------- Previous post was at 17:03 ----------
Not being a windows expert (or even a windows user) I can’t vouch for the veracity of this, but I am seeing multiple posts across the interwebs saying the manual fix is:
1. Boot Windows into Safe Mode or WRE.
2. Go to C:\Windows\System32\drivers\CrowdStrike
3. Locate and delete file matching "C-00000291*.sys"
4. Boot normally.
|
|
|
|
|
19-07-2024, 17:48
|
#22
|
|
Dr Pepper Addict
Cable Forum Team
Join Date: Oct 2003
Location: Nottingham
Age: 62
Services: Aquiss FTTP (900M), Sky Q TV, Sky Mobile, Flextel SIP
Posts: 29,563
|
Re: IT outages are reported across the world
Quote:
Originally Posted by Chris
1. Boot Windows into Safe Mode or WRE.
2. Go to C:\Windows\System32\drivers\CrowdStrike
3. Locate and delete file matching "C-00000291*.sys"
4. Boot normally.
|
That looks reasonable.
__________________
Baby, I was born this way.
|
|
|
|
|
19-07-2024, 18:50
|
#23
|
|
cf.mega poster
Join Date: Feb 2012
Posts: 4,725
|
Re: IT outages are reported across the world
I am surprised that any global updates are not pushed out in waves to assess impact of initial deployments.
__________________
Unifi UCG Ultra + Unifi APs | VM 1Gbps
|
|
|
|
|
19-07-2024, 20:22
|
#24
|
|
067
Join Date: Jul 2007
Location: Middlesbrough
Age: 49
Services: Many
Posts: 4,985
|
Re: IT outages are reported across the world
Well that was a day and a half !!!!
---------- Post added at 20:22 ---------- Previous post was at 20:21 ----------
Quote:
Originally Posted by Paul
That looks reasonable.
|
That is the fix from crowdstrike and it works just fine
__________________
Nerves of steel, heart of gold, knob of butter......
|
|
|
|
|
19-07-2024, 21:37
|
#25
|
|
Architect of Ideas
Join Date: Dec 2004
Posts: 11,146
|
Re: IT outages are reported across the world
Contactless payments were fine at Troon which was the extent of my IT use for the day.
Does seem slightly worrying that a minor error can have such significant consequences.
|
|
|
|
|
19-07-2024, 21:50
|
#26
|
|
The Dark Satanic Mills
Join Date: Dec 2003
Location: floating in the ether
Posts: 12,980
|
Re: IT outages are reported across the world
Quote:
Originally Posted by jfman
Contactless payments were fine at Troon
|
Not jealous much.
Although, at halfway a couple of my bets are still live.
__________________
The wheel's still turning but the hamsters dead.
|
|
|
|
|
19-07-2024, 22:13
|
#27
|
|
Dr Pepper Addict
Cable Forum Team
Join Date: Oct 2003
Location: Nottingham
Age: 62
Services: Aquiss FTTP (900M), Sky Q TV, Sky Mobile, Flextel SIP
Posts: 29,563
|
Re: IT outages are reported across the world
Quote:
Originally Posted by ianch99
I am surprised that any global updates are not pushed out in waves to assess impact of initial deployments.
|
More to the point, you would think they would check a machine still works after being updated (and rebooted) before pushing it out to anyone.
__________________
Baby, I was born this way.
|
|
|
|
|
19-07-2024, 22:35
|
#28
|
|
067
Join Date: Jul 2007
Location: Middlesbrough
Age: 49
Services: Many
Posts: 4,985
|
Re: IT outages are reported across the world
Quote:
Originally Posted by Paul
More to the point, you would think they would check a machine still works after being updated (and rebooted) before pushing it out to anyone.
|
A reboot wasn’t required to trigger, the csagent.sys file faulted in non paged and put machines into a boot loop
Our biggest headache was walking people on physical laptops through deleting the file as bitlocker caused some fun
AVD & w365 we just restored
Servers we automated the fix
__________________
Nerves of steel, heart of gold, knob of butter......
|
|
|
|
|
20-07-2024, 12:11
|
#29
|
|
Grumpy Fecker
Join Date: Jul 2007
Location: Warrington
Age: 65
Services: Every Weekend
Posts: 16,951
|
Re: IT outages are reported across the world
I must admit as a Linux user this was me yesterday 
https://x.com/i/status/1814235168363987221
|
|
|
|
|
20-07-2024, 12:36
|
#30
|
|
cf.mega poster
Join Date: Feb 2012
Posts: 4,725
|
Re: IT outages are reported across the world
Quote:
Originally Posted by Paul
More to the point, you would think they would check a machine still works after being updated (and rebooted) before pushing it out to anyone.
|
Yes, of course, pre-roll out testing is a given and I do not understand why this was not done for a enterprise-grade production deployment.
What is flawed is the lack of a phased roll out to assess impact of new delivery. I am guessing that this update came via a Crowdstrike update process rather than Microsoft Update. This is why Microsoft is not really getting the heat for this.
I do not think Linux or MacOS would have been taken down this easily although I may be wrong.
__________________
Unifi UCG Ultra + Unifi APs | VM 1Gbps
|
|
|
|
|
Currently Active Users Viewing This Thread: 1 (0 members and 1 guests)
|
|
|
Posting Rules
|
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts
HTML code is Off
|
|
|
All times are GMT +1. The time now is 13:54.
|
Join CF
You are here: 
