Cable Forum

Cable Forum (https://www.cableforum.uk/board/index.php)
-   General IT Discussion (https://www.cableforum.uk/board/forumdisplay.php?f=19)
-   -   Facebook Outage (https://www.cableforum.uk/board/showthread.php?t=33710426)

Paul 04-10-2021 18:19
Facebook Outage
 
My daughter was moning her whatsapp wasnt working.

I could not find any issues with our network, so we went to search google, and found news of a major outage on Facebooks network.

https://www.independent.co.uk/life-s...-b1932059.html

Quote:
WhatsApp, Instagram and Facebook have all gone down in a major outage.

The three apps – which are all owned by Facebook, and run on shared infrastructure – all completely stopped working shortly before 5pm.
Other products that are part of the same family of apps, such as Facebook Workplace, also stopped working.

Mr K 04-10-2021 18:23
Re: Facebook Outage
 
Oh dear, an hour without social media it will result in many breakdowns...

Taf 04-10-2021 18:43
Re: Facebook Outage
 
Quote:
Originally Posted by Mr K (Post 36095805)
Oh dear, an hour without social media it will result in many breakdowns...
It's over 2 hours now. Quite unusual, and it's global.

Carth 04-10-2021 18:54
Re: Facebook Outage
 
Quote:
Originally Posted by Taf (Post 36095811)
It's over 2 hours now. Quite unusual, and it's global.
aaah, that explains why my local newspaper (and I use the term newspaper in the loosest possible terms) haven't got lots of new and uninteresting articles/stories today.

Not saying that all the new intrepid reporters just seem to write copy stuff from facebook & twitter, but . . .

BenMcr 04-10-2021 19:36
Re: Facebook Outage
 
Oops.

https://twitter.com/briankrebs/statu...426718725?s=19
Quote:
Confirmed: The DNS records that tell systems how to find Facebook.com or Instagram.com got withdrawn this morning from the global routing tables. Can you imagine working at FB right now, when your email no longer works & all your internal FB-based tools fail?

pip08456 04-10-2021 20:04
Re: Facebook Outage
 
1 Attachment(s)
Quote:
Originally Posted by BenMcr (Post 36095820)
That appears to be a symptom of the actual issue.

https://www.cableforum.uk/board/atta...6&d=1633374046

Taf 04-10-2021 20:30
Re: Facebook Outage
 
1 Attachment(s)
..

jfman 04-10-2021 21:02
Re: Facebook Outage
 
Quote:
Originally Posted by Carth (Post 36095814)
aaah, that explains why my local newspaper (and I use the term newspaper in the loosest possible terms) haven't got lots of new and uninteresting articles/stories today.

Not saying that all the new intrepid reporters just seem to write copy stuff from facebook & twitter, but . . .
Didn’t know you read the same local paper as me ;)

What will the Facebook mums do after the school run if this isn’t fixed by morning?

Hugh 04-10-2021 21:18
Re: Facebook Outage
 
1 Attachment(s)
https://krebsonsecurity.com/2021/10/...gram-whatsapp/
Quote:
Doug Madory is director of internet analysis at Kentik, a San Francisco-based network monitoring company. Madory said at approximately 11:39 a.m. ET today (15:39 UTC), someone at Facebook caused an update to be made to the company’s Border Gateway Protocol (BGP) records. BGP is a mechanism by which Internet service providers of the world share information about which providers are responsible for routing Internet traffic to which specific groups of Internet addresses.

In simpler terms, sometime this morning Facebook took away the map telling the world’s computers how to find its various online properties. As a result, when one types Facebook.com into a web browser, the browser has no idea where to find Facebook.com, and so returns an error page.

In addition to stranding billions of users, the Facebook outage also has stranded its employees from communicating with one another using their internal Facebook tools. That’s because Facebook’s email and tools are all managed in house and via the same domains that are now stranded.

“Not only are Facebook’s services and apps down for the public, its internal tools and communications platforms, including Workplace, are out as well,” New York Times tech reporter Ryan Mac tweeted. “No one can do any work. Several people I’ve talked to said this is the equivalent of a ‘snow day’ at the company.”
Also…

https://www.cableforum.uk/board/atta...9&d=1633378853

idi banashapan 04-10-2021 21:19
Re: Facebook Outage
 
good god, how are people coping? I hope everyone is ok.

Hom3r 04-10-2021 21:34
Re: Facebook Outage
 
VM are struggling as well


https://downdetector.co.uk/status/virgin-media/map/

nffc 04-10-2021 21:38
Re: Facebook Outage
 
So where is everyone going to post fuel tanker panic updates now?


Also, it really does look to me like someone's hosed the DNS records from inside, whether that's a misconfiguration by accident or if someone's done it to take it offline, will remain to be seen.

Hom3r 04-10-2021 21:40
Re: Facebook Outage
 
2 Attachment(s)
I had 7 days without FB thanks to the rubbish bots, that don't get the way things are meant.

I mean you can have friendly abuse that has no malice, but FB cannot detect that, it sees bullying.

But on the bright side they lost $50b off it value :D

Hom3r 04-10-2021 21:44
Re: Facebook Outage
 
If you check this link, it appears that many other sites have suffered outages at the same time.


https://downdetector.co.uk/

Jaymoss 04-10-2021 22:02
Re: Facebook Outage
 
yeah my gmail is not sending/receiving even tested between 2 accounts and nothing

Hugh 04-10-2021 22:02
Re: Facebook Outage
 
Quote:
Originally Posted by Hom3r (Post 36095844)
If you check this link, it appears that many other sites have suffered outages at the same time.


https://downdetector.co.uk/
From the Washington Post
Quote:
It’s also possible the outage was affecting other Internet services, Nash* said. When the services went down, so many users tried to load the sites that it caused a run on traffic on the Internet’s DNS infrastructure.

“The reason these failures are so crazy is because there’s so much interconnectiveness of the Internet we rely on,” Nash said.
* Courtney Nash, senior research analyst at security company Verica.

idi banashapan 04-10-2021 22:03
Re: Facebook Outage
 
someone is going to be called into a rather serious meeting with HR present in the morning.

Hugh 04-10-2021 22:04
Re: Facebook Outage
 
A meeting with no coffee…

Hom3r 04-10-2021 22:05
Re: Facebook Outage
 
Quote:
Originally Posted by idi banashapan (Post 36095852)
Someone is going to be called into a rather serious meeting with HR present in the morning.

Well I know that these updated have an off-line test to check them, but the real world is different.

Hugh 04-10-2021 22:18
Re: Facebook Outage
 
1 Attachment(s)
I, for one, welcome our new cybernetic overlords…

https://www.cableforum.uk/board/atta...3&d=1633382245

Jaymoss 04-10-2021 22:55
Re: Facebook Outage
 
And it is back

Chris 04-10-2021 22:57
Re: Facebook Outage
 
Quote:
Originally Posted by Jaymoss (Post 36095862)
And it is back
Not here it isn’t …

If it’s been a DNS fail it’ll take a while for everyone to reconnect.

Jaymoss 04-10-2021 23:53
Re: Facebook Outage
 
When I posted that I had got a whatsap message and then check FB and working. All seems to be up here now

Paul 05-10-2021 00:01
Re: Facebook Outage
 
Quote:
Originally Posted by Chris (Post 36095863)
If it’s been a DNS fail it’ll take a while for everyone to reconnect.
In theory, it shouldnt - its actual DNS changes that take a while to propergate, due to TTL.
But if DNS simply fails due to the source servers being down, then it shoud all start working again as soon as the source servers are up.

Of course, they may get overloaded to start with.

That said, some of the reports suggest BGP changes were the problem.
In that case it can take time for more changes (ie fixes) to find their way to all routers.

Carth 05-10-2021 00:05
Re: Facebook Outage
 
hmmm . . I'm wondering if I can block facebook through the router (tplink) settings . . her indoors would just think it was still down :D

pip08456 05-10-2021 00:07
Re: Facebook Outage
 
Quote:
Originally Posted by nffc (Post 36095842)
So where is everyone going to post fuel tanker panic updates now?


Also, it really does look to me like someone's hosed the DNS records from inside, whether that's a misconfiguration by accident or if someone's done it to take it offline, will remain to be seen.
There is nothing wrong with teh DNS records. They still exist but systems can't access them due to a config update on the BGP routing.

As Hugh posted,
Quote:
someone at Facebook caused an update to be made to the company’s Border Gateway Protocol (BGP) records. BGP is a mechanism by which Internet service providers of the world share information about which providers are responsible for routing Internet traffic to which specific groups of Internet addresses.

OLD BOY 05-10-2021 07:53
Re: Facebook Outage
 
https://www.irishtimes.com/business/...ange-1.4691536

[EXTRACT]

Facebook, Instagram and WhatsApp are now back up and running after being shuttered by a global outage on Monday.

The widespread disruption was blamed on a “faulty configuration change”, with Facebook saying in a statement:

“Our engineering teams have learned that configuration changes on the backbone routers that coordinate network traffic between our data centres caused issues that interrupted this communication.

“This disruption to network traffic had a cascading effect on the way our data centres communicate, bringing our services to a halt.”

The company in a late Monday blog post did not specify who executed the configuration change and whether it was planned.

Several Facebook employees who declined to be named had told Reuters earlier that they believed that the outage was caused by an internal mistake in how internet traffic is routed to its systems.

The failures of internal communication tools and other resources that depend on that same network in order to work compounded the error, the employees said. Security experts have said an inadvertent mistake or sabotage by an insider were both plausible.

“We want to make clear at this time we believe the root cause of this outage was a faulty configuration change,” Facebook said in the blog.

Halcyon 05-10-2021 09:58
Re: Facebook Outage
 
Quite a few sites were very slow yesterday.


Things seem ok this morning though.

Mick 05-10-2021 11:06
Re: Facebook Outage
 
Didn’t even notice/miss it. Don’t have WhatsApp, Instagram. Might log in to Facebook once a week.

Paul 05-10-2021 15:21
Re: Facebook Outage
 
Quote:
Originally Posted by Mick (Post 36095920)
Didn’t even notice/miss it. Don’t have WhatsApp, Instagram. Might log in to Facebook once a week.
I dont use instagram at all, the only time I use whatsapp is when my kids want to send me pictures from their phone. I probably look at facebook twice a week.

The only reason I knew was my daughter was having trouble connecting to whatsapp, so asked me to take a look.
Having determined it was a WA issue and not our network, I went on to google and came across the outage reports.


All times are GMT +1. The time now is 01:13.

Powered by vBulletin® Version 3.8.11
Copyright ©2000 - 2025, vBulletin Solutions Inc.
All Posts and Content are © Cable Forum