Cable Forum

Cable Forum (https://www.cableforum.uk/board/index.php)
-   Virgin Media Internet Service (https://www.cableforum.uk/board/forumdisplay.php?f=12)
-   -   MAJOR NETWORK ISSUE (17 Jan 2012) (https://www.cableforum.uk/board/showthread.php?t=33684721)

Peter_ 19-01-2012 10:44

Re: MAJOR NETWORK ISSUE (17 Jan 2012)
 
Quote:

Originally Posted by rmwebs (Post 35365415)
I'm guessing that means it wasn't some sort of switch failure then...is the 'business sensitive' information good or bad news?

As it was not published we cannot go into any detail.

Sephiroth 19-01-2012 11:11

Re: MAJOR NETWORK ISSUE (17 Jan 2012)
 
I can imagine what's sensitive. The opposition would seize on any information that might lead them to conclude and expose insuffient resilience on VM's part.

As many techies will know, you can algorithmically re-route when there is a node failure; this put pressure on other nodes but is in any case standard everywhere these days.

Plus you can put in physical resilience so that another device takes over with the same IP address in case of failure of a key device. I suspect that didn't happen. If there is a site failure then, of course, this measure is not effective).

The trick is to do proper reliability analysis, identify the potential critical items and design the risk out accordingly. Just so you know, this is one of the day job things I do.

Tricky Trevor 19-01-2012 11:16

Re: MAJOR NETWORK ISSUE (17 Jan 2012)
 
Ok here

https://www.cableforum.co.uk/images/...2012/01/42.png

qasdfdsaq 19-01-2012 11:58

Re: MAJOR NETWORK ISSUE (17 Jan 2012)
 
Quote:

Originally Posted by Sephiroth (Post 35365453)
As many techies will know, you can algorithmically re-route when there is a node failure; this put pressure on other nodes but is in any case standard everywhere these days.

Plus you can put in physical resilience so that another device takes over with the same IP address in case of failure of a key device. I suspect that didn't happen. If there is a site failure then, of course, this measure is not effective).

The trick is to do proper reliability analysis, identify the potential critical items and design the risk out accordingly. Just so you know, this is one of the day job things I do.

Yes, most sensible departments, including mine, do a combination of all 3 of the above. Although that said, I've seen our whole network taken down more often by human error and critical software bugs than actual hardware failure.

I see no excuse for this level of failure in any major ISP, particularly not one of the largest in the UK. And especially not lingering effects several days on as some people seem to be reporting...

Paul 19-01-2012 12:09

Re: MAJOR NETWORK ISSUE (17 Jan 2012)
 
Quote:

Originally Posted by Peter_ (Post 35365266)
Well the were more posts on this subject on that forum than the were on this forum, does that not tell you something.

I wasnt aware we were in a posting count competition.

Digital Fanatic 19-01-2012 12:49

Re: MAJOR NETWORK ISSUE (17 Jan 2012)
 
Quote:

Originally Posted by rmwebs (Post 35365415)
I'm guessing that means it wasn't some sort of switch failure then...is the 'business sensitive' information good or bad news?

It was, I'm talking about the exact details.

schuey100 19-01-2012 12:59

Re: MAJOR NETWORK ISSUE (17 Jan 2012)
 
I'm still getting drops, happening all day, unusual because my service is normally excellent, I wonder if they're still having issues of some kind, I don't see many people posting about drops in connection so maybe it's just me!

Peter_ 19-01-2012 13:00

Re: MAJOR NETWORK ISSUE (17 Jan 2012)
 
Quote:

Originally Posted by Paul M (Post 35365489)
I wasnt aware we were in a posting count competition.

I was commenting on a particular issue that had the community forum inundated with posts in every section all about the same issue, hence they added a yellow banner to the first page to little effect as no one actually read it.

Nothing to do with any competition rather a simple statement of fact.

Digital Fanatic 19-01-2012 14:43

Re: MAJOR NETWORK ISSUE (17 Jan 2012)
 
Quote:

Originally Posted by schuey100 (Post 35365550)
I'm still getting drops, happening all day, unusual because my service is normally excellent, I wonder if they're still having issues of some kind, I don't see many people posting about drops in connection so maybe it's just me!

Give Support a call on 151. There are no ongoing issues AFAIK., although the major outage may have masked some more local issues.

The PIT 19-01-2012 17:32

Re: MAJOR NETWORK ISSUE (17 Jan 2012)
 
Quote:

Originally Posted by Peter_ (Post 35365266)
Well the were more posts on this subject on that forum than the were on this forum, does that not tell you something.

Like I said when I tried it I couldn't get through. So it doesn't how many posted or what was put on a banner once the site was over whelmed.

The information was here though.

sollp 19-01-2012 17:57

Re: MAJOR NETWORK ISSUE (17 Jan 2012)
 
Quote:

Originally Posted by qasdfdsaq (Post 35365483)
Yes, most sensible departments, including mine, do a combination of all 3 of the above. Although that said, I've seen our whole network taken down more often by human error and critical software bugs than actual hardware failure.

I see no excuse for this level of failure in any major ISP, particularly not one of the largest in the UK. And especially not lingering effects several days on as some people seem to be reporting...

Cleaner unplugging the Rack to hoover, like most Comm's Room's there are extensions off of extension's hanging off a 13amp plug!!

qasdfdsaq 19-01-2012 18:16

Re: MAJOR NETWORK ISSUE (17 Jan 2012)
 
Where I work,

a) Cleaners can't enter the server room(s)
b) Rack can't be unplugged accidentally
c) All cabling is neat and tidy, all inter-rack cabling is ducted or under the floor.

I'd expect any serious communications environment to be the same.

Turkey Machine 19-01-2012 18:39

Re: MAJOR NETWORK ISSUE (17 Jan 2012)
 
Quote:

Originally Posted by Peter_ (Post 35365341)
Unless it is posted on the community forum we could not post it on a public forum as it would be classed as commercially sensitive information and could lose us our jobs, not worth it especially as we are awaiting our payout.

Masque & DF & any other VM people who help us out: apologies guys, I hadn't realised Virgin's policy was that far-reaching. We definitely don't wanna lose you as you're one of the most valuable assets to this forum. :)

---------- Post added at 19:35 ---------- Previous post was at 19:32 ----------

Quote:

Originally Posted by Sephiroth (Post 35365453)
I can imagine what's sensitive. The opposition would seize on any information that might lead them to conclude and expose insuffient resilience on VM's part.

As many techies will know, you can algorithmically re-route when there is a node failure; this put pressure on other nodes but is in any case standard everywhere these days.

Plus you can put in physical resilience so that another device takes over with the same IP address in case of failure of a key device. I suspect that didn't happen. If there is a site failure then, of course, this measure is not effective).

The trick is to do proper reliability analysis, identify the potential critical items and design the risk out accordingly. Just so you know, this is one of the day job things I do.

Which is exactly the reason why work want to get out of their current set-up - ever since their take-over, and the lies they told about the networks being kept separate, it's degraded to the point where it's not worth it for them any more. It was convenient at the time because about 2 years ago they wanted to move out of another provider's datacentre.

EDIT: Considering this took out a big chunk of leased line connectivity, I can see a considerable backlash of data contracts being re-negotiated and lost as a result of this.

---------- Post added at 19:39 ---------- Previous post was at 19:35 ----------

Quote:

Originally Posted by qasdfdsaq (Post 35365763)
Where I work,

a) Cleaners can't enter the server room(s)
b) Rack can't be unplugged accidentally
c) All cabling is neat and tidy, all inter-rack cabling is ducted or under the floor.

I'd expect any serious communications environment to be the same.

Most of the time this is true, however when many third parties are involved communication does break down. :)

MaverickJesus 19-01-2012 19:00

Re: MAJOR NETWORK ISSUE (17 Jan 2012)
 
It was apparently a cooling failure that caused a core router to overheat, they were updating VM Business support tickets with that explanation shortly after it went tits up.

Peter_ 19-01-2012 19:19

Re: MAJOR NETWORK ISSUE (17 Jan 2012)
 
Quote:

Originally Posted by The PIT (Post 35365748)
Like I said when I tried it I couldn't get through. So it doesn't how many posted or what was put on a banner once the site was over whelmed.

The information was here though.

I never even noticed and I was online for the whole time but never looked at any forum until hours later and saw all the posts, rather surprised to say the least.

Now if I had been in work it would have worked wonders for my AHT.

Hugh 19-01-2012 19:48

Re: MAJOR NETWORK ISSUE (17 Jan 2012)
 
Quote:

Originally Posted by qasdfdsaq (Post 35365763)
Where I work,

a) Cleaners can't enter the server room(s)
b) Rack can't be unplugged accidentally
c) All cabling is neat and tidy, all inter-rack cabling is ducted or under the floor.

I'd expect any serious communications environment to be the same.

Absolutely.

Sephiroth 19-01-2012 19:58

Re: MAJOR NETWORK ISSUE (17 Jan 2012)
 
... and last time I entered a Virgin Media data centre server hall, so it was.

qasdfdsaq 20-01-2012 03:00

Re: MAJOR NETWORK ISSUE (17 Jan 2012)
 
Quote:

Originally Posted by Sephiroth (Post 35365834)
... and last time I entered a Virgin Media data centre server hall, so it was.

Hey did you notice if their network was running on tits?

Sephiroth 20-01-2012 16:37

Re: MAJOR NETWORK ISSUE (17 Jan 2012)
 
Quote:

Originally Posted by qasdfdsaq (Post 35365940)
Hey did you notice if their network was running on tits?

Qasi

In the spirit of your question, it was all up!

qasdfdsaq 20-01-2012 17:15

Re: MAJOR NETWORK ISSUE (17 Jan 2012)
 
xD

sollp 20-01-2012 17:47

Re: MAJOR NETWORK ISSUE (17 Jan 2012)
 
Quote:

Originally Posted by qasdfdsaq (Post 35365763)
Where I work,

a) Cleaners can't enter the server room(s)
b) Rack can't be unplugged accidentally
c) All cabling is neat and tidy, all inter-rack cabling is ducted or under the floor.

I'd expect any serious communications environment to be the same.

Indeed you would, but after visiting many that aren't because of the few things I have put down.

Tuvoc 22-01-2012 11:02

Re: MAJOR NETWORK ISSUE (17 Jan 2012)
 
Quote:

Originally Posted by Peter_ (Post 35365802)
I never even noticed and I was online for the whole time but never looked at any forum until hours later and saw all the posts, rather surprised to say the least.

Strangely my service seemed totally unaffected, I was somewhat surprised to hear of it the next day. If it was network-wide, I don't understand...

Peter_ 22-01-2012 11:10

Re: MAJOR NETWORK ISSUE (17 Jan 2012)
 
Quote:

Originally Posted by Tuvoc (Post 35367161)
Strangely my service seemed totally unaffected, I was somewhat surprised to hear of it the next day. If it was network-wide, I don't understand...

Not everyone was affected including myself and many others.

Chrysalis 22-01-2012 11:35

Re: MAJOR NETWORK ISSUE (17 Jan 2012)
 
Network wide doesnt necessarily mean 100% affected.

qasdfdsaq 22-01-2012 11:57

Re: MAJOR NETWORK ISSUE (17 Jan 2012)
 
IIRC just about everything going via Leeds => Poplar was broken.

Peter_ 22-01-2012 12:05

Re: MAJOR NETWORK ISSUE (17 Jan 2012)
 
Quote:

Originally Posted by qasdfdsaq (Post 35367202)
IIRC just about everything going via Leeds => Poplar was broken.

It was a strange one to say the least.


All times are GMT. The time now is 19:23.

Powered by vBulletin® Version 3.8.11
Copyright ©2000 - 2026, vBulletin Solutions Inc.
All Posts and Content are © Cable Forum