VM Business Cloudflare issue

fizzyade · 10-10-2020, 22:18

Hi,

I've used cloudflare for my DNS for a long time (I also use their CDN's). Over the past week I've been having issues with sites timing out, initially I thought it was just a flakey virgin period, but further digging shows packet loss to 1.1.1.1 with ping. Pinging google DNS 8.8.8.8 I see no packet loss, so I switched my DNS over to google and low and behold the internet started behaving normally with no lookup or site failures.

So, is anybody else seeing issues to cloudflares DNS servers? I'm on a static ip business account (13 IP's), I haven't yet tried the magic cycling of my main public IP to see if any of the other IP's are better (or worse).

Cheers.

spiderplant · 11-10-2020, 11:11

I don't see an issue pinging from one of VM's central servers. Do you know which CMTS you are connected to?

fizzyade · 11-10-2020, 19:17

New Malden. The service has been a bit flakey since the digger famously pulled all the cables out a while back and the service was out for the best part of a week, prior to that I never had any issues, after that it never felt as stable.

This new issue has been noticible for a week.

Running simultaneous pings (I wrote an app on github called pingnoo) I see lots of drops on 1.1.1.1, but zero to Google’s servers.

**Paul** · 11-10-2020, 19:32

Their service should prioritise DNS over responding to pings, but that said, Im getting 100% ping response here from 1.1.1.1, with an average of 15ms.

General Maximus · 11-10-2020, 21:03

me too with 13ms

spiderplant · 11-10-2020, 21:21

Ok, it seems to be a regional network fault. There are actually 5 active CMTSs in New Malden, but I can recreate the fault from all of them. I can also recreate in Croydon, Hersham, Hayes and Watford, but not from outside the London area. I'll report it to the appropriate people tomorrow.

Skie · 11-10-2020, 21:25

I've seen some cloudflare 1.1.1.1 issues in Liverpool. Ping seems fine but packet-loss is 2%-5%

That said, my area has an open SNR fault so it could be that rearing its head.

spiderplant · 12-10-2020, 10:46

Appears to be fixed now. Can you confirm?

Skie · 12-10-2020, 12:21

For me it looks like it is, cheers!

Ping statistics for 1.1.1.1:
Packets: Sent = 250, Received = 250, Lost = 0 (0% loss),
Approximate round trip times in milli-seconds:
Minimum = 8ms, Maximum = 24ms, Average = 10ms

fizzyade · 14-10-2020, 14:34

Quote:

Originally Posted by spiderplant

Ok, it seems to be a regional network fault. There are actually 5 active CMTSs in New Malden, but I can recreate the fault from all of them. I can also recreate in Croydon, Hersham, Hayes and Watford, but not from outside the London area. I'll report it to the appropriate people tomorrow.

Thank you!

I've been struggling with this for a week before I realised what the issue was, I've just checked and it is fixed now.

Thank goodness I wasn't going mad.

---------- Post added at 14:34 ---------- Previous post was at 14:29 ----------

Quote:

Originally Posted by Paul

Their service should prioritise DNS over responding to pings, but that said, Im getting 100% ping response here from 1.1.1.1, with an average of 15ms.

Yeah, but I was seeing DNS lookup failures, it was making browsing the web almost impossible. I worked back from the DNS failures to ping and not the other way around, it still could have been a false positive but with both seemingly confirming a packet loss I figured there was an issue.

I'm the author of Pingnoo https://github.com/fizzyade/pingnoo so understand why ping may not be a useful metric unless you know what you're doing.

I may now add a DNS lookup module into Pingnoo to check for actual losses during lookup.

**Paul** · 14-10-2020, 16:41

Ive never heard of Pingnoo, but it does look interesting.

fizzyade · 14-10-2020, 19:55

Quote:

Originally Posted by Paul

Ive never heard of Pingnoo, but it does look interesting.

It's early in development, and my father passed away a couple of months ago so I've not been working on it as much as I would like as I've been travelling back and forward to to visit my mum.

Synthetic · 14-10-2020, 20:41

I've been getting issues up in the Newcastle area the past week or so, only seems to be an issue during peak hours though so could be congestion although i'm on a new build estate...

CMTS is Jarr14