Virgin Akamai Cache Congestion
20-05-2021, 16:48
|
#1
|
cf.geek
Join Date: Jul 2010
Location: Newcastle
Posts: 785
|
Virgin Akamai Cache Congestion
Hello all
I've been looking at a really annoying streaming video quality issue for the past few weeks which i've tracked down to seemingly being an issue with video served from akamai.
For example channel5, seems to hit akadash0.akamaized.net and a traceroute ends at a virgin media address of cur1-melt2-0-0-cust128.12-1.cable.virginm.net (213.106.24.129)
From my investigation it seems to be this cache is congested and causing the streaming quality to drop.
Was hoping someone else more in the know could tell me if i'm onto something here or way off, i don't fancy my chances raising this with CS
TIA!
|
|
|
20-05-2021, 18:45
|
#2
|
cf.mega poster
Join Date: Jun 2003
Posts: 8,901
|
Re: Virgin Akamai Cache Congestion
I'll pick this up if you can provide some evidence, and a way to recreate it.
Can anyone else recreate this?
By the way, that reverse DNS lookup isn't correct, though that isn't the cause of your problem. I guess they have reused an old Melton Mowbray IP address but forgot to update the DNS. I can confirm 213.106.24.129 is actually a link to Akamai from VM in Manchester.
|
|
|
20-05-2021, 20:04
|
#3
|
Just a Geek
Join Date: Jul 2015
Posts: 3,601
|
Re: Virgin Akamai Cache Congestion
Have you tried changing the route by changing the DNS server or trying a VPN
|
|
|
20-05-2021, 21:31
|
#4
|
cf.geek
Join Date: Jul 2010
Location: Newcastle
Posts: 785
|
Re: Virgin Akamai Cache Congestion
Yeah so if I use cloudflare warp, everything is good.
SP what else can I provide to help? I can reproduce it on my5 and itv hub, I'll try and find out if there's any other on demand that uses akamai and check if I can recreate it there too
|
|
|
20-05-2021, 22:00
|
#5
|
cf.mega poster
Join Date: Jun 2003
Posts: 8,901
|
Re: Virgin Akamai Cache Congestion
What device are you running My5 and ITVHub on? Can you quantify the quality drop? Does it only happen at certain times of day? Also please name some specific assets that show the fault.
BBC iPlayer certainly used to use Akamai, but I don't know if they still do.
|
|
|
21-05-2021, 08:40
|
#6
|
cf.geek
Join Date: Jul 2010
Location: Newcastle
Posts: 785
|
Re: Virgin Akamai Cache Congestion
Quote:
Originally Posted by spiderplant
What device are you running My5 and ITVHub on? Can you quantify the quality drop? Does it only happen at certain times of day? Also please name some specific assets that show the fault.
BBC iPlayer certainly used to use Akamai, but I don't know if they still do.
|
Noticed it on both my fire sticks originally, my partner has also mentioned she noticed sky go (i rarely watch anything on it) drops in quality quite often but no way to check anything on the PS4 app.
I've recreated it on my5 chrome on my laptop, using the dev console i can see the segments it's requesting end in "1500" (assume the max bitrate) and that changes down to 800,360,180 before the picture and audio become noticeably worse, the assets then go back to 1500 and the quality improves, then drops etc etc
It does seem to coincide with peak times, it seems to be staying at 1500 right now, i'll test again later this afternoon and try and get some logs / screenshots
|
|
|
23-05-2021, 14:05
|
#8
|
Ran Away
Join Date: Nov 2008
Location: Lincoln
Services: phone + 1gbit BB + SkyQ
Posts: 11,021
|
Re: Virgin Akamai Cache Congestion
problem solved then
|
|
|
24-05-2021, 08:42
|
#9
|
cf.geek
Join Date: Jul 2010
Location: Newcastle
Posts: 785
|
Re: Virgin Akamai Cache Congestion
Quote:
Originally Posted by General Maximus
problem solved then
|
For now it appears so
Spiderpant - just wondering if virgin have any monitoring on these caches, can they see utilisation on the network links to them / the boxes themselves?
I'd imagine they sync their content OOH overnight, but could they somehow end up doing this peak times and causing congestion?
Just trying to get an idea of how these things work heh
|
|
|
24-05-2021, 09:49
|
#10
|
cf.mega poster
Join Date: Jun 2003
Posts: 8,901
|
Re: Virgin Akamai Cache Congestion
The caches are owned and managed by Akamai themselves. VM can only monitor the link capacity, though we'd contact Akamai if we thought the problem lay at their end.
|
|
|
24-05-2021, 11:29
|
#11
|
cf.geek
Join Date: Jul 2010
Location: Newcastle
Posts: 785
|
Re: Virgin Akamai Cache Congestion
Thanks SP
Interestingly, i'm no longer being routed to the VM cache, and everything is fine...
C:\Users\xx>tracert akadash0.akamaized.net
Tracing route to a1160.w10.akamai.net [88.221.87.131]
over a maximum of 30 hops:
1 1 ms 1 ms 1 ms 192.168.88.1
2 12 ms 14 ms 8 ms 10.53.34.249
3 11 ms 12 ms 10 ms gate-core-2a-xe-501-0.network.virginmedia.net [82.2.240.105]
4 * * * Request timed out.
5 * * * Request timed out.
6 27 ms 24 ms 25 ms 86.85-254-62.static.virginmediabusiness.co.uk [62.254.85.86]
7 * * * Request timed out.
8 23 ms 23 ms 26 ms uk-lon03a-ri1-ae-2-0.aorta.net [84.116.135.46]
9 30 ms 24 ms 24 ms 213.46.174.130
10 24 ms 29 ms 26 ms ae8-xcr1.lnt.cw.net [195.2.24.130]
11 30 ms 29 ms 29 ms ae4-ucr1.mcr.cw.net [195.2.27.166]
12 30 ms 30 ms 30 ms 217.161.88.254
13 29 ms 29 ms 27 ms a88-221-87-131.deploy.static.akamaitechnologies.com [88.221.87.131]
Trace complete.
Not really sure what is going on here but pinning down is becoming a nightmare, the trend does seem to be the issue only appears when using the VM cache in particular, very strange.
|
|
|
24-05-2021, 12:26
|
#12
|
cf.mega poster
Join Date: Jun 2003
Posts: 8,901
|
Re: Virgin Akamai Cache Congestion
Maybe somebody already identified the fault and has taken the problem link out of use.
|
|
|
24-05-2021, 13:11
|
#13
|
cf.geek
Join Date: Jul 2010
Location: Newcastle
Posts: 785
|
Re: Virgin Akamai Cache Congestion
Quote:
Originally Posted by spiderplant
Maybe somebody already identified the fault and has taken the problem link out of use.
|
Fingers crossed, i'll keep an eye on it, cheers SP
|
|
|
28-05-2021, 20:36
|
#14
|
cf.addict
Join Date: Jan 2008
Posts: 160
|
Re: Virgin Akamai Cache Congestion
Quote:
Originally Posted by spiderplant
Maybe somebody already identified the fault and has taken the problem link out of use.
|
Are you aware of any issues between BT sport and now tv using apps? Recently at my house (350mbits) I’ve been getting buffering and quality drops. The in-laws have too.
My house:
350mbit (speed test usually good/low latency/jitter)
Shub4
Asus rtac68u
Apple TV 4K (not the recent one) hardwired to router
Nowtv app
Btsport app
In-laws:
100mbit (speed test usually good/low latency/jitter)
Shub3
Asus rtac68u
Samsung 50” connected via 5ghz WiFi - have done Speedtest from tv using fast.com and it can max out the connection.
Nowtv app
Btsport app
Issues started roughly at the same time. I’m area 20, they are burnage/didsbury.
|
|
|
28-05-2021, 22:09
|
#15
|
cf.mega poster
Join Date: Jun 2003
Posts: 8,901
|
Re: Virgin Akamai Cache Congestion
Quote:
Originally Posted by Robertus
Are you aware of any issues between BT sport and now tv using apps?
|
No, I wouldn't know where to begin with that one, sorry
|
|
|
Currently Active Users Viewing This Thread: 1 (0 members and 1 guests)
|
|
Posting Rules
|
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts
HTML code is Off
|
|
|
All times are GMT +1. The time now is 20:23.
|