Easynews Speedup! Doh!

[lordy]

Since moving to NTL, Easynews has been a bit sluggish.

Even changing my route (via Easynews route change page) hasnt made much difference..

Then today I realised , if you change route by following the Easynews "Site Slow" link from your homepage.. it takes you back to the Easynews webserver on port 80. so you are only changing route for traffic from Easynews to the NTL proxy.

You need to change route directly from
http://members.easynews.com:81/route/

This post should get moved/merged at some point, but I think some people here would like to see it! My download is now red-lining It's a networking/routing issue which is fixed by understanding a proxy issue!

Lordy

[Horace]

It doesn't help that much since NTL seem to be throttling connections to Easynews. Making multiple connections either in an NNTP app or in a download manager (FDM) if downloading via the web interface are the only ways I've found of getting around this.

If its web browser and zip manager use reget to download the zip and set connections to above 20 you will max your connection.If your using NNTP then use a reader like Newsbin that will allow 10 connections also maxing your connection
The Zip manager being slow is a known fault with Easynews.If your downloading zips bigger than 255 meg then you need a multi threading download manager anyway as transparent proxies are known to damage the zips

[James Henry]

Just use an NNTP client for downloading NNTP files, problem solved

Originally Posted by James Henry

Just use an NNTP client for downloading NNTP files, problem solved

Easynews has something most if not all other news server does not have and thats the web based interface,A global search that searches everywhere without having to download millions of headers.A zip manager that allows you to download groups of files easily and an excellent par viewer that will find all posts from various groups to give you a complete post.It also has an easy nzb creator in the zipmanager that covers all newsgroups and every post unlike newzbin.com that has to have nzbs written and uploaded so its not complete.Easynews in unique in offering this I use it alongside my Giganews account and NNTP

[lordy]

I've had no problems downloading 100s of Gig via zipmanager via Easynews (except networking problems fixed by correcting the route is indicated in first post )

I download zips from http://zip.members.easynews.com:81/...

And I get slightly better performance via

https://secure.zip.members.easynews.com:81/...

(Dont know why, as there is more overhead. Maybe the secure server is twiddling it's thumbs most of the time)

Never download anything via port 80.

Downloading via NNTP is 25% slower (all else being equal), and if you are on NTL 10meg it uses more of your download limit..(I'm on 2meg)

After I went HTTP, I would never go back to NNTP, simply because you have to download more bytes to get the same files , although Easynews allow for this, NTL dont , so if you are on a capped service you are wasting some of your total using NNTP. I used to have the full NNTP monty with multple XNews windows etc. etc. but now I just use multiple instances of wget from the command line.. Which I fire off from the Global Search page..

Lordy

[Paradox26]

For those of you who use Easynews etc, does your Card get billed in USD? or GBP? I would like to try out easynews, which is why Im asking.

Thanks

[lordy]

Originally Posted by zinglebarb

If your downloading zips bigger than 255 meg then you need a multi The Zip manager being slow is a known fault with Easynews.

I downloaded full speed no problems with 5 threads once routing fixed as per first post (only 2M line thhough)

Originally Posted by zinglebarb

If your downloading zips bigger than 255 meg then you need a multi threading download manager anyway as transparent proxies are known to damage the zips

I've not had any damage here downloading 2G zips via port 81. NTL Bromley. Why would multi-threading prevent damage? Avoiding the proxy would - hence port 81.

Lordy

---------- Post added at 14:50 ---------- Previous post was at 14:48 ----------

Originally Posted by Sahil

For those of you who use Easynews etc, does your Card get billed in USD? or GBP? I would like to try out easynews, which is why Im asking.

Just like when you go on holiday. Your bill will show the UK Sterling equivalent of $10 using CC companies exchange rate. (around £6 ish)

Lordy

---------- Post added at 15:23 ---------- Previous post was at 14:50 ----------

Originally Posted by Horace

It doesn't help that much since NTL seem to be throttling connections to Easynews.

Route is something to be considered and it helps a lot if your route is not already optimal. I had 5 threads on the go yesterday (via port 81) and it was downloading at between 80and 150Kbps.. as soon as I fixed my route (as per OP) it went up to 238Kbps solid. So it certainly helped me.

It's certainly worth looking at, as people could be assuming its NTL being sneaky when fixing their route would certainly help towards to goal of faster downloads.

I just posted because I realised all my previous attempts to change the route, were invalid because they were done from the port 80 admin page.

I suggest people do all of the following:
- try changing their route (via http://members.easynews.com:81/route/) ,
- for HTTP use port 81,
- and use multiple threads.
- (and IMO use HTTP anyway as it will be faster all else being equal - less to download)

Originally Posted by Horace

Making multiple connections either in an NNTP app or in a download manager (FDM) if downloading via the web interface are the only ways I've found of getting around this.

Remember Easynews is in the States, so latency is likely the issue (not NTL being sneaky).

People forget that NNTP downloads from a decent newsreader, often implicity have multiple connections at the same time (as 'n' .rar parts are downloaded concurrently), then they compare that to a single thread on HTTP(via NTL proxy) and say NNTP is faster!

When using HTTP they should also use whetever mechanism also allows multiple connections.. AND use port 81.. and they will be no real problems.

To get a full bandwidth download with a single connection (at the TCP/IP level) of any protocol (NNTP or HTTP) from across the pond .. is wishful thinking... because the latency is higher and network congestion could be anywhere..

Ping a site in the UK and then ping one in the US. Thats the reason why you use multiple threads whether it be NNTP or HTTP.

But for HTTP definitely use port 81!

Also regarding NTL throttling traffic...

Looking at my trace times from Easynews to NTL, I couldn't see any evidence of that.

HOST                                       LOSS    RCVD    SENT    BEST    AVG    WORST
ge1-8-1000m.sw1.easynews.com                0%    10    10    0.40    0.90    2.36
e-2-2-1000m.core-03.phx1.puregig.net        0%    10    10    0.28    0.38    0.54
65.118.182.93                                0%    10    10    0.77    4.25    32.84
205.171.129.113                              0%    10    10    1.32    3.49    11.83
67.14.10.54                                  0%    10    10    11.73    19.71    47.05
205.171.213.110                              0%    10    10    11.96    25.53    109.08
205.171.1.58                                0%    10    10    10.90    16.18    59.16
po12-0.ashcr1.Ashburn.opentransit.net        0%    10    10    65.75    67.00    68.27
po6-0.loncr3.London.opentransit.net          0%    10    10    134.94    136.91    141.83
so-1-0-0-0.loncr4.London.opentransit.net    0%    10    10    135.18    142.18    185.46
???                                          100%    0    10    0.00    0.00    0.00
nth-bb-b-ae0-0.inet.ntl.com                  0%    10    10    138.44    141.00    153.70
pop-bb-a-so-100-0.inet.ntl.com              0%    10    10    138.10    147.63    216.17
brom-t2core-a-pos31.inet.ntl.com            0%    10    10    139.23    189.23    353.65
lwhm-t2cam1-a-ge-wan31.inet.ntl.com          0%    10    10    139.09    144.75    176.33
ubr05lewi-ge10.inet.ntl.com                  0%    10    10    140.12    145.36    181.69
???                                          100%    0    10    0.00    0.00    0.00

The big drop is across opentransit.net which I suspect is crossing the pond.
Its simply the distance involved, hence multiple threads to alleviate latency issues.

Lordy

[IanUK]

NTL don't throttle Easynews.
I've a 10 meg connection.

I can get 400-450k from a single thread using port 81 or secure port 81.
NNTP gives me about 500k from a single thread.

4 Connections tends to max out my 10 meg connection most of the time.

It is vital though that I route through Level 3 (yours may vary) as other routes are really rubbish to NTL.

NNTP doesn't use any more of our precious cap though, Easynews doesn't count either headers nor the NNTP overhead in its calculations.

[lordy]

Agree with everything else but ...

Originally Posted by IanUK

NNTP doesn't use any more of our precious cap though, Easynews doesn't count either headers nor the NNTP overhead in its calculations.

Agree: Easynews doesnt count it but NTL do if you are on a capped connection. All NTL see is the amount of data not the protocol being used.

plus all else being equal NNTP is slower .. eg download 5G of data to get 4G of actual information.

I agree its not worth going silly with the amount of connections to alleviate latency. Between 4-10 is usually sufficient. Anymore and it affects other internet activities..

Also for the conspiracy theorist ...

Running a trace from Easynews to my proxy address "80.1.224.4" always results in 10% packet loss at some of the NTL routers and the advice
"The router most likely responsible for your slow downloads in owned by ntl.com"

..but using my actual IP address for the trace doesnt. I'm not a networking guru but it looks "interesting". Certainly traffic from Easynews to NTL proxy (and hence users using HTTP port 80) appears to be suffering packetloss.

Lordy

[James Henry]

Excuse my ignorance on this guys

Are you saying that Easynews decode the base 7 NNTP files so you are downloading pure binaries without the need to decode them back to base 8, and that they have a searchable index of the decoded binaries?

I'm curious as they'd need to either decode them on the fly or have double the storage, and it's a bit shaky legally if they are not only storing but indexing the binaries in a human-readable format.

EDIT: Never mind I just checked on it on the website. Here's hoping the RIAA/MPAA et al don't go after them, they would be shut down quicker than you could say 'omfgwtfbbq' the services they offer blow the 'common carrier' defense out of the window a bit

[IanUK]

Originally Posted by lordy

Agree with everything else but ...

Agree: Easynews doesnt count it but NTL do if you are on a capped connection. All NTL see is the amount of data not the protocol being used.Lordy

Doh, of course, I was thinking purely from Easynews's cap not NTL's.

I'll get me coat...

---------- Post added at 16:26 ---------- Previous post was at 16:24 ----------

Originally Posted by James Henry

Excuse my ignorance on this guys

Are you saying that Easynews decode the base 7 NNTP files so you are downloading pure binaries without the need to decode them back to base 8, and that they have a searchable index of the decoded binaries?

I'm curious as they'd need to either decode them on the fly or have double the storage, and it's a bit shaky legally if they are not only storing but indexing the binaries in a human-readable format.

EDIT: Never mind I just checked on it on the website. Here's hoping the RIAA/MPAA et al don't go after them, they would be shut down quicker than you could say 'omfgwtfbbq' the services they offer blow the 'common carrier' defense out of the window a bit

I don't think they are worried, this has cropped up time and again and their answer is always something along of the lines of 'we don't post anything and no human decodes stuff etc etc'

They have been going for years, maybe their time will come but they seem to be within current US laws.

[James Henry]

Originally Posted by IanUK

They have been going for years, maybe their time will come but they seem to be within current US laws.

Actually just the mere fact they don't keep records places them outside of US law being pedantic

In any case they seem alright so far so all good and so long as they have the ability to record usage no-one can complain too hard.

[Horace]

OK, to answer a couple of points made.
Yes, rerouting makes some difference but nothing really noticable. I regularly use the rerouter, usually before any large downloads or when I notice things crawling.
I've been with Easynews for *years* and used usenet since the days when I used to pay for a 33.6k dialup account with Demon.
Up until 10meg came in I could max my connection on a 3 meg connection without any problems. I'm often not getting 1 meg connection speeds from EN using the same download settings.This is a very specific problem between NTL and Easynews since I have an account with another stateside usenet provider which can max my connection without problems. I've tried a friends DSL account and it downloads perfectly via web and NNTP without having to use multiple connections. So...same hardware, same isp, same nsp, same routes, newly increased maximum speeds and EN support forum with lots of NTL users complaining..hmm..it doesn't take a genius does it?

Sahill : Easynews bill in USD.

[lordy]

Originally Posted by Horace

OK, to answer a couple of points made.
Yes, rerouting makes some difference but nothing really noticable.

Hi Horace, remember thats your experience. Your existing route could have been near optimal before hand. If others get good gains than its noticable for them. They could have been on very sub-optimal routes. I went from 50-160kbps to 240kbps. So, its certainly one of the things people should look at. And it may or may not make a difference. I'n my experience, it usually does!

Lordy