Super slow update from amazonaws

[chatan]

I've notice a very slow download on one of the update packages (breeze):  being trying all afternoon today (still at 11%) and I also noticed this slowness on an update several days ago, too:

Get:1 http://ds9-maui.s3-website.eu-central-1....2-packages xenial/main amd64 breeze amd64 4:5.8.2-0neon+16.04+build22 [32.4 MB]
28% [1 breeze 3,577 kB/32.4 MB 11%]                              426 B/s 4d 15h 15min 2s

Speed fluctuates of course, but I've seen it as slow as 40 B/s, occasionally for short periods it will get as high as few thousand KB/s, but typically is in the couple hundred B/s or less.

Something on my end?

[leszek]

It is fast here. The repo is an s3 server from amazon. Maybe something todo with the DDOS attacks from the last 2 days.

[starbuck]

is there maybe a difference if accessing files via
http://ds9-maui.s3.amazonaws.com/maui-2-...ckages.bz2
or
http://ds9-maui.s3-website.eu-central-1....ckages.bz2
?

[chatan]

I'm in Japan and googling "amazon s3 slow download" reveals tons of issues related to regions.  Examples:

"Amazon Web Services speeds can vary by up to 200X depending on region"
"Ubuntu apt-get install extremely slow download in EU Ireland region"

In one link I found this reply:

...your S3 buckets are situated in a specific location, for example us-east, europe, us-west etc. This is the place where your files are physically stored. They are not distributed geographically. Users from other places in the world will experience delay when requesting data from these buckets.

Good news, though:  breeze is now 30% downloaded

[chatan]

is there maybe a difference if accessing files via
http://ds9-maui.s3.amazonaws.com/maui-2-...ckages.bz2
or
http://ds9-maui.s3-website.eu-central-1....ckages.bz2
?

Code:

wget -O /dev/null http://ds9-maui.s3-website.eu-central-1.amazonaws.com/maui-2-packages/dists/xenial/main/binary-amd64/Packages.bz2

...gives about 0 ~ 3 Kb/s in short test

Code:

wget -O /dev/null http://ds9-maui.s3.amazonaws.com/maui-2-packages/dists/xenial/main/binary-amd64/Packages.bz2

...gives about 4 ~ 5 Kb/s in short test

[starbuck]

i think there is an option to replicate S3 buckets to other regions, looking into this the next weeks.