9:26 a.m.
The new feature in yum to use a mirrorlist instead of everbody
donwloading from download.fedora.redhat.com is great. Unfortunately yum
sometimes seems to download from the mirror furthest away and the
downloads are really slow.
But as I was to lazy to edit all the files in /etc/yum.repos.d/ to use
the closest mirror I have written a small script which tries to
determine the best mirror, removes the mirrorlist directive from the
repo file and appends a baseurl line with the best mirror.
If anyone is interested the script can be found at:
http://lisas.de/~adrian/rpm/netselect-0.3-0.fdr.2.i386.rpm
http://lisas.de/~adrian/rpm/netselect-0.3-0.fdr.2.src.rpm
http://lisas.de/~adrian/rpm/netselect-yum-0.3-0.fdr.2.i386.rpm
All this is more or less just copied (inspired) by debian's
netselect-apt.
Adrian
9:43 a.m.
Adrian Reber wrote :
The new feature in yum to use a mirrorlist instead of everbody
donwloading from download.fedora.redhat.com is great. Unfortunately yum
sometimes seems to download from the mirror furthest away and the
downloads are really slow.
But as I was to lazy to edit all the files in /etc/yum.repos.d/ to use
the closest mirror I have written a small script which tries to
determine the best mirror, removes the mirrorlist directive from the
repo file and appends a baseurl line with the best mirror.
If anyone is interested the script can be found at:
http://lisas.de/~adrian/rpm/netselect-0.3-0.fdr.2.i386.rpm
http://lisas.de/~adrian/rpm/netselect-0.3-0.fdr.2.src.rpm
http://lisas.de/~adrian/rpm/netselect-yum-0.3-0.fdr.2.i386.rpm
All this is more or less just copied (inspired) by debian's
netselect-apt.
Haven't looked at this yet, but how about selecting more than one mirror
(e.g. the 5 best), creating a local yum mirror file, and pointing yum's
configuration to that file:///path/to/that/mirrorlist? I really like the
fact that yum tries another server when one doesn't seem to respond, which
wouldn't be the case anymore with a single baseurl configured.
Matthias
--
Clean custom Red Hat Linux rpm packages : http://freshrpms.net/
Fedora Core release 3 (Heidelberg) - Linux kernel 2.6.9-1.667.radeonfb
Load : 0.27 0.31 0.62
1:41 a.m.
Haven't looked at this yet, but how about selecting more than one
mirror
(e.g. the 5 best), creating a local yum mirror file, and pointing yum's
configuration to that file:///path/to/that/mirrorlist? I really like the
fact that yum tries another server when one doesn't seem to respond, which
wouldn't be the case anymore with a single baseurl configured.
What about combining this:
http://aspn.activestate.com/ASPN/Cookbook/Python/Recipe/284631
with netselect and generating a mirrorlist of the best mirrors every
night or something?
-sv
2:17 a.m.
On Friday 19 November 2004 02:41, seth vidal wrote:
What about combining this:
http://aspn.activestate.com/ASPN/Cookbook/Python/Recipe/284631
with netselect and generating a mirrorlist of the best mirrors every
night or something?
-sv
Not a good idea in my opinion... I try keep my cable modem fairly unused
during the day for interactive stuff but at night I run mirrors and backup
some of my data to a remote server - in other words, if you test the
performance at that time automatically, you'll never find a worthwhile
server...
How about getting the 5 fastest results the first time - then when you run,
start with the first in the list (that way you probably get more consistent
performance) and if that server isn't available, the user cancels out cause
its too slow or something like that, then go to the next server and also find
a new one in the background? That should be fairly seemless for the user
since its fairly unlikely that a normal user will run out of servers in his
list before a new one has been found...
Well, at least at 3:15am this sounds like a good plan :-)
Peter.
3:21 a.m.
On Fri, 2004-11-19 at 03:17 -0500, Peter Arremann wrote:
How about getting the 5 fastest results the first time - then when
you run,
start with the first in the list (that way you probably get more consistent
performance) and if that server isn't available, the user cancels out cause
its too slow or something like that, then go to the next server and also find
a new one in the background? That should be fairly seemless for the user
since its fairly unlikely that a normal user will run out of servers in his
list before a new one has been found...
This could have some interesting effects....
The nearest and normally best server to me is in a building within sight
and with direct fibre. However that server is a known Fedora mirror.
On release days (or weeks) it, um, struggles somewhat (load average of
250 is normal) and we hit the user limits.
So if you install during the release week, and (rightly) update
immediately afterwards, you *could* end up with strange ideas of how the
network looks, which are not really valid when the fuss calms down a
bit.
Not a major problem, but release periods tends to be... strange.
Nigel.
--
[ Nigel Metheringham Nigel.Metheringham(a)InTechnology.co.uk ]
[ - Comments in this message are my own and not ITO opinion/policy - ]
2:29 a.m.
On Fri, 2004-11-19 at 02:41 -0500, seth vidal wrote:
> Haven't looked at this yet, but how about selecting more
than one mirror
> (e.g. the 5 best), creating a local yum mirror file, and pointing yum's
> configuration to that file:///path/to/that/mirrorlist? I really like the
> fact that yum tries another server when one doesn't seem to respond, which
> wouldn't be the case anymore with a single baseurl configured.
What about combining this:
http://aspn.activestate.com/ASPN/Cookbook/Python/Recipe/284631
with netselect and generating a mirrorlist of the best mirrors every
night or something?
hmmm measuring during the times the net is quiet sounds evil... also
loading a bunch of mirrors all the time just to measure bw sounds like
it won't scale well with the number of people doing it.
I wonder if yum could do a reverse dns lookup, and then do a
right-to-left matching trick on the name vs the mirrors (perhaps
excepting .com/.net/.org); that way for me, I get at least mirrors in
.nl, and if my ISP's mirror gets into the mirror list, I'll always get
that one.
Well maybe it needs a few tricks, like traceroute to somewhere with a
TTL of 4, and use some of the intermediate machines for the matching as
well (and have the same info available for each mirror) so that you stay
within the same upstream bandwidth provider etc etc
8:43 a.m.
hmmm measuring during the times the net is quiet sounds evil... also
loading a bunch of mirrors all the time just to measure bw sounds like
it won't scale well with the number of people doing it.
I wonder if yum could do a reverse dns lookup, and then do a
right-to-left matching trick on the name vs the mirrors (perhaps
excepting .com/.net/.org); that way for me, I get at least mirrors in
.nl, and if my ISP's mirror gets into the mirror list, I'll always get
that one.
Well maybe it needs a few tricks, like traceroute to somewhere with a
TTL of 4, and use some of the intermediate machines for the matching as
well (and have the same info available for each mirror) so that you stay
within the same upstream bandwidth provider etc etc
The above is why I suggested doing this in a secondary script and not in
yum. It would be a mess to put that code _in_ yum. But if someone wanted
to write a generic mirror tester then lots of things could use it.
-sv
1 p.m.
On 2004-11-19 (Friday) 10:29, Arjan van de Ven wrote:
I wonder if yum could do a reverse dns lookup, and then do a
right-to-left matching trick on the name vs the mirrors (perhaps
excepting .com/.net/.org); that way for me, I get at least mirrors in
.nl, and if my ISP's mirror gets into the mirror list, I'll always get
that one.
This method will not work in all cases (.edu, in Bulgaria the official
mirror is http://mirrors.evrocom.net /high .bg domain tax/). What about
using http://www.freenet.org.nz/python/ip2country/ip2country.py or similar
solution? Or make a 'worldmap' file that can be used by yum to determinate
the best mirror /f(MyIP, bandwidth, hops, rtt)/?
BTW: how did you get this header, I mean your email inside?
--- cut ---
Reply-To: arjanv <at> redhat <dot> com,
Development discussions related to Fedora Core <fedora-devel-list(a)redhat.com>
--- cut ---
--
Regards,
Doncho N. Gunchev Registered Linux User #291323 at counter.li.org
GPG-Key-ID: 1024D/DA454F79 http://pgp.mit.edu
Key fingerprint = 684F 688B C508 C609 0371 5E0F A089 CB15 DA45 4F79
3:20 p.m.
On Thu, Nov 18, 2004 at 04:43:49PM +0100, Matthias Saou wrote:
> But as I was to lazy to edit all the files in /etc/yum.repos.d/
to use
> the closest mirror I have written a small script which tries to
> determine the best mirror, removes the mirrorlist directive from the
> repo file and appends a baseurl line with the best mirror.
Haven't looked at this yet, but how about selecting more than one mirror
(e.g. the 5 best), creating a local yum mirror file, and pointing yum's
configuration to that file:///path/to/that/mirrorlist? I really like the
I have extended the script to use the best n mirrors and not only one.
The number of mirrors to use can be specified on the commandline. I am,
however, not using the mirrorlist directive but just appending multiple
servers to the baseurl directive.
http://lisas.de/~adrian/rpm/netselect-0.3-0.fdr.3.i386.rpm
http://lisas.de/~adrian/rpm/netselect-0.3-0.fdr.3.src.rpm
http://lisas.de/~adrian/rpm/netselect-yum-0.3-0.fdr.3.i386.rpm
Gentoo use the same technique to determine the best mirror. In addition
to using netselect they offer to meassure the bandwidth by downloading a
100KB file from each mirror.
Adrian
7087
days inactive
7091
days old
8 comments
7 participants
participants (7)
-
Adrian Reber -
Arjan van de Ven -
Doncho N. Gunchev -
Matthias Saou -
Nigel Metheringham -
Peter Arremann -
seth vidal