FAQ
With the imminent release of CentOS 4.3 , and then 3.7 ... we are looking
for ways to improve the way we get CentOS to end users.

It is likely that shortly we will restrict access to msync.centos.org to
officialy registered mirrors. This is to try to conserve the bandwidth
that we have available to sync mirrors.

We will also be switching rsync access to mirror.centos.org off as that
should not be used by external mirrors to sync. (mirrors should
preferably use us-msync. and eu-msync. - but otherwise msync. )

That would mean that new mirrors would need an alternative method to sync
and we will be requesting that they initially sync from another mirror.
Then once synced and registered they would be given access to
msync.centos.org if needed.

( It is assumed that any mirrors that provide
rsync access will be happy for new mirrors to sync using them, but if not
please speak up ... )

In order to scale up we may need for external mirrors to become hubs and
act as sync masters for other mirrors. Alternatively we do need more
geographically spread servers of our own - if anyone has any spare ....

It is also possible that we could provide the whole tree via bittorrent
for new mirrors to use to sync - but thawould onyl be of benefit if
mirrors were prepared to act as feeds for the torrent.

Also a proposal that has been made is to provide access to dvd.iso files
on external mirrors and we are looking into doing that. At the moment
dvd.iso files are only available by bittorrent and some people are forbidden from using
that by companies regulations.

We also have a vault of older CentOS releases that we keep at
vault.centos.org, (approx 115 GB - but will grow slightly once CentOS 4.2
is vaulted) that could benefit from being mirrored more widely.

So - if any mirrors have space and bandwidth to spare , then please answer
the following questions.

---------------------

1. Would you be prepared to act as a hub for other (local) mirrors to sync
from - either by providing us with a server to use, or setting up an
apache virtual host that we can point to (would have to be
standard CentOS mirror structure ) - and an rsync module.

--------------------

2. Would you be prepared to feed a bittorrent of the centos tree for new
mirrors to use to sync ??

--------------------

3. Would you be prepared to mirror dvd.iso files , (bearing in mind the
apache 2GB file size restriction may mean using a different http server)

We would provide these as a separate rsync repo - and they could
(preferably) be initially downloaded via bitorrent.

Our iso redirect system would see which mirrors carried the dvd iso files
and offer those mirrors to users for those files.

--------------------

4. Would you be prepared to mirror vault.centos.org

--------------------


Do you have any other suggestions ??

Regards
Lance
--
uklinux.net -
The ISP of choice for the discerning Linux user.

Search Discussions

  • Seth vidal at Mar 8, 2006 at 8:13 pm

    On Wed, 2006-03-08 at 17:43 +0000, Lance Davis wrote:
    In order to scale up we may need for external mirrors to become hubs and
    act as sync masters for other mirrors. Alternatively we do need more
    geographically spread servers of our own - if anyone has any spare ....

    Right now mirror.linux.duke.edu is available with a restricted rsync
    port for mirroring. We have a lot of hosts that mirror fedora in our
    allow list and I'm sure a lot of those same hosts mirror centos, as
    well.

    So anyone who is currently pulling direct from centos and already syncs
    from mirror.linux.duke.edu for fedora releases can just grab centos from
    us, too.

    in short: mirror.linux.duke.edu is cool w/acting as a hub for
    I2-connected institutions. If there are adjustments to how we currently
    mirror centos that need to be made, let me know.

    thanks
    -sv
  • Bob Pierce at Mar 8, 2006 at 8:21 pm
    These all sound like good changes to me.

    We would most likely be willing to mirror the dvd.iso files. Do you know
    if there are any plans to build an RPM of apache 2.2 for CentOS4? It
    looks like Apache 2.2 has large file size support.

    We may also be willing to become an rsync hub. The hub would share the
    same 5Mbit/sec download cap as our HTTP mirror. This might not be
    significant enough bandwidth to help sync a new mirror. However, Centos
    is the only thing we are mirroring and that 5Mbit/sec is always there
    ready for centos downloads.

    Keep up the great work.

    Bob Pierce
    Systems Analyst
    Westman Communications Group
    pierceb@westmancom.com



    -----Original Message-----
    From: centos-mirror-bounces@centos.org
    On Behalf Of Lance Davis
    Sent: Wednesday, March 08, 2006 11:44 AM
    To: centos-mirror@centos.org
    Subject: [CentOS-mirror] CentOS Mirror System Proposals)


    With the imminent release of CentOS 4.3 , and then 3.7 ... we are
    looking for ways to improve the way we get CentOS to end users.

    It is likely that shortly we will restrict access to msync.centos.org to
    officialy registered mirrors. This is to try to conserve the bandwidth
    that we have available to sync mirrors.

    We will also be switching rsync access to mirror.centos.org off as that
    should not be used by external mirrors to sync. (mirrors should
    preferably use us-msync. and eu-msync. - but otherwise msync. )

    That would mean that new mirrors would need an alternative method to
    sync and we will be requesting that they initially sync from another
    mirror.
    Then once synced and registered they would be given access to
    msync.centos.org if needed.

    ( It is assumed that any mirrors that provide rsync access will be happy
    for new mirrors to sync using them, but if not please speak up ... )

    In order to scale up we may need for external mirrors to become hubs and
    act as sync masters for other mirrors. Alternatively we do need more
    geographically spread servers of our own - if anyone has any spare ....

    It is also possible that we could provide the whole tree via bittorrent
    for new mirrors to use to sync - but thawould onyl be of benefit if
    mirrors were prepared to act as feeds for the torrent.

    Also a proposal that has been made is to provide access to dvd.iso
    files on external mirrors and we are looking into doing that. At the
    moment dvd.iso files are only available by bittorrent and some people
    are forbidden from using that by companies regulations.

    We also have a vault of older CentOS releases that we keep at
    vault.centos.org, (approx 115 GB - but will grow slightly once CentOS
    4.2 is vaulted) that could benefit from being mirrored more widely.

    So - if any mirrors have space and bandwidth to spare , then please
    answer the following questions.

    ---------------------

    1. Would you be prepared to act as a hub for other (local) mirrors to
    sync from - either by providing us with a server to use, or setting up
    an apache virtual host that we can point to (would have to be standard
    CentOS mirror structure ) - and an rsync module.

    --------------------

    2. Would you be prepared to feed a bittorrent of the centos tree for new
    mirrors to use to sync ??

    --------------------

    3. Would you be prepared to mirror dvd.iso files , (bearing in mind the
    apache 2GB file size restriction may mean using a different http server)

    We would provide these as a separate rsync repo - and they could
    (preferably) be initially downloaded via bitorrent.

    Our iso redirect system would see which mirrors carried the dvd iso
    files and offer those mirrors to users for those files.

    --------------------

    4. Would you be prepared to mirror vault.centos.org

    --------------------


    Do you have any other suggestions ??

    Regards
    Lance
    --
    uklinux.net -
    The ISP of choice for the discerning Linux user.


    _______________________________________________
    CentOS-mirror mailing list
    CentOS-mirror@centos.org
    http://lists.centos.org/mailman/listinfo/centos-mirror
  • Seth vidal at Mar 8, 2006 at 8:26 pm

    On Wed, 2006-03-08 at 14:21 -0600, Bob Pierce wrote:
    These all sound like good changes to me.

    We would most likely be willing to mirror the dvd.iso files. Do you know
    if there are any plans to build an RPM of apache 2.2 for CentOS4? It
    looks like Apache 2.2 has large file size support.
    apache 2.0 works for LFS (well, at least on x86_64).

    and an apache 2.2 package would need to be in centos-plus or addons or
    whatever - not in core.

    -sv
  • Bob Pierce at Mar 8, 2006 at 8:58 pm
    If apache 2.0 works with large files, then we'd be happy to mirror the
    dvd.iso files.

    About Apache 2.2, I was referring to an extra package outside of core.
    But if the functionality is not needed then that's fine.

    Bob.

    -----Original Message-----
    From: centos-mirror-bounces@centos.org
    On Behalf Of seth vidal
    Sent: Wednesday, March 08, 2006 2:27 PM
    To: Mailing list for CentOS mirrors.
    Subject: RE: [CentOS-mirror] CentOS Mirror System Proposals)
    On Wed, 2006-03-08 at 14:21 -0600, Bob Pierce wrote:
    These all sound like good changes to me.

    We would most likely be willing to mirror the dvd.iso files. Do you
    know if there are any plans to build an RPM of apache 2.2 for CentOS4?
    It looks like Apache 2.2 has large file size support.
    apache 2.0 works for LFS (well, at least on x86_64).

    and an apache 2.2 package would need to be in centos-plus or addons or
    whatever - not in core.

    -sv


    _______________________________________________
    CentOS-mirror mailing list
    CentOS-mirror@centos.org
    http://lists.centos.org/mailman/listinfo/centos-mirror
  • Seth vidal at Mar 8, 2006 at 9:06 pm

    On Wed, 2006-03-08 at 14:58 -0600, Bob Pierce wrote:
    If apache 2.0 works with large files, then we'd be happy to mirror the
    dvd.iso files.

    About Apache 2.2, I was referring to an extra package outside of core.
    But if the functionality is not needed then that's fine.
    easy to test
    1. make a file from urandom that's 3.4GB (size of avg iso)
    2. create a checksum of it (sha1sum thatfile)
    3. transfer file using wget to another machine
    4. compare the checksum

    -sv
  • Mihai Maties at Mar 8, 2006 at 9:25 pm

    On Wednesday 08 March 2006 23:06, seth vidal wrote:
    On Wed, 2006-03-08 at 14:58 -0600, Bob Pierce wrote:
    If apache 2.0 works with large files, then we'd be happy to mirror the
    dvd.iso files.

    About Apache 2.2, I was referring to an extra package outside of core.
    But if the functionality is not needed then that's fine.
    easy to test
    1. make a file from urandom that's 3.4GB (size of avg iso)
    I don't know if this is such a good idea. dd if=/dev/zero is much faster than
    dd if=/dev/urandom and the output file suits your test. I'm pretty sure that
    if wget will fsck up the file the test will show it even if the original file
    was full of zeros (and BTW, make sure you are using a wget binary with LFS,
    or else the test is useless :)
    2. create a checksum of it (sha1sum thatfile)
    3. transfer file using wget to another machine
    4. compare the checksum

    Mihai
  • Peter Kjellström at Mar 9, 2006 at 6:01 pm

    On Wednesday 08 March 2006 18:43, Lance Davis wrote:
    ---------------------

    1. Would you be prepared to act as a hub for other (local) mirrors to sync
    from - either by providing us with a server to use, or setting up an
    apache virtual host that we can point to (would have to be
    standard CentOS mirror structure ) - and an rsync module.
    I could be a hub, I already allow rsync from * and I have a standard tree (I
    think). If it would require more work then maybe.
    --------------------

    2. Would you be prepared to feed a bittorrent of the centos tree for new
    mirrors to use to sync ??
    If it was easy, secure and had logging and monitoring.
    --------------------

    3. Would you be prepared to mirror dvd.iso files , (bearing in mind the
    apache 2GB file size restriction may mean using a different http server)
    If it could be done with a package with an working repo (updates) on i386,
    yes.
    We would provide these as a separate rsync repo - and they could
    (preferably) be initially downloaded via bitorrent.

    Our iso redirect system would see which mirrors carried the dvd iso files
    and offer those mirrors to users for those files.

    --------------------

    4. Would you be prepared to mirror vault.centos.org
    Allready do, and I'd like to nominate debuginfo too for "extra full" mirrors.

    /Peter
    Do you have any other suggestions ??
    Only then the possible mirroring of debuginfo.
    Regards
    Lance
    --
    ------------------------------------------------------------
    Peter Kjellstr?m |
    National Supercomputer Centre |
    Sweden | http://www.nsc.liu.se
    -------------- next part --------------
    A non-text attachment was scrubbed...
    Name: not available
    Type: application/pgp-signature
    Size: 191 bytes
    Desc: not available
    Url : http://lists.centos.org/pipermail/centos-mirror/attachments/20060309/2232ba84/attachment.bin
  • Arctic Network Administrator at Mar 9, 2006 at 6:26 pm

    for arcticnetwork.ca:

    1. Would you be prepared to act as a hub for other (local) mirrors to sync
    from - either by providing us with a server to use, or setting up an
    apache virtual host that we can point to (would have to be
    standard CentOS mirror structure ) - and an rsync module.
    Yes. We currently offer CentOS via rsync. rsync.arcticnetwork.ca::centos
    2. Would you be prepared to feed a bittorrent of the centos tree for new
    mirrors to use to sync ??
    No. We are supported by our provider because we are a network-friendly
    alternative to Bittorrent. Bittorrent is bad.
    3. Would you be prepared to mirror dvd.iso files , (bearing in mind the
    Our webserver (lighttpd) supports large files. We also offer our
    collections via FTP which supports large file sizes.
    --------------------

    4. Would you be prepared to mirror vault.centos.org
    Not at this time due to disk space requirements.
    Do you have any other suggestions ??
    Are there any plans for a mirror status tool? Several other projects
    run something as simple as mirmon, or as complex as a custom
    automatic-notification monitoring tool, like CPAN has.
  • Bob Pierce at Mar 9, 2006 at 9:12 pm
    It doesn't look like LFS is supported by apache 2.0 on i386.

    I downloaded the Centos4.2 x86_64 DVD to our server as a test file.
    When I go to download it I get the following in the http error log:
    [error] [client 216.xx.xx.xx] (75)Value too large for defined data type:
    access to /CentOS-4.2-x86_64-binDVD1.iso failed

    So, we may be limited to only offering the dvd.iso files on our ftp
    mirror

    Bob.

    -----Original Message-----
    From: centos-mirror-bounces@centos.org
    On Behalf Of seth vidal
    Sent: Wednesday, March 08, 2006 3:06 PM
    To: Mailing list for CentOS mirrors.
    Subject: RE: [CentOS-mirror] CentOS Mirror System Proposals)
    On Wed, 2006-03-08 at 14:58 -0600, Bob Pierce wrote:
    If apache 2.0 works with large files, then we'd be happy to mirror the
    dvd.iso files.

    About Apache 2.2, I was referring to an extra package outside of core.
    But if the functionality is not needed then that's fine.
    easy to test
    1. make a file from urandom that's 3.4GB (size of avg iso) 2. create a
    checksum of it (sha1sum thatfile) 3. transfer file using wget to another
    machine 4. compare the checksum

    -sv


    _______________________________________________
    CentOS-mirror mailing list
    CentOS-mirror@centos.org
    http://lists.centos.org/mailman/listinfo/centos-mirror
  • Johnny Hughes at Mar 10, 2006 at 12:40 am

    On Thu, 2006-03-09 at 15:12 -0600, Bob Pierce wrote:
    It doesn't look like LFS is supported by apache 2.0 on i386.
    That is true ... we are working on something for that (either an
    httpd-2.2 in centosplus or a patched version of httpd-2.0 with LFS
    support in centosplus. It does break some things either way (so I would
    only use it on a mirror server and not on production boxes). Neither of
    these will probably be ready for the 4.3 release.
    I downloaded the Centos4.2 x86_64 DVD to our server as a test file.
    When I go to download it I get the following in the http error log:
    [error] [client 216.xx.xx.xx] (75)Value too large for defined data type:
    access to /CentOS-4.2-x86_64-binDVD1.iso failed

    So, we may be limited to only offering the dvd.iso files on our ftp
    mirror
    That is a nice option. We still need to workout the path details for
    where the DVDs will go (on FTP servers), so I think initially on 4.3 we
    will just stick to DVD only via BitTorrent.
    Bob.

    -----Original Message-----
    From: centos-mirror-bounces@centos.org
    On Behalf Of seth vidal
    Sent: Wednesday, March 08, 2006 3:06 PM
    To: Mailing list for CentOS mirrors.
    Subject: RE: [CentOS-mirror] CentOS Mirror System Proposals)
    On Wed, 2006-03-08 at 14:58 -0600, Bob Pierce wrote:
    If apache 2.0 works with large files, then we'd be happy to mirror the
    dvd.iso files.

    About Apache 2.2, I was referring to an extra package outside of core.
    But if the functionality is not needed then that's fine.
    easy to test
    1. make a file from urandom that's 3.4GB (size of avg iso) 2. create a
    checksum of it (sha1sum thatfile) 3. transfer file using wget to another
    machine 4. compare the checksum

    -sv
    -------------- next part --------------
    A non-text attachment was scrubbed...
    Name: not available
    Type: application/pgp-signature
    Size: 189 bytes
    Desc: This is a digitally signed message part
    Url : http://lists.centos.org/pipermail/centos-mirror/attachments/20060309/6f294c2d/attachment.bin

Related Discussions

Discussion Navigation
viewthread | post
Discussion Overview
groupcentos-mirror @
categoriescentos
postedMar 8, '06 at 5:43p
activeMar 10, '06 at 12:40a
posts11
users7
websitecentos.org
irc#centos

People

Translate

site design / logo © 2022 Grokbase