| 1) Mag Gam Re: [CentOS] ZFS on Linux |
|
|
| thanks everyone for your fair and balanced opinions and experiences! ... |
|
|
|
|
|
|
|
thanks everyone for your fair and balanced opinions and experiences!
On Sun, Dec 28, 2008 at 2:38 PM, Davide Cittaro <davide.cittaro@ifom-ieo-campus.it> wrote: > > On Dec 28, 2008, at 7:16 PM, Mag Gam wrote: > >> I am planning to use ZFS on my Centos 5.2 systems. The data I am >> storing is very large text files where each file can range from 10M to >> 20G. I am very interested on the compression feature of ZFS, and it >> seems no other native Linux FS supports it. >> > > Even if fuse implementation of ZFS looks rather stable, I won't > suggest it in a production environment... > We strongly wanted ZFS and we chose for Solaris 10 for our file server. > >> My question are: Is ZFS stable? How does it scale for very large >> filesytems, ie, 2TB to 9TB? How is the performance of fuse? I plan to >> use it on my archive server first, so data reliability is very >> important > > ZFS really is great. We are now managing three 18Tb archives. It is > not only reliable, it comes with zpool and zfs commands that really > make it easy to manage! > If you don't want Solaris, you can use FreeBSD 7 which supports native > ZFS. > > d > > Davide Cittaro > [email protected: davide.ci...@ifom-ieo-campus.it] > > > > _______________________________________________ > CentOS mailing list > [email protected: C...@centos.org] > http://lists.centos.org/mailman/listinfo/centos > _______________________________________________ CentOS mailing list [email protected: C...@centos.org] http://lists.centos.org/mailman/listinfo/centos
|
|
|
| 2) Mag Gam [CentOS] ZFS on Linux |
|
|
| I am planning to use ZFS on my Centos 5.2 systems. The data I am storing is very large text files... |
|
|
|
|
|
|
|
I am planning to use ZFS on my Centos 5.2 systems. The data I am storing is very large text files where each file can range from 10M to 20G. I am very interested on the compression feature of ZFS, and it seems no other native Linux FS supports it. My question are: Is ZFS stable? How does it scale for very large filesytems, ie, 2TB to 9TB? How is the performance of fuse? I plan to use it on my archive server first, so data reliability is very important Any thoughts or ideas? TIA
|
|
|
| 3) Mag Gam Re: [CentOS] bonding theory question |
|
|
| So, I decided to go with mode 6 since my network admin says thats supported at my college. I have... |
|
|
|
|
|
|
|
So, I decided to go with mode 6 since my network admin says thats supported at my college. I have everything working perfectly however I still get an occasional packet drop which is not good. http://www.howtoforge.com/network_card_bonding_centosBy reading the HOWTO and README.txt I am not sure if I am missing anything else. Has anyone else configured this before? TIA
On Sat, Sep 6, 2008 at 2:22 PM, Filipe Brandenburger <filbranden@gmail.com> wrote: > On Sat, Sep 6, 2008 at 13:11, Mag Gam <magawake@gmail.com> wrote: >> Actually, would there be a big performance boost when using mode4? > > Not necessarily, since balance-rr already gives you load-balancing. > They actually implement it differently. balance-rr can spread packets > of the same TCP connection across the two links, so you may use your > links more, but with the side effect of having your packets delivered > out of order. In 802.3ad all packets of a single TCP connection will > use the same link, this means your links will not be as balanced as > what you get with balance-rr, but it will not require reordering on > the other side of the connection. Check section 12.1.1 in > /usr/share/doc/iputils-*/README.bonding . In any case, you should > evaluate what your needs are and tune for that. > >> Currently I am seeing 95% total throughput. > > If you have only a few clients doing huge transfers, 802.3ad will > probably not be as good as balance-rr for that. Again, you should tune > it for your needs. > >> Which isn't that bad. I am >> peaking at 238MB/sec (each gig/e connections) > > I believe you mean 238MB/sec on both interfaces, since 1Gbps = 125MB/s. > >> Also, mode0 does fault tolerance, meaning if a switch failure occurs >> we should still be good, but how would the packets then be >> transferred? I suppose rr would be disabled since it won't need to >> alternate, correct? > > Actually balance-rr is still there, it is only doing round-robin of > one interface only. Remember, you could have a bonding of 3, 4 or more > interfaces, in that case if you loose one you still have more than one > to balance traffic through. > > Filipe > _______________________________________________ > CentOS mailing list > [email protected: C...@centos.org] > http://lists.centos.org/mailman/listinfo/centos > _______________________________________________ CentOS mailing list [email protected: C...@centos.org] http://lists.centos.org/mailman/listinfo/centos
|
|
|
| 4) Mag Gam Re: [CentOS] strict memory |
|
|
| Hi John: Well, we run a lot of statistical analysis and our code loads a lot of data into a vector... |
|
|
|
|
|
|
|
Hi John: Well, we run a lot of statistical analysis and our code loads a lot of data into a vector for fast calculations. I am not sure how else to do these calculations fast without loading it into memory. Thats why we have to do it this way. TIA
On Thu, Oct 16, 2008 at 1:00 PM, John R Pierce <pierce@hogranch.com> wrote: > Mag Gam wrote: >> >> Hello All: >> >> Running 5.2 at our university. We have several student's processes >> that take up too much memory. Our system have 64G of RAM and some >> processes take close to 32-48G of RAM. This is causing many problems >> for others. I was wondering if there is a way to restrict memory usage >> per process? If the process goes over 32G simply kill it. Any thoughts >> or ideas? >> >> > > In /etc/profile, use "ulimit -v NNNN" (in kilobytes) to limit the max > virtual of all processes spawned by that shell > > > 32G per process on a 64G machine sounds like a bit much. wouldn't a limit > more like 4GB per user session be more appropriate on a multiuser system? > _______________________________________________ > CentOS mailing list > [email protected: C...@centos.org] > http://lists.centos.org/mailman/listinfo/centos > _______________________________________________ CentOS mailing list [email protected: C...@centos.org] http://lists.centos.org/mailman/listinfo/centos
|
|
|
| 5) Mag Gam Re: [CentOS] strict memory |
|
|
| Yes. Thanks. I was thinking of that too. Any other suggestions? TIA ... |
|
|
|
|
|
|
|
Yes. Thanks. I was thinking of that too. Any other suggestions? TIA
On Thu, Oct 16, 2008 at 12:56 PM, Filipe Brandenburger <filbranden@gmail.com> wrote: > Hi, > > On Thu, Oct 16, 2008 at 12:48, Mag Gam <magawake@gmail.com> wrote: >> I was wondering if there is a way to restrict memory usage >> per process? If the process goes over 32G simply kill it. > > You can limit the amount of virtual memory of a process with "ulimit > -v". See "help ulimit" or "man bash" for more details. > > HTH, > Filipe > _______________________________________________ > CentOS mailing list > [email protected: C...@centos.org] > http://lists.centos.org/mailman/listinfo/centos > _______________________________________________ CentOS mailing list [email protected: C...@centos.org] http://lists.centos.org/mailman/listinfo/centos
|
|
|
| 6) Mag Gam [CentOS] strict memory |
|
|
| Hello All: Running 5.2 at our university. We have several student's processes that take up too much... |
|
|
|
|
|
|
|
Hello All: Running 5.2 at our university. We have several student's processes that take up too much memory. Our system have 64G of RAM and some processes take close to 32-48G of RAM. This is causing many problems for others. I was wondering if there is a way to restrict memory usage per process? If the process goes over 32G simply kill it. Any thoughts or ideas? TIA
|
|
|
| 7) Mag Gam [CentOS] need filesystem recommendation |
|
|
| Hi All, I have a backup site and I would like to rsync from production to backup site. However, I... |
|
|
|
|
|
|
|
Hi All, I have a backup site and I would like to rsync from production to backup site. However, I would like to have all backups be compressed so I can save space. Can anyone recommend a good way to do this? I am currently using tar and bzip2 to do this. TIA
|
|
|
| 8) Mag Gam Re: [CentOS] compiling libarchive |
|
|
| Thanks Ralph. Got libarchive compiled fine, now trying to compile archivemount I keep getting this... |
|
|
|
|
|
|
|
Thanks Ralph. Got libarchive compiled fine, now trying to compile archivemount I keep getting this error now: gcc -D_FILE_OFFSET_BITS=64 -O2 -DNDEBUG -Wall -W -MM archivemount.c > dep gcc -larchive -lfuse -o archivemount archivemount.o archivemount.o(.text+0x1474): In function `save': : undefined reference to `archive_write_set_compression_gzip' archivemount.o(.text+0x147f): In function `save': : undefined reference to `archive_write_set_compression_bzip2' collect2: ld returned 1 exit status make: *** [archivemount] Error 1
On Fri, Sep 5, 2008 at 5:09 AM, Ralph Angenendt <ra+centos@br-online.de> wrote: > Mag Gam wrote: >> Has anyone been able to compile libarchive and archivemount? I want to >> use this with fuse. >> >> The compile is very tough for libarchive, I keep getting >> tar/write.c:730: error: `EXT2_IOC_GETFLAGS' undeclared (first use in >> this function) > > e2fsprogs-devel is missing on your machine. > > Ralph > > _______________________________________________ > CentOS mailing list > [email protected: C...@centos.org] > http://lists.centos.org/mailman/listinfo/centos > > _______________________________________________ CentOS mailing list [email protected: C...@centos.org] http://lists.centos.org/mailman/listinfo/centos
|
|
|
| 9) Mag Gam [CentOS] compiling libarchive |
|
|
| Has anyone been able to compile libarchive and archivemount? I want to use this with fuse. The... |
|
|
|
|
|
|
|
Has anyone been able to compile libarchive and archivemount? I want to use this with fuse. The compile is very tough for libarchive, I keep getting c -o tar/bsdtar-util.o `test -f 'tar/util.c' || echo './'`tar/util.c mv -f tar/.deps/bsdtar-util.Tpo tar/.deps/bsdtar-util.Po gcc -DHAVE_CONFIG_H -I. -I./libarchive -I./libarchive -g -O2 -MT tar/bsdtar-write.o -MD -MP -MF tar/.deps/bsdtar-write.Tpo -c -o tar/bsdtar-write.o `test -f 'tar/write.c' || echo './'`tar/write.c tar/write.c: In function `write_hierarchy': tar/write.c:730: error: `EXT2_IOC_GETFLAGS' undeclared (first use in this function) tar/write.c:730: error: (Each undeclared identifier is reported only once tar/write.c:730: error: for each function it appears in.) tar/write.c:732: error: `EXT2_NODUMP_FL' undeclared (first use in this function) tar/write.c: In function `write_entry': tar/write.c:915: error: `EXT2_IOC_GETFLAGS' undeclared (first use in this function) make[1]: *** [tar/bsdtar-write.o] Error 1 make[1]: Leaving directory `/var/tmp/archivemount-0.5.3/libarchive-2.5.5' make: *** [all] Error 2 TIA
|
|
|
| 10) Mag Gam Re: [CentOS] Re: CentOS 4.7 status |
|
|
| where can we get ISOs? I can test for VirtualBox atleast. If there is a problem I will submit a... |
|
|
|
|
|
|
|
where can we get ISOs? I can test for VirtualBox atleast. If there is a problem I will submit a bug.
On Tue, Sep 2, 2008 at 3:45 PM, Scott Silva <ssilva@sgvwater.com> wrote: > on 8-30-2008 6:37 PM Adrian Sevcenco spake the following: >> >> Hi, >> i was wondering what is the status of 4.7 >> Thank you, >> Best regards, >> Adrian >> > 4.7 was delayed so the buildservers could get 5.2 ready. 4.7 is probably in > the queue now, but it takes a while because CentOS doesn't have a million > dollar hardware budget, and has to schedule things to best use the hardware > available. > > When it is ready and synced to the mirrors, it will be announced. > > -- > MailScanner is like deodorant... > You hope everybody uses it, and > you notice quickly if they don't!!!! > > > _______________________________________________ > CentOS mailing list > [email protected: C...@centos.org] > http://lists.centos.org/mailman/listinfo/centos > > _______________________________________________ CentOS mailing list [email protected: C...@centos.org] http://lists.centos.org/mailman/listinfo/centos
|
|
|
| 11) Mag Gam Re: [CentOS] Changing swap resume signature location |
|
|
| This is a Debian specific command. I am certain something like this exists for CentOS too... |
|
|
|
|
|
|
|
On Mon, Sep 1, 2008 at 2:42 PM, Patrice Guay <patrice.guay@nanotechnologies.qc.ca> wrote: >>> On Sat, Aug 30, 2008 at 8:05 AM, Patrice Guay>>> <patrice.guay@nanotechnologies.qc.ca> wrote:>>>> At boot time, the system is looking for a resume signature on the>>>> default SWAP partition that was defined during the OS installation.>>>>>>>> On several systems, I changed the location of the SWAP partition. How do>>>> I change the location where the system looks at boot time for the resume>>>> signature?>>>>>> 1. Format the swap partition again: sudo mkswap /dev/XXX>> 2. Activate swap partition sudo swapon /dev/XXX>> 3. Replace UUID=XXX in /etc/initramfs-tools/conf.d/resume by>> "resume=/dev/XXX">> 4. Regenerate the initrd: sudo mkinitramfs -o /boot/initrd.img-2.6.XX>> (same version as the kernel)>>>> I cannot find the /etc/initramfs-tools directory on my system. Which> package provides it under CentOS 5?>> Thanks,> --> Patrice> _______________________________________________> CentOS mailing list> [email protected: C...@centos.org]> http://lists.centos.org/mailman/listinfo/centos>This is a Debian specific command. I am certain something like this exists for CentOS too...
|
|
|
| 12) Mag Gam Re: [CentOS] Changing swap resume signature location |
|
|
| 1. Format the swap partition again: sudo mkswap /dev/XXX 2. Activate swap partition sudo swapon... |
|
|
|
|
|
|
|
1. Format the swap partition again: sudo mkswap /dev/XXX 2. Activate swap partition sudo swapon /dev/XXX 3. Replace UUID=XXX in /etc/initramfs-tools/conf.d/resume by "resume=/dev/XXX" 4. Regenerate the initrd: sudo mkinitramfs -o /boot/initrd.img-2.6.XX (same version as the kernel)
On Mon, Sep 1, 2008 at 1:23 PM, Mag Gam <magawake@gmail.com> wrote: > Why not create a new swap partition and place it in /etc/fstab ? > You don't have to worry about swap signatures and all... > > > > > On Sat, Aug 30, 2008 at 8:05 AM, Patrice Guay > <patrice.guay@nanotechnologies.qc.ca> wrote: >> At boot time, the system is looking for a resume signature on the >> default SWAP partition that was defined during the OS installation. >> >> On several systems, I changed the location of the SWAP partition. How do >> I change the location where the system looks at boot time for the resume >> signature? >> >> Thanks, >> -- >> Patrice Guay >> [email protected: patrice...@nanotechnologies.qc.ca] >> _______________________________________________ >> CentOS mailing list >> [email protected: C...@centos.org] >> http://lists.centos.org/mailman/listinfo/centos >> > _______________________________________________ CentOS mailing list [email protected: C...@centos.org] http://lists.centos.org/mailman/listinfo/centos
|
|
|
| 13) Mag Gam Re: [CentOS] Changing swap resume signature location |
|
|
| Why not create a new swap partition and place it in /etc/fstab ? You don't have to worry about swap... |
|
|
|
|
|
|
|
Why not create a new swap partition and place it in /etc/fstab ? You don't have to worry about swap signatures and all...
On Sat, Aug 30, 2008 at 8:05 AM, Patrice Guay <patrice.guay@nanotechnologies.qc.ca> wrote: > At boot time, the system is looking for a resume signature on the > default SWAP partition that was defined during the OS installation. > > On several systems, I changed the location of the SWAP partition. How do > I change the location where the system looks at boot time for the resume > signature? > > Thanks, > -- > Patrice Guay > [email protected: patrice...@nanotechnologies.qc.ca] > _______________________________________________ > CentOS mailing list > [email protected: C...@centos.org] > http://lists.centos.org/mailman/listinfo/centos > _______________________________________________ CentOS mailing list [email protected: C...@centos.org] http://lists.centos.org/mailman/listinfo/centos
|
|
|
| 14) Mag Gam Re: [CentOS] CentOS 4.7 status |
|
|
| Seems Redhat already released 4.7... |
|
|
|
|
|
| |