[olug] large files

[Matthew G. Marsh]

On Sat, 22 Mar 2003, Phil Brutsche wrote:

> A long time ago, in a galaxy far, far way, someone said...
>
> > On Sat, 22 Mar 2003, Vincent wrote:
> >
> > >                              Ext3           ReiserFS    XFS                 JFS
> > > File system max     16384 Gb  17592 Gb   18,000 Pb+     32 Pb
> > > File size max          2048 Gb    1 Eb*          9,000 Pb         4 Pb
> >
> > Yes note your first numbers - reality is that on a 32 bit OS (aka Linux on
> > x86) the _file_ size limit is still 2G (2048M). Try it some time -
> > seriously I still run into this especially with Squid and SNORT logs...
> >
> > Once you have a _file_ over 2G the application usually just stops working.
>
> You must not have your glibc compiled for large file support :)  Large
> file support requires a 2.4.x or 2.5.x kernel as well as a properly
> compiled glibc 2.2.x.

Correct!

Unfortunately only lately true as there were problems with large file
especially under SMP until mid 2.4 (2.4.9+ IIRC) although I think most of
the distros using 2.4 kernels had mega patches for this. Of course the
rest of the VM problems in early 2.4 overshadowed the large file stuff.

OT - have you played at all with the P4 syscall speedups in
linux2.5/glibc2.4 at all? I am way curious but my only P4 machine is my
lapdesktop and I try not to hack on it... ;-}

I have been starting to play with the IPSec in 2.5 now to see how it will
fit in with multiple tunnels and the number crunching in that could use a
boost in performance.

> --
>
> Phil Brutsche
> phil at brutsche.us

--------------------------------------------------
Matthew G. Marsh,  President
Paktronix Systems LLC
1506 North 59th Street
Omaha  NE  68104
Phone: (402) 553-2288
Email: mgm at midwestlinux.com
WWW:  http://www.midwestlinux.com
--------------------------------------------------