[GLLUG] TCP/IP protocol efficiency

[Sean O'Malley]

Have you tried crossmeta?

http://www.crossmeta.com/
or is that what you were referring to as non-current?


On Wed, 24 Jan 2007, Mike Szumlinski wrote:

> It is single frames of film datacined from a $500k Thompson Bones.
> It actually is going onto a 4Gb fiber shared storage solution that
> Windows can't read because it is formatted XFS.  We tried ext3, but
> the FS just couldn't handle the data speed (we sustain about
> 320-350MB/sec with the datacine).  Basically once the files are
> scanned in from film, they are fed to an NLE that is doing online 2K
> film editing...so we are simply trying to move data from an XFS
> volume that is really really fast to an NTFS volume that is really
> really fast.  The big problem is that we can't read from XFS in a
> supported way on the Windows side and we can't write to NTFS in a
> supported way on the Linux side...so enter network layer to make
> things slower.
>
> Unless anyone knows a way to run a supported current XFS driver on
> Windows I'm stuck with network speed.  Installing software on the
> linux box could break the support contract on the Bones.  They are a
> bit finicky as to what runs on their controller.
>
> -Mike
>
> On Jan 24, 2007, at 4:11 PM, Sean O'Malley wrote:
>
> >
> >
> > On Wed, 24 Jan 2007, Mike Szumlinski wrote:
> >
> >> I've currently gotten involved with a project that is requiring I
> >> reshare thousands of 12MB files out over TCP/IP from an XFS volume
> >> on SuSe for use with Windows systems.  I have tried sftp and found
> >> the transfer speed to be somewhat less than acceptable over gig-e and
> >> was wondering if anyone had any input into another method of sharing
> >> out the files that would be A) easier and B) faster.  Obviously samba
> >> comes to mind, but I'm wondering if there are other easier ways to
> >> tune this connection.  Any suggestions/ideas would be much
> >> appreciated.
> >
> > What is the nature of the access of the files?
> >
> > Does the client have to download the file each time it accesses it,
> > or does it only have to access it once and process it? or are they
> > restricted sets of machines (internal to a business). How often do the
> > files get accessed? (is it like archive data?)
> >
> > I am wondering if running something like an AFS server/client that
> > does do
> > client side caching would be a more effective approach.
> >
> > _______________________________________________
> > linux-user mailing list
> > linux-user at egr.msu.edu
> > http://mailman.egr.msu.edu/mailman/listinfo/linux-user
>