Re: Processing Data

[Michael Doornbos <mike@imapenguin.com>]

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

On Friday 24 May 2002 10:23 pm, Tom Droege wrote:
> I am a brute force sort of guy.  I have done this by making two copies of
> the pipeline directory and two output directories.  I then use a simple
> shell program that just copies edited versions of setup_param one after the
> other into setup_param.  We shall see if this all works.  At least both
> processors are working full time.  Probably just chatting over their back
> fence gossiping about what this fool is trying to do.

Actually, it sounds like what you have done is a reasonable way of using both 
processors well. Hopefully your dual output doesn't create an IO bottleneck 
on your disks, but letting the kernel do the task switching is the quickest 
way to get the most out of both of your processors.  Modern Linux kernels are 
reasonably good at managing what you have done.  Of course there are always 
better ways of doing things, but the coding time may not be worth the slight 
performance gain. 

If you do have IO problems, you could try letting your old machine catch one 
of the outputs via NFS(or some other network filesystem).  I have done this 
on my small cluster with great success.

I've been enjoying your enthusiastic emails about what you are learning.  
Thanks for taking the time to tell us about them!

Michael

- -- 
Michael Doornbos
President
Imapenguin, LLC
mike@imapenguin.com
www.imapenguin.com
PGP Fingerprint
2F98 37A3 F49F 422F 7D0F  C9F0 6E6E 48DD FE05 F97C
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.0.6 (GNU/Linux)
Comment: For info see http://www.gnupg.org

iD8DBQE873Lrbm5I3f4F+XwRAviXAJ4nD47vYYZUvTLxKrHBYUJWVcD1XgCfV6/A
eSUu/QGP+Y7phSpDn6EzngM=
=0Qz1
-----END PGP SIGNATURE-----