2007/05/11
CE Changes
by
admin
—
posted at
2007-05-11 12:43
last modified
2007-05-11 12:43
While reorganizing the CE, the following changes were made.
Mount Points
Each node has one mount point to each NFS server. There are three NFS servers: nfs03 (internal disks), nfs04 (Fibre Channel), and nfs05 (SSA disks). On any given node, there should be the following mounts:- /mnt/nfs03 -> nfs03:/mnt/raid
- /mnt/nfs04 -> nfs04:/mnt/raid
- /mnt/ssa -> nfs05:/ssa
Soft Links / Directory Locations
The following soft links should be on all nodes:- /grid_home -> /mnt/nfs04/grid_home
- /home -> /mnt/nfs04/home
- /grid_home2 -> /mnt/nfs03/grid_home2
- /opt/kickstart -> /mnt/nfs04/opt/kickstart
- /opt/osg/app -> /mnt/nfs04/opt/osg/app
- /opt/osg/data -> /mnt/nfs03/zeng/osg_data/data
- /zeng -> /mnt/nfs03/zeng/zeng
- /opt/condor/local -> /scratch/condor (or /opt-head/condor_logs on the head node)
The correct OSG stack is now located in /opt/osg/osg-060 (local disk). On worker nodes, it is the osg-wn-client. On the head node, it is the full CE install.
Rsync
The following directories are rsync'd to avoid NFS load:- /opt/osg/osg-wn-source -> /opt/osg/osg-060 (worker nodes only)
- /opt/osg/osg-060/globus/share/certificates -> /etc/grid-security/certificates
- /mnt/nfs04/opt/condor/ -> /opt/condor
Changes made to nodes
The following individual changes were made to the nodes which were alive:mkdir -p /mnfs/nfs03Again, additional changes will need to be done to configure condor.
mkdir -p /mnt/nfs04
mkdir -p /mnt/ssa
cp /opt/kickstart/hosts /etc/hosts
cp /opt/kickstart/fstab /etc/fstab
mount -a
mkdir -p /opt/osg/osg-060
ln -s /mnt/nfs04/opt/kickstart /opt/kickstart
ln -s /mnt/nfs04/opt-2/osg-wn-source /opt/osg/osg-wn-source
mkdir -p /etc/grid-security/certificates
cp /opt/kickstart/crontab /etc/crontab
cp /opt/kickstart/osg.sh /etc/profile.d/osg.sh
ln -s /mnt/nfs04/opt/osg/app /opt/osg/app
ln -s /mnt/nfs03/zeng/osg_data/data /opt/osg/data
cp /mnt/nfs04/opt/condor/etc/examples/condor.boot /etc/init.d/condor.boot
/sbin/chkconfig --level 345 condor.boot on
mkdir -p /scratch/condor/log
mkdir -p /scratch/condor/spool
mkdir -p /scratch/condor/execute
chown -R condor /scratch/condor/execute
chmod a+w /scratch/condor/execute
- Category(s)
- default