gridftp-transfer-probe
Documentation for installing the GridFTP transfer probe on a Globus GridFTP server.
The BestMan SRM server can be combined with a Globus GridFTP server overlaid on top of any file system in order to form an OSG storage element. In order to do transfer accounting for these kind of systems, we have a Gratia probe which reports transfers based upon the Globus GridFTP server logs.
This document covers the Gratia GridFTP transfer probe installation. It must be repeated once for every GridFTP server in the SE.
- Source the OSG install:
source /opt/osg/osg-100/setup.sh
- Make a backup of the OSG install:
cp -r $VDT_LOCATION $VDT_LOCATION/../osg-bkp-prior-gratia-probe
- Install the Gratia probe from the VDT through Pacman.
cd $VDT_LOCATION
pacman -get http://vdt.cs.wisc.edu/vdt_1101_cache:Gratia-GridFTP-Transfer-Probe - Source the VDT install again.
source $VDT_LOCATION/setup.sh
- Configure the probe with the newly installed configuration script.
$VDT_LOCATION/vdt/setup/configure_gratia --probe gridftp-transfer --report-to <gratia_host:gratia_port> --probe-cron --site-name "blah"
For an OSG site, this should be (PLEASE CHANGE SITENAME IN FOLLOWING LINE!):$VDT_LOCATION/vdt/setup/configure_gratia --probe gridftp-transfer --report-to gratia-osg-transfer.opensciencegrid.org:80 --probe-cron --site-name "CHANGME" - You need a valid osg-user-vo-map.txt file in $VDT_LOCATION/monitoring. Some sites rarely update this file and the file is the same as the one in the CE (this assumes that the CE UID space is the same as the SE UID space). It might be the simplest option to just automatically copy this file from the CE to SE.
- If this isn't a good solution for you, the next two bulletpoints discuss how to automate this procedure directly from GUMS.
- If your site uses GUMS, please do the following:
- Set the VDT_GUMS_HOST variable:
export VDT_GUMS_HOST=osg-test3.unl.edu
- Install the GUMS client for the gums-host-cron script:
pacman -get http://vdt.cs.wisc.edu/vdt_1101_cache:GUMS-Client
- Check to make sure the file
$VDT_LOCATION/gums/config/gums-client.properties
has the correct GUMS server. If it does not, contact Brian Bockelman: the VDT_GUMS_HOST setting should have taken care of this. - Touch the osg-attributes.conf so the osg-user-vo-map.txt will be generated:
mkdir $VDT_LOCATION/monitoring
touch $VDT_LOCATION/monitoring/osg-attributes.conf - Turn the services on:
vdt-control --on gratia-gridftp-transfer
vdt-control --enable gums-host-cron
vdt-control --on gums-host-cron - This should install a cronjob for the user root. If you run the following command as root:
crontab -l
The output should include a line like this:7,17,27,37,47,57 * * * * /opt/osg/osg-100/gratia/probe/gridftp-transfer/gridftp-transfer_meter.cron.sh > /opt/osg/osg-100/gratia/var/logs/gratia-probe-gridftp-transfer.log 2>&1
- Run gums-host-cron by hand:
/opt/osg/osg-100/gums/scripts/gums-host-cron
It has no output, but you should verify that the generated file is non-zero:ls -l $VDT_LOCATION/monitoring/osg-user-vo-map.txt
If the GUMS users aren't all valid users on the GridFTP server, there will be a file named osg-user-vo-map.txt.new instead of osg-user-vo-map.txt. You may safely copy the .txt.new file over to the .txt name. Contact Brian if this file is not generated or if it is zero sized. - If you use a grid-mapfile or edg-mkgridmap, please contact Brian and he'll help you decide on the best approach.
- If you haven't already, turn on the GridFTP probe:
vdt-control --on gratia-gridftp-transfer
- Make sure the cron job has appeared in the root user's crontab. If you run the following command as root:
crontab -l
The output should include a line like this:36 6,12,18,0 * * * /opt/osg/osg-100/gums/scripts/gums-host-cron
- Run the Gratia probe once by hand to check for functionality:
$VDT_LOCATION/gratia/probe/gridftp-transfer/gridftp-transfer_meter.cron.sh
Look for any abnormal termination and report it if it is a non-trivial site issue. - (Nebraska
admins only) Check the following page to make sure the new GridFTP
server probe shows up on the list of distinct probe names. It will
have the name gridftp-transfer:example.com, where example.com is replaced by the host's FQDN:
http://gratia-osg-transfer.opensciencegrid.org:80/gratia-reporting/showQuery.jsp?sql=select%20distinct%20ProbeName%20from%20JobUsageRecord_Meta;&ReportTitle=Distinct%20Probe%20Names&displayReport=false&__title