Daily Tasks
A list of tasks which must be performed each day to monitor the health of the T2 site.
General cluster
- Look at nagios! --> http://osg-test3.unl.edu/nagios/
Grid Interfaces
CMS Tests
- The SAM webpage is located at here. There should be an entry for site Nebraska and it should pass all tests.
- The JobRobot page. Click on the latest day's worth of information. Look for unl in the table (usually second-to-last). Verify that all jobs have been successful.
OSG Tests
- CEMon/BDII Server Status. Look for the red.unl.edu entry; make sure that the Served Data age and CEMon Data Feed entry have both been updated within the last 10 minutes. (There may also be a BDII Data Feed column which is very old; ignore it)
- VORS. There should be two green dots in Nebraska from VORS (one for storage, one for CE). Make sure Nebraska and T2_Nebraska_Storage both PASS in the table.
- T2_Storage_Nebraska. Click on the link to the Latest Test Results. Make sure all tests PASS.
- Nebraska. Click on the link to the Latest Test Results. Make sure all tests PASS (except for optional VDS ones).
dCache
- Visit this webpage to make sure dCache is running. Look for any cells listed as OFFLINE.
- Hand-test an SRM transfer.
- Hand-test a dcap transfer.
Phedex
- Check network graphs to make sure LoadTest transfers are happening.
- Visit the PhEDEx webpage, make sure we are appearing in the data rates table.
- Investigate / report any transfer errors.
- Check last 24 hour's transfer quality. Report any significant deviations from 100%.
Websites
- Visit t2.unl.edu (this webpage) to make sure it is online.