DQ2 tutorial
Introduction
Globus credentials, NICADD and lxplus computer accounts are required.
Project directories should be created
as /xdata/user/athena (here and below replace 'user' with your login name).
The "/xdata" and "/bdata" disks are accessible from all desktops and cluster nodes.
Please never store large data files in the home directory.
Setup the T3 environment
SSH to t3int0.nicadd.niu.edu (known as t3int0 for nicadd desktops).
The below tutorial will use the mc08.005144.PythiaZee.recon.AOD.e323_s400_d99_r47 dataset for the input.
The dq2-ls example
To check that the input dataset is avalable on the grid :
Open the new shell on pt3int0
[user@pt3int0 ~]$ setupATLAS
[user@pt3int0 ~]$ localSetupDQ2Client
************************************************************************
It is strongly recommended that you run DQ2 in a new session
It may use a different version of python from Athena.
************************************************************************
Continue ? (yes[no]) : yes
Setting up DQ2 Client ...
Setting up gLite ...
Setting up gLite version 3.1.38-0
Current python version was 2.4.3 ...
Setting up python from /export/share/atlas/ATLASLocalRootBase/x86_64/gLite/3.1.38-0/external/usr/bin.
*****************************************************************
Setting up DQ2 Client version 0.1.33
DQ2_LOCAL_SITE_ID is ROAMING
To change this, create a file
/export/share/atlas/ATLASLocalRootBase/config/localDQ2ClientSetup.sh
containing the line
export DQ2_LOCAL_SITE_ID=
*****************************************************************
[user@pt3int0 ~]$ dq2-ls -fH valid1.105144.PythiaZee.recon.AOD.e380_a80_tid039474/
Missing voms proxy. Create one with: voms-proxy-init -voms atlas
[user@pt3int0 ~]$ voms-proxy-init -voms atlas
Cannot find file or dir: /home/user/.glite/vomses
Enter GRID pass phrase: xxxxxxxxx
Your identity: /DC=org/DC=doegrids/OU=People/CN=FirstName LastName xxxxxx
Creating temporary proxy ............................... Done
Contacting voms.cern.ch:15001 [/DC=ch/DC=cern/OU=computers/CN=voms.cern.ch] "atlas" Done
Creating proxy .................................................... Done
Your proxy is valid until Sat Jul 24 01:35:30 2010
[user@pt3int0 ~]$ dq2-ls -fH valid1.105144.PythiaZee.recon.AOD.e380_a80_tid039474/
valid1.105144.PythiaZee.recon.AOD.e380_a80_tid039474/
[ ] AOD.039474._00038.pool.root.1 DCA4E600-2DEA-DD11-BD96-001D0963C6F3 md5:68c81e8b43d4ac1d0f1914432b527e58 31.02 MB
[ ] AOD.039474._00012.pool.root.1 947C7B7B-2EEA-DD11-9740-001636E07B80 md5:8d3e5af371aeb5dd03065af57bb389ff 30.50 MB
................................................................................................................................
[ ] AOD.039474._00028.pool.root.1 08B979A6-2CEA-DD11-A169-001D0963D997 md5:ad0054790e82b68c963a42c0af8e3363 30.75 MB
total files: 40
local files: 0
total size: 1.22 GB
date: 2009-01-27 13:18:11
###Done. Note for nicadd users - to store data downloaded with dq2-get
please create/use /xdata/user/mystoredir
or /bdata/user/mystoredir
Next
Batch processing:: The Tier3 farm at Nicadd
Sergey A. Uzunyan
Last modified: Tue Aug 26 14:08:46 CDT 2014