This is an old revision of the document!
Table of Contents
Getting data to ANL from the grid
Using dq2-get command
For small data samples, use the dq2-get command. dq2-get are set automatically on atlas16-18 if one uses the setup described on the setup page. Read workbook_introduction how to setup atlas software.
One can also setup the dq2-get client using the CVFMS file system
The DQ2 client is described in this HowTo and this manual with further information here
To setup dq2-get using CVFMS file system, use this script:
- setup.sh
#!/bin/bash export AVERS=17.0.4 export TEST_AREA=$HOME/testarea export ATLAS_LOCAL_ROOT_BASE=/cvmfs/atlas.cern.ch/repo/ATLASLocalRootBase source ${ATLAS_LOCAL_ROOT_BASE}/user/atlasLocalSetup.sh asetup --release=$AVERS --testarea=$TEST_AREA
Put it in a file “setup.sh” and then “source setup.sh”.
Then type:
localSetupDQ2Client voms-proxy-init -voms atlas -valid 96:00
Say “yes” and type your password.
The most often used dq2 commands are below dq2-xxx –help will show the options:
- dq2-get -copies data from local storage or over the grid
- dq2-ls -lists datasets matching a given pattern
- dq2-put -allows the user to create user-defined datasets
- dq2-ls -P -creates PoolFileCatalog.xml
Before starting using this, type:
voms-proxy-init -voms atlas
or using the standard (proxy for 3 days):
grid-proxy-init -valid 96:00
Before start using dq2-get, check the contents of your Grid proxy with the command:
voms-proxy-info -all
Then check the location of your data:
dq2-ls -r -f user.CCC.0108173.topmix_Egamma.AOD.v2
Then pull the data:
dq2-get -a -s <Data location> <Data set name to copy>
Note: if looking for containers (a collection of data sets that end with a /) *dq2-ls* will not work. You need to do *dq2-list-datasets-container*.
Using Pathena and pbook, prun commands
Do the setup as above then then type:
localSetupPandaClient
The general ATLAS instructions for pathena can be found here.
Putting files on the grid
(thanks to Taylor for checking)
Setup Atlas release. For SL6, source this code:
#!/bin/bash export AVERS=17.7.0 export TEST_AREA=$HOME/testarea export ATLAS_LOCAL_ROOT_BASE=/cvmfs/atlas.cern.ch/repo/ATLASLocalRootBase source ${ATLAS_LOCAL_ROOT_BASE}/user/atlasLocalSetup.sh asetup --release=$AVERS --cmtconfig=x86_64-slc6-gcc46-opt --testarea=$TEST_AREA localSetupDQ2Client --skipConfirm voms-proxy-init -voms atlas -valid 96:00 localSetupPandaClient --noAthenaCheck
Using subscription
Read section using data subscription.
— Sergei Chekanov 2013/03/18 09:21