ATLAS Support Center

User Tools

Site Tools

Trace:
asc:workbook_introduction

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
Next revision 		Previous revision
asc:workbook_introduction [2023/08/14 19:12]
asc [Data storage] 		asc:workbook_introduction [2023/08/14 19:20] (current)
asc [Setting up ATLAS Software]
Line 38: Line 38:
  
  
-===== Computer farm =====+===== Setting up some software =====
  
  
-The computer farm consists of 16 servers atlas50-65. Each server has 2 CPU with 8 cores and 5 TB of local disk space.   The farm is based on SL6+You can setup some software (ROOT, FASTJET, PYTHIA, new Latex) as this:
  
-The PC farm uses the [[http://atlaswww.hep.anl.gov/asc/arcond/|Arcond]] for job submission which allows to share the resources and 
-simplifies the data discovery. The backend  of this farm is Condor. You can use it as well 
-as long as you restrict your jobs to atlas50-65 and use 4 cores per server. If you have long jobs, please use the old farm. Login to the computer farm is not allowed. 
  
-  
-You can see the current CPU usage using this web page [[http://146.139.33.7/ganglia/|ANL-ATLAS computer farm monitor]]. (can be accessed from inside ANL, or when using a proxy after atlas1 ssh). Alternatively, look at the Condor jobs monitor here [[http://atlaswww.hep.anl.gov/asc/admin/cpu-monitor/ | ANL-ATLAS condor monitor]]. 
- 
-You can run [[http://atlaswww.hep.anl.gov/asc/jcondor/ | JCondor Monitoring]] GUI to monitor condor cluster: 
 <code bash> <code bash>
-/share/sl6/set_asc.sh +source /users/admin/share/sl7/setup.sh
-cp -rf /share/sl6/jcondor . +
-cd jcondor +
-java -jar jcondor.jar +
-</code> +
- +
-===== After initial login ===== +
- +
- +
-About the scratch disk space: It is available on atlas1,2,16,17,18 (5TB for each server) and on every desktop. Every user has a directory under /data1 and /data2. The scratch disks do not have backup. You should use these disks if you do not want to gain speed for running/compiling your programs. +
- +
-In some cases, you will need to access data from all computers. If data size is not large (not larger than 10 GB), one can put data on NFS: /data/nfs/users/ If you are interested in a larger sample, contact the administrator. +
- +
-Please read the section [[asc:workbook_data|Working with data at ANL Tier3]] for details on how to store and process your data. +
- +
- +
-===== Default shell and  environment ===== +
- +
- +
-The default shell for the ANL ASC is bash. +
-To setup the necessary environment (ROOT, SVN etc), run this script: +
- +
-<code bash source.sh> +
-source /share/sl6/set_asc.sh+
 </code> </code>
 +This setup uses the native Python2 from SL7
  
 Check this by running "root" or "condor_status". You can also add the environmental variables automatically: Create '.bash_profile' file if it is not done yet, and put these lines: Check this by running "root" or "condor_status". You can also add the environmental variables automatically: Create '.bash_profile' file if it is not done yet, and put these lines:
Line 82: Line 53:
 <code bash>    <code bash>   
     alias ls='ls -F --color=auto'     alias ls='ls -F --color=auto'
-    source /share/sl6/set_asc.sh 
  </code>  </code>
  
Line 95: Line 65:
 </code> </code>
  
-All precompiled software is located here: 
  
 +== Python3 from LCG ==
 +
 +You can also setup basic programs using Python3. Create a setup file "setup.sh" as this:
 <code bash> <code bash>
-/share/sl6/+#!/bin/bash 
 +echo "Setup ROOT, PyROOT tensorflow" 
 +export ATLAS_LOCAL_ROOT_BASE=/cvmfs/atlas.cern.ch/repo/ATLASLocalRootBase 
 +source ${ATLAS_LOCAL_ROOT_BASE}/user/atlasLocalSetup.sh 
 +lsetup "views LCG_104 x86_64-centos7-gcc11-opt"
 </code> </code>
 +
 +Then you can setup many LCG packages as:
 +
 +<code>
 +source setup.sh
 +</code>
 +
 +Please read the section [[asc:workbook_data|Working with data at ANL Tier3]] for details on how to store and process your data.
 +
  
 Before compiling any package, please check this directory. Note that you can also use cvmfs "localSetupSFT". Before compiling any package, please check this directory. Note that you can also use cvmfs "localSetupSFT".
Line 126: Line 111:
 Then "source set.sh" every time you login on atlas16-28 computers. Note: you should use the bash shell for this setup. If you are happy with this, one can put this line in .bash_profile or .bashrc files (if you are using bash shell and want to set up the ATLAS staff every time you login). You can change the ATLAS release and testarea by changing "AVERS" and "TEST_AREA" variables. Then "source set.sh" every time you login on atlas16-28 computers. Note: you should use the bash shell for this setup. If you are happy with this, one can put this line in .bash_profile or .bashrc files (if you are using bash shell and want to set up the ATLAS staff every time you login). You can change the ATLAS release and testarea by changing "AVERS" and "TEST_AREA" variables.
  
-You can also use packages compiled with RootCore. For SL6, they are located here: 
- 
-<code> 
- /share/sl6/AtlasRootCoreLib 
-</code> 
- 
- they were compiled against the native SL6 gcc (/usr/bin/gcc), native python (/usr/bin/python) and ROOT (source /share/grid/app/asc_app/asc_rel/1.0/setup-script/set_asc.sh). 
-If you want to recompile such packages using a different ROOT, simply 
-copy this directory to your directory, and run "A_COMPILE.sh" to recompile all these packages. 
- 
-If you need to add more packages, get them with svn: 
- 
-<code bash> 
-export SVNOFF=svn+ssh://svn.cern.ch/reps/atlasoff 
-svn co $SVNOFF/Reconstruction/Jet/ApplyJetCalibration/tags/ApplyJetCalibration-00-03-15 ApplyJetCalibration 
-</code> 
- 
-and run the script "A_COMPILE.sh" again. 
  
 Read more [[https://twiki.atlas-canada.ca/bin/view/AtlasCanada/ATLASLocalRootBase | about ATLASLocalRootBase]]. Read more [[https://twiki.atlas-canada.ca/bin/view/AtlasCanada/ATLASLocalRootBase | about ATLASLocalRootBase]].
asc/workbook_introduction.1692040339.txt.gz · Last modified: 2023/08/14 19:12 by asc

Page Tools

Except where otherwise noted, content on this wiki is licensed under the following license: Public Domain
Public Domain Donate Powered by PHP Valid HTML5 Valid CSS Driven by DokuWiki