ATLAS Support Center

User Tools

Site Tools

Trace:
community:hepsim:usage_download

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Next revision 		Previous revision
community:hepsim:usage_download [2016/04/28 15:15]
asc created 		community:hepsim:usage_download [2016/10/12 20:59] (current)
asc [Downloading truth-level files]
Line 3: Line 3:
 ======  How to download, view and find data ====== ======  How to download, view and find data ======
  
-======  Data formats ====== +======  EVGEN events ====== 
-Truth-level data are stored in a platform-independent format called [[http://atlaswww.hep.anl.gov/asc/promc/ | ProMC]] that allows very effective compression using a variable-byte encoding.  This data format is+Truth-level (EVGEN) data are stored in a platform-independent format called [[http://atlaswww.hep.anl.gov/asc/promc/ | ProMC]] that allows very effective compression using a variable-byte encoding.  This data format is
 supported by popular programming languages (C++, Java, Python) on major  operating system (Windows, Mac, Linux, etc.). supported by popular programming languages (C++, Java, Python) on major  operating system (Windows, Mac, Linux, etc.).
 +Open access to such files via the http protocol is the central element  in the design of HepSim, since
 +further processing using fast and full simulations is done using computer resources from multiple locations.
 +The compact ProMC files optimized for web streaming, together with the http protocol optimized  
 +to handle many (relatively small) files, is one of the distinct features of HepSim compared to other production systems.
 +
  
 Simulated data after fast and full detector simulations are kept in ROOT and LCIO  formats.  Simulated data after fast and full detector simulations are kept in ROOT and LCIO  formats. 
Line 46: Line 51:
 ======  Event record browser ====== ======  Event record browser ======
  
-Use the event-record browser to view separate events, cross sections and log files. On Linux/Mac, use:+Use the event-record browser to view separate EVGEN events, cross sections and log files. On Linux/Mac, use:
  
 <code bash> <code bash>
Line 74: Line 79:
 ======  File validation ====== ======  File validation ======
  
-One can check the consistency of the file and additional information as:+Check the consistency of the EVGEN file and additional information as:
  
 <code bash> <code bash>
Line 112: Line 117:
  
 Let us show how to find all files associated with a given Monte Carlo event sample. Let us show how to find all files associated with a given Monte Carlo event sample.
-Go to [[http://atlaswww.hep.anl.gov/hepsim/ | HepSim database]] and find a sample by clicking on the "Info" column.+Go to [[http://atlaswww.hep.anl.gov/hepsim/ | HepSim database]]. Look at the links "Files". It list the available files.
 Then find the files as:                        Then find the files as:                       
 <code bash> <code bash>
Line 223: Line 228:
 hs-get tev100_higgs_ttbar_mg5 data hs-get tev100_higgs_ttbar_mg5 data
 </code> </code>
 +You will be prompted to use certain mirror (if there are alternative mirrors). Select the mirror and start downloading the files.
 +
 Alternatively, this example downloads files using the URL of the Info page: Alternatively, this example downloads files using the URL of the Info page:
 <code bash> <code bash>
Line 231: Line 238:
 hs-get http://mc.hep.anl.gov/asc/hepsim/events/pp/100tev/higgs_ttbar_mg5 data hs-get http://mc.hep.anl.gov/asc/hepsim/events/pp/100tev/higgs_ttbar_mg5 data
 </code> </code>
-All these examples will download all files from the "tev100_higgs_ttbar_mg5" event sample.+All these examples will download all files from the "tev100_higgs_ttbar_mg5" event sample. 
  
 +<note important>If you see that the download is slow, use an alternative URL from the mirror list which is given for each dataset.
 +</note>
  
 You can stop downloading using [Ctrt-D]. Next time you start it, it will continue the download. You can stop downloading using [Ctrt-D]. Next time you start it, it will continue the download.
Line 291: Line 300:
 hs-get  tev100_ttbar_mg5%rfast001 data 3 10 hs-get  tev100_ttbar_mg5%rfast001 data 3 10
 </code> </code>
-As before, one can also download the files using the URL:+ 
 +As before, one can also download the files using the URL approach:
 <code bash> <code bash>
 hs-ls http://mc.hep.anl.gov/asc/hepsim/events/pp/100tev/ttbar_mg5/rfast001/ # list all files hs-ls http://mc.hep.anl.gov/asc/hepsim/events/pp/100tev/ttbar_mg5/rfast001/ # list all files
 hs-get http://mc.hep.anl.gov/asc/hepsim/events/pp/100tev/ttbar_mg5/rfast001/ data hs-get http://mc.hep.anl.gov/asc/hepsim/events/pp/100tev/ttbar_mg5/rfast001/ data
 </code> </code>
 +Note that the reconstruction tag "rfast001" is separated by backslash as for the usual directory.
 +As before, the URL can be taken from the list with mirrors. For example, if you want to download  files from Nersc, use this URL:
  
 +<code bash>
 +hs-ls  http://portal.nersc.gov/project/m1758/data/events/pp/100tev/ttbar_mg5/rfast001/ # list all files
 +hs-get http://portal.nersc.gov/project/m1758/data/events/pp/100tev/ttbar_mg5/rfast001/ data
 +</code>
  
  
community/hepsim/usage_download.1461856526.txt.gz · Last modified: 2016/04/28 15:15 by asc

Page Tools

Except where otherwise noted, content on this wiki is licensed under the following license: Public Domain
Public Domain Donate Powered by PHP Valid HTML5 Valid CSS Driven by DokuWiki