Differences

This shows you the differences between two versions of the page.

--- community:hepsim:usage_download [2016/04/28 15:15] – created asc
+++ community:hepsim:usage_download [2016/10/12 20:59] (current) – [Downloading truth-level files] asc
@@ Line 3: / Line 3: @@
 ======  How to download, view and find data ======
-======  Data formats ======
+======  EVGEN events ======
-Truth-level data are stored in a platform-independent format called [[http://atlaswww.hep.anl.gov/asc/promc/ | ProMC]] that allows very effective compression using a variable-byte encoding.  This data format is
+Truth-level (EVGEN) data are stored in a platform-independent format called [[http://atlaswww.hep.anl.gov/asc/promc/ | ProMC]] that allows very effective compression using a variable-byte encoding.  This data format is
 supported by popular programming languages (C++, Java, Python) on major  operating system (Windows, Mac, Linux, etc.).
+Open access to such files via the http protocol is the central element  in the design of HepSim, since
+further processing using fast and full simulations is done using computer resources from multiple locations.
+The compact ProMC files optimized for web streaming, together with the http protocol optimized
+to handle many (relatively small) files, is one of the distinct features of HepSim compared to other production systems.
 Simulated data after fast and full detector simulations are kept in ROOT and LCIO  formats.
@@ Line 46: / Line 51: @@
 ======  Event record browser ======
-Use the event-record browser to view separate events, cross sections and log files. On Linux/Mac, use:
+Use the event-record browser to view separate EVGEN events, cross sections and log files. On Linux/Mac, use:
 <code bash>
@@ Line 74: / Line 79: @@
 ======  File validation ======
-One can check the consistency of the file and additional information as:
+Check the consistency of the EVGEN file and additional information as:
 <code bash>
@@ Line 112: / Line 117: @@
 Let us show how to find all files associated with a given Monte Carlo event sample.
-Go to [[http://atlaswww.hep.anl.gov/hepsim/ | HepSim database]] and find a sample by clicking on the "Info" column.
+Go to [[http://atlaswww.hep.anl.gov/hepsim/ | HepSim database]]. Look at the links "Files". It list the available files.
 Then find the files as:
 <code bash>
@@ Line 223: / Line 228: @@
 hs-get tev100_higgs_ttbar_mg5 data
 </code>
+You will be prompted to use certain mirror (if there are alternative mirrors). Select the mirror and start downloading the files.
 Alternatively, this example downloads files using the URL of the Info page:
 <code bash>
@@ Line 231: / Line 238: @@
 hs-get http://mc.hep.anl.gov/asc/hepsim/events/pp/100tev/higgs_ttbar_mg5 data
 </code>
 All these examples will download all files from the "tev100_higgs_ttbar_mg5" event sample.
+<note important>If you see that the download is slow, use an alternative URL from the mirror list which is given for each dataset.
+</note>
 You can stop downloading using [Ctrt-D]. Next time you start it, it will continue the download.
@@ Line 291: / Line 300: @@
 hs-get  tev100_ttbar_mg5%rfast001 data 3 10
 </code>
-As before, one can also download the files using the URL:
+As before, one can also download the files using the URL approach:
 <code bash>
 hs-ls http://mc.hep.anl.gov/asc/hepsim/events/pp/100tev/ttbar_mg5/rfast001/ # list all files
 hs-get http://mc.hep.anl.gov/asc/hepsim/events/pp/100tev/ttbar_mg5/rfast001/ data
 </code>
+Note that the reconstruction tag "rfast001" is separated by backslash as for the usual directory.
+As before, the URL can be taken from the list with mirrors. For example, if you want to download  files from Nersc, use this URL:
+<code bash>
+hs-ls  http://portal.nersc.gov/project/m1758/data/events/pp/100tev/ttbar_mg5/rfast001/ # list all files
+hs-get http://portal.nersc.gov/project/m1758/data/events/pp/100tev/ttbar_mg5/rfast001/ data
+</code>