Differences
This shows you the differences between two versions of the page.
Both sides previous revision Previous revision Next revision | Previous revision | ||
hepsim:usage_download [2017/03/08 16:47] hepsim17 |
hepsim:usage_download [2020/05/22 02:45] hepsim17 |
||
---|---|---|---|
Line 3: | Line 3: | ||
[[: | [[: | ||
- | ====== | + | ====== |
====== | ====== | ||
- | Truth-level (EVGEN) data are stored in a platform-independent format called [[http:// | + | Truth-level (EVGEN) data are stored in a platform-independent format called [[https:// |
supported by popular programming languages (C++, Java, Python) on major operating system (Windows, Mac, Linux, etc.). | supported by popular programming languages (C++, Java, Python) on major operating system (Windows, Mac, Linux, etc.). | ||
Open access to such files via the http protocol is the central element | Open access to such files via the http protocol is the central element | ||
Line 20: | Line 20: | ||
<code bash> | <code bash> | ||
- | wget http:// | + | wget https:// |
source hs-toolkit/ | source hs-toolkit/ | ||
</ | </ | ||
Line 27: | Line 27: | ||
<code bash> | <code bash> | ||
- | curl http:// | + | curl https:// |
source hs-toolkit/ | source hs-toolkit/ | ||
</ | </ | ||
Line 54: | Line 54: | ||
<code bash> | <code bash> | ||
- | hs-view | + | hs-view |
</ | </ | ||
- | Here we looked at one file of the [[http://mc.hep.anl.gov/asc/hepsim/events/ | + | Here we have looked at one file of the [[http://atlaswww.hep.anl.gov/ |
Of course, one can look at the local file as well: | Of course, one can look at the local file as well: | ||
<code bash> | <code bash> | ||
- | hs-view | + | wget https:// |
+ | hs-view | ||
</ | </ | ||
after you downloaded it. | after you downloaded it. | ||
- | On Windows, download [[http:// | + | On Windows, download [[https:// |
You will see a pop-up GUI browser which displays the MC record. You can search for a given particle name, view data layouts and log files using the [Menu]: | You will see a pop-up GUI browser which displays the MC record. You can search for a given particle name, view data layouts and log files using the [Menu]: | ||
Line 74: | Line 75: | ||
This works for full parton-shower simulations with detailed information on particles. | This works for full parton-shower simulations with detailed information on particles. | ||
Unlike the usual parton shower Monte Carlo, this browser has a detailed information on event weights, PDF uncertainties and scale uncertainties (in some cases). The browser can show 4-momenta of each event as well as the total cross sections (for NLO, you need to read all events to get an accurate cross section). Look at the [[https:// | Unlike the usual parton shower Monte Carlo, this browser has a detailed information on event weights, PDF uncertainties and scale uncertainties (in some cases). The browser can show 4-momenta of each event as well as the total cross sections (for NLO, you need to read all events to get an accurate cross section). Look at the [[https:// | ||
- | |||
- | |||
====== | ====== | ||
Line 82: | Line 81: | ||
<code bash> | <code bash> | ||
- | hs-info | + | hs-info |
</ | </ | ||
Line 88: | Line 87: | ||
< | < | ||
- | File = http:// | + | File = http:// |
- | ProMC version = 2 | + | ProMC version = 4 |
- | Last modified = 2013-06-05 16:32:18 | + | Last modified = 2015-10-03 12:06:52 |
- | Description | + | Description |
- | ParticleDecays: | + | |
Events | Events | ||
- | Sigma (pb) = 2.72474E1 ± 1.92589E-1 | + | Sigma (pb) = 5.61176E-1 ± 3.3035E-3 |
- | Lumi | + | Lumi |
Varint units = E:100000 L:1000 | Varint units = E:100000 L:1000 | ||
Log file: = logfile.txt | Log file: = logfile.txt | ||
- | The file was validated. Exit. | + | #### |
</ | </ | ||
All entries are self-explanatory. Varint units - values used to multiply energy (momenta) to convert to variable-byte integers. | All entries are self-explanatory. Varint units - values used to multiply energy (momenta) to convert to variable-byte integers. | ||
The " | The " | ||
- | See the [[http:// | + | See the [[https:// |
One can look at separate events using the above command after passing an integer argument that specifies | One can look at separate events using the above command after passing an integer argument that specifies | ||
Line 109: | Line 107: | ||
<code bash> | <code bash> | ||
- | hs-info | + | hs-info |
</ | </ | ||
- | |||
- | |||
====== List available data files ====== | ====== List available data files ====== | ||
Let us show how to find all files associated with a given Monte Carlo event sample. | Let us show how to find all files associated with a given Monte Carlo event sample. | ||
- | Go to [[http:// | + | Go to [[https:// |
Then find the files as: | Then find the files as: | ||
<code bash> | <code bash> | ||
Line 125: | Line 121: | ||
This command shows a table with file names and their sizes. | This command shows a table with file names and their sizes. | ||
- | Here is an example illustrating how to list all files from the [[http:// | + | Here is an example illustrating how to list all files from the [[https:// |
Monte Carlo sample: | Monte Carlo sample: | ||
<code bash> | <code bash> | ||
- | hs-ls tev100_higgs_ttbar_mg5 | + | hs-ls tev100pp_higgs_ttbar_mg5 |
</ | </ | ||
Line 135: | Line 131: | ||
<code bash> | <code bash> | ||
- | hs-ls tev100_higgs_ttbar_mg5 | + | hs-ls tev100pp_higgs_ttbar_mg5 |
</ | </ | ||
The string " | The string " | ||
<code bash> | <code bash> | ||
- | hs-ls tev100_higgs_ttbar_mg5 | + | hs-ls tev100pp_higgs_ttbar_mg5 |
</ | </ | ||
Line 147: | Line 143: | ||
<code bash> | <code bash> | ||
- | hs-ls http:// | + | hs-ls https:// |
</ | </ | ||
Line 153: | Line 149: | ||
<code bash> | <code bash> | ||
- | hs-ls http:// | + | hs-ls https:// |
</ | </ | ||
Line 224: | Line 220: | ||
hs-get [name] [OUTPUT_DIR] | hs-get [name] [OUTPUT_DIR] | ||
</ | </ | ||
- | where [name] is either the name of the dataset, or the URL of Info page [[http:// | + | where [name] is either the name of the dataset, or the URL of Info page [[https:// |
- | This example downloads dataset "tev100_higgs_ttbar_mg5" to the directory " | + | This example downloads dataset "tev100pp_higgs_ttbar_mg5" to the directory " |
<code bash> | <code bash> | ||
- | hs-get | + | hs-get |
</ | </ | ||
You will be prompted to use certain mirror (if there are alternative mirrors). Select the mirror and start downloading the files. | You will be prompted to use certain mirror (if there are alternative mirrors). Select the mirror and start downloading the files. | ||
Line 233: | Line 229: | ||
Alternatively, | Alternatively, | ||
<code bash> | <code bash> | ||
- | hs-get | + | hs-get |
</ | </ | ||
Or, if you know the download URL with the file locations, use this command: | Or, if you know the download URL with the file locations, use this command: | ||
<code bash> | <code bash> | ||
- | hs-get | + | hs-get |
</ | </ | ||
- | All these examples will download all files from the "tev100_higgs_ttbar_mg5" event sample. | + | All these examples will download all files from the "tev100pp_higgs_ttbar_mg5" event sample. |
<note important> | <note important> | ||
Line 249: | Line 245: | ||
This example shows how to download 10 files using 3 threads: | This example shows how to download 10 files using 3 threads: | ||
<code bash> | <code bash> | ||
- | hs-get | + | hs-get |
</ | </ | ||
Instead of [Download URL], one can use the URL of the info page, or the name of the dataset. | Instead of [Download URL], one can use the URL of the info page, or the name of the dataset. | ||
- | Here are 2 identical examples to download 5 files using single (1) thread and the ouput directory " | + | Here are 2 identical examples to download 5 files using single (1) thread and the output |
Using the URL of the info page: | Using the URL of the info page: | ||
<code bash> | <code bash> | ||
- | hs-get | + | hs-get |
</ | </ | ||
or, when using the dataset name given on the info page: | or, when using the dataset name given on the info page: | ||
<code bash> | <code bash> | ||
- | hs-get | + | hs-get |
</ | </ | ||
You can also download files that have certain pattern in the names. If a directory contains files generated with different pt cuts, | You can also download files that have certain pattern in the names. If a directory contains files generated with different pt cuts, | ||
- | the names are usually have the substring | + | the names are usually have the sub-string |
<code bash> | <code bash> | ||
- | hs-get | + | hs-get |
</ | </ | ||
The last argument shows that all the downloaded files should have the string " | The last argument shows that all the downloaded files should have the string " | ||
Line 289: | Line 285: | ||
Reconstructed files are stored inside the directory " | Reconstructed files are stored inside the directory " | ||
where " | where " | ||
- | [[http:// | + | [[https:// |
fast simulation, version 001). To download the reconstructed events for the reconstruction tag " | fast simulation, version 001). To download the reconstructed events for the reconstruction tag " | ||
<code bash> | <code bash> | ||
- | hs-ls | + | hs-ls |
- | hs-get | + | hs-get |
</ | </ | ||
- | The symbol " | + | The symbol " |
If you want to download 10 files in 3 threads, use this: | If you want to download 10 files in 3 threads, use this: | ||
< | < | ||
- | hs-get | + | hs-get |
</ | </ | ||
As before, one can also download the files using the URL approach: | As before, one can also download the files using the URL approach: | ||
<code bash> | <code bash> | ||
- | hs-ls http:// | + | hs-ls https:// |
- | hs-get | + | hs-get |
</ | </ | ||
Note that the reconstruction tag " | Note that the reconstruction tag " | ||
Line 314: | Line 310: | ||
hs-get http:// | hs-get http:// | ||
</ | </ | ||
- | |||
- | |||