Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
Next revision 		Previous revision
Last revision Both sides next revision
hepsim:quick [2018/05/31 15:48]
hepsim17 [Quick start] 		hepsim:quick [2021/05/07 18:30]
hepsim17 [Quick start]
Line 9: Line 9:
 <code bash>       <code bash>      
 bash   #  set bash if you haven't done this before  bash   #  set bash if you haven't done this before 
-wget http://atlaswww.hep.anl.gov/hepsim/soft/hs-toolkit.tgz -O - | tar -xz;+wget https://atlaswww.hep.anl.gov/hepsim/soft/hs-toolkit.tgz -O - | tar -xz;
 source hs-toolkit/setup.sh source hs-toolkit/setup.sh
 </code> </code>
  
-This creates the directory "hs-toolkit" with HepSim commands. You can also download it as [[http://atlaswww.hep.anl.gov/hepsim/soft/hs-toolkit.tgz | hs-toolkit.tgz]]. Note that+This creates the directory "hs-toolkit" with HepSim commands. You can also download it as [[https://atlaswww.hep.anl.gov/hepsim/soft/hs-toolkit.tgz | hs-toolkit.tgz]]. Note that
 [[https://www.java.com/en/download/|Java 8]] and above should be installed.  [[https://www.java.com/en/download/|Java 8]] and above should be installed. 
 You can view the commands using the bash shell by typing : You can view the commands using the bash shell by typing :
Line 22: Line 22:
  
 The directory contains several bash scripts for Linux/Mac, and Windows batch (BAT) files to process events on Windows OS. The directory contains several bash scripts for Linux/Mac, and Windows batch (BAT) files to process events on Windows OS.
-The package is used for download, view and analyse HepSim files (truth-level files in the [[https://atlaswww.hep.anl.gov/asc/promc/ | PROMC format]]).  +The package is used for download, view and analyze truth-level events in the [[https://atlaswww.hep.anl.gov/asc/promc/ | PROMC]] or [[https://github.com/proio-org/ | PROIO]] format.  
  
-<note tip>To analyse (*.lcio) files with Geant4 simulations, use  +<note tip> 
-[[http://atlaswww.hep.anl.gov/asc/jas4pp | JAS4PP program]].  +Use [[https://atlaswww.hep.anl.gov/asc/jas4pp | JAS4PP program]] for analysing LCIO  
-This program can also be used for truth-level [[https://atlaswww.hep.anl.gov/asc/promc/ | PROMC files]]. +(*.lcio) files with Geant4 simulations. 
-To analyse ROOT files with fast simulations, use Delphes/ROOT frameworks. +This program can also be used for truth-level records in the [[https://atlaswww.hep.anl.gov/asc/promc/|PROMC]], [[https://github.com/proio-org/| PROIO]] and [[https://root.cern/|ROOT]] file formats. You can also use Delphes/ROOT framework for ROOT files. 
 </note> </note>
  
Line 34: Line 34:
  
 Let us show how to find the files associated with a given Monte Carlo event sample.  Let us show how to find the files associated with a given Monte Carlo event sample. 
-Go to [[http://atlaswww.hep.anl.gov/hepsim/|HepSim database]] and find the "Files" column.+Go to [[https://atlaswww.hep.anl.gov/hepsim/|HepSim database]] and find the "Files" column.
 It shows URL of truth-level files ("EVGEN"), i.e. files directly created by event generators.   It shows URL of truth-level files ("EVGEN"), i.e. files directly created by event generators.  
  
Line 54: Line 54:
 Similarly, one can use the download URL: Similarly, one can use the download URL:
 <code bash> <code bash>
-hs-ls http://mc.hep.anl.gov/asc/hepsim/events/pp/100tev/higgs_ttbar_mg5/ +hs-ls https://mc.hep.anl.gov/asc/hepsim/events/pp/100tev/higgs_ttbar_mg5/ 
 </code> </code>
 Note that in this approach, one can use URL mirrors close to your geographical location. Note that in this approach, one can use URL mirrors close to your geographical location.
Line 61: Line 61:
  
 <code bash> <code bash>
-hs-ls [setname] simple     > input.list     # make list of ProMC files (without URL path) +hs-ls [name] simple     > input.list     # make list of ProMC files (without URL path) 
-hs-ls [setname] simple-url > input_url.list # make list with URL from the main server+hs-ls [name] simple-url > input_url.list # make list with URL from the main server
 </code> </code>
-where [setname] is the name of dataset. You can also use a URL if you want to create a list of files from certain (mirror) servers.+where [name] is the name of dataset. You can also use a URL if you want to create a list of files from certain (mirror) servers.
 ====== Searching for datasets ====== ====== Searching for datasets ======
  
  
 The best method to find the needed sample is to use the web page with  The best method to find the needed sample is to use the web page with 
-[[http://atlaswww.hep.anl.gov/hepsim/search.php|database search]].+[[https://atlaswww.hep.anl.gov/hepsim/search.php|database search]].
  
 Enter "rfull" in the search field, and you will see all samples with full simulation taggs. Enter "rfast", and you will Enter "rfull" in the search field, and you will see all samples with full simulation taggs. Enter "rfast", and you will
Line 79: Line 79:
  
  
-  * [[http://atlaswww.hep.anl.gov/hepsim/list.php?find=rfull]] list MC after full simulations +  * [[https://atlaswww.hep.anl.gov/hepsim/list.php?find=rfull]] list MC after full simulations 
-  * [[http://atlaswww.hep.anl.gov/hepsim/list.php?find=rfast]] lists MC after fast simulations +  * [[https://atlaswww.hep.anl.gov/hepsim/list.php?find=rfast]] lists MC after fast simulations 
-  * [[http://atlaswww.hep.anl.gov/hepsim/list.php?find=mg5]] - lists all Madgraph5 samples +  * [[https://atlaswww.hep.anl.gov/hepsim/list.php?find=mg5]] - lists all Madgraph5 samples 
-  * [[http://atlaswww.hep.anl.gov/hepsim/list.php?find=higgs%rfast]] - lists Higgs samples after fast simulation+  * [[https://atlaswww.hep.anl.gov/hepsim/list.php?find=higgs%rfast]] - lists Higgs samples after fast simulation
  
 If you prefer to use the command-line approach, you can find URL that corresponds a dataset using this command: If you prefer to use the command-line approach, you can find URL that corresponds a dataset using this command:
Line 123: Line 123:
  
 <code> <code>
-hs-get http://atlaswww.hep.anl.gov/hepsim/info.php?item=2 data +hs-get https://atlaswww.hep.anl.gov/hepsim/info.php?item=2 data 
 </code> </code>
  
Line 129: Line 129:
  
 <code> <code>
-hs-get http://mc.hep.anl.gov/asc/hepsim/events/pp/100tev/higgs_ttbar_mg5 data+hs-get https://mc.hep.anl.gov/asc/hepsim/events/pp/100tev/higgs_ttbar_mg5 data
 </code> </code>
 All these examples will download all files from the "tev100pp_higgs_ttbar_mg5" event sample. All these examples will download all files from the "tev100pp_higgs_ttbar_mg5" event sample.
Line 147: Line 147:
 hs-get tev13pp_higgs_pythia8_ptbins  data 3 10 pt100_ hs-get tev13pp_higgs_pythia8_ptbins  data 3 10 pt100_
 </code> </code>
-where the name is [[http://atlaswww.hep.anl.gov/hepsim/info.php?item=92|tev13pp_higgs_pythia8_ptbins]]. +where the name is [[https://atlaswww.hep.anl.gov/hepsim/info.php?item=92|tev13pp_higgs_pythia8_ptbins]]. 
  
 The command download files to the "data" directory in 2 threads. The maximum number of download files is 5 and all file names have *pt100* string (i.e. pT>100 GeV). The command download files to the "data" directory in 2 threads. The maximum number of download files is 5 and all file names have *pt100* string (i.e. pT>100 GeV).
Line 167: Line 167:
 where "NNN" is a version number.  where "NNN" is a version number. 
 You can identify detector geometries that correspond to the tags using  [[http://atlaswww.hep.anl.gov/hepsim/detectors.php|detector description page]]. You can identify detector geometries that correspond to the tags using  [[http://atlaswww.hep.anl.gov/hepsim/detectors.php|detector description page]].
-For example, [[http://atlaswww.hep.anl.gov/hepsim/info.php?item=15|tev100pp_ttbar_mg5]] +For example, [[https://atlaswww.hep.anl.gov/hepsim/info.php?item=15|tev100pp_ttbar_mg5]] 
 sample includes the link "rfast001" (Delphes fast simulation, version 001). To download the reconstructed events for the reconstruction tag "rfast001", use this syntax:  sample includes the link "rfast001" (Delphes fast simulation, version 001). To download the reconstructed events for the reconstruction tag "rfast001", use this syntax: 
  
Line 184: Line 184:
 As before, one can also download the files using the URL: As before, one can also download the files using the URL:
 <code bash> <code bash>
-hs-ls http://mc.hep.anl.gov/asc/hepsim/events/pp/100tev/ttbar_mg5/rfast001/ # list all files +hs-ls https://mc.hep.anl.gov/asc/hepsim/events/pp/100tev/ttbar_mg5/rfast001/ # list all files 
-hs-get http://mc.hep.anl.gov/asc/hepsim/events/pp/100tev/ttbar_mg5/rfast001/ data+hs-get https://mc.hep.anl.gov/asc/hepsim/events/pp/100tev/ttbar_mg5/rfast001/ data
 </code> </code>
  
Line 193: Line 193:
  
 <code bash>  <code bash> 
-hs-info http://mc.hep.anl.gov/asc/hepsim/events/pp/14tev/pythia8_higgs2mumu/tev14_pythia8_h2mm_1.promc+hs-info https://mc.hep.anl.gov/asc/hepsim/events/pp/14tev/pythia8_higgs2mumu/tev14_pythia8_h2mm_1.promc
 </code> </code>
  
Line 223: Line 223:
  
 <code> <code>
-hs-info http://mc.hep.anl.gov/asc/hepsim/events/pp/14tev/pythia8_higgs2mumu/tev14_pythia8_h2mm_1.promc 100 +hs-info https://mc.hep.anl.gov/asc/hepsim/events/pp/14tev/pythia8_higgs2mumu/tev14_pythia8_h2mm_1.promc 100 
 </code> </code>
  
Line 230: Line 230:
 hs-view [promc file]               hs-view [promc file]              
 </code> </code>
-This command brings up a GUI window to look at separate events. You should forward X11 to see the GUI. For Windows: download the file [[http://atlaswww.hep.anl.gov/asc/hepsim/hepsim.jar|hepsim.jar]] and  click on it. Then open the file as [File]-[Open file].+This command brings up a GUI window to look at separate events. You should forward X11 to see the GUI. For Windows: download the file [[https://atlaswww.hep.anl.gov/asc/hepsim/hepsim.jar|hepsim.jar]] and  click on it. Then open the file as [File]-[Open file].
  
  
Line 239: Line 239:
  
 <code> <code>
-hs-view http://mc.hep.anl.gov/asc/hepsim/events/pp/14tev/pythia8_higgs2mumu/tev14_pythia8_h2mm_1.promc+hs-view https://mc.hep.anl.gov/asc/hepsim/events/pp/14tev/pythia8_higgs2mumu/tev14_pythia8_h2mm_1.promc
 </code> </code>
 Here we looked at one file of [[http://mc.hep.anl.gov/asc/hepsim/events/pp/14tev/qcd/pythia8/|Pythia8 (QCD) sample]].  Here we looked at one file of [[http://mc.hep.anl.gov/asc/hepsim/events/pp/14tev/qcd/pythia8/|Pythia8 (QCD) sample]]. 
Line 246: Line 246:
 ====== Monte Carlo logfile ====== ====== Monte Carlo logfile ======
  
-You can work with ProMC using the standard Linux commands, such as "unzip": +Each ProMC/ProIO file includes a logfile from the Monte Carlo generator. Show this file on the screen as: 
 + 
 +<code> 
 +hs-log [file] 
 +</code> 
 +where [file] is either a ProMC or ProIO file (you can use URL instead of the full path on the local computer). 
 + 
 +In the case of ProMC files, one can use the standard Linux commands, such as "unzip": 
  
 <code> <code>
Line 308: Line 315:
 In this example, we will run a Python (to be more exact, Jython) script and, at the same time, will stream data from the web. In this example, we will run a Python (to be more exact, Jython) script and, at the same time, will stream data from the web.
 Find a HepSim event sample by clicking the info "Info" column.  Find a HepSim event sample by clicking the info "Info" column. 
-For example, look at a ttbar sample from Madgraph: [[http://atlaswww.hep.anl.gov/hepsim/info.php?item=15|ttbar_mg5]].  +For example, look at a ttbar sample from Madgraph: [[https://atlaswww.hep.anl.gov/hepsim/info.php?item=15|ttbar_mg5]].  
 Find the URL of the analysis script ("ttbar_mg5.py") located at the bottom. Copy it to some foulder. Or use "wget": Find the URL of the analysis script ("ttbar_mg5.py") located at the bottom. Copy it to some foulder. Or use "wget":
  
 <code bash> <code bash>
-wget http://mc.hep.anl.gov/asc/hepsim/events/pp/100tev/ttbar_mg5/macros/ttbar_mg5.py+wget https://mc.hep.anl.gov/asc/hepsim/events/pp/100tev/ttbar_mg5/macros/ttbar_mg5.py
 </code> </code>
  
Line 345: Line 352:
 then we download the analysis script, and then we run this script over the local data using 10000 events: then we download the analysis script, and then we run this script over the local data using 10000 events:
 <code> <code>
-hs-get http://mc.hep.anl.gov/asc/hepsim/events/pp/100tev/ttbar_mg5 ttbar_mg5+hs-get https://mc.hep.anl.gov/asc/hepsim/events/pp/100tev/ttbar_mg5 ttbar_mg5
 hs-run ttbar_mg5 10000 hs-run ttbar_mg5 10000
 </code> </code>
Line 354: Line 361:
 The above example has some limitations since it uses rather simple editor.  The above example has some limitations since it uses rather simple editor. 
 Another approach is to use the full-featured [[http://atlaswww.hep.anl.gov/asc/jas4pp/|Jas4pp]] or    Another approach is to use the full-featured [[http://atlaswww.hep.anl.gov/asc/jas4pp/|Jas4pp]] or   
-[[http://jwork.org/dmelt/|DataMelt]] programs which give more flexibility.+[[https://datamelt.org|DataMelt]] programs which give more flexibility.
 <code bash> <code bash>
 wget -O dmelt.zip http://jwork.org/dmelt/download/current.php; wget -O dmelt.zip http://jwork.org/dmelt/download/current.php;
Line 362: Line 369:
 You can also pass URL with data as an argument and limit the calculation to 10000 events: You can also pass URL with data as an argument and limit the calculation to 10000 events:
 <code bash> <code bash>
-./dmelt/dmelt_batch.sh ttbar_mg5.py http://mc.hep.anl.gov/asc/hepsim/events/pp/100tev/ttbar_mg5/ 10000 +./dmelt/dmelt_batch.sh ttbar_mg5.py https://mc.hep.anl.gov/asc/hepsim/events/pp/100tev/ttbar_mg5/ 10000 
 </code> </code>
  
 As before, use the batch mode using downloaded ProMC files. As before, use the batch mode using downloaded ProMC files.
-Let assume that we put all ProMC files to the directory "data". Then run [[http://jwork.org/dmelt/|DataMelt]] over the data as:+Let assume that we put all ProMC files to the directory "data". Then run [[https://datamelt.org/|DataMelt]] over the data as:
  
 <code bash> <code bash>
Line 375: Line 382:
 then we download the analysis script, and then we run this script over the local data using 10000 events: then we download the analysis script, and then we run this script over the local data using 10000 events:
 <code> <code>
-hs-get http://mc.hep.anl.gov/asc/hepsim/events/pp/100tev/ttbar_mg5 ttbar_mg5+hs-get https://mc.hep.anl.gov/asc/hepsim/events/pp/100tev/ttbar_mg5 ttbar_mg5
 ./dmelt/dmelt_batch.sh ttbar_mg5.py ttbar_mg5 10000  ./dmelt/dmelt_batch.sh ttbar_mg5.py ttbar_mg5 10000 
 </code> </code>
Line 381: Line 388:
  
 Then click "run" (or [F8]).  Then click "run" (or [F8]). 
-One can also start  [[http://jwork.org/dmelt/|DataMelt]] without input files: +One can also start  [[https://datamelt.org|DataMelt]] without input files: 
 <code> <code>
 ./dmelt/dmelt.sh ./dmelt/dmelt.sh
 </code> </code>
 on Linux/Mac. On Windows, run "dmelt.bat" instead. You will see the DatMelt IDE. on Linux/Mac. On Windows, run "dmelt.bat" instead. You will see the DatMelt IDE.
-Locate  an URL location of the analysis script, such as [[http://atlaswww.hep.anl.gov/hepsim/info.php?item=15|ttbar_mg5]] (can be found under "Info" link). Then copy this link using the right mouse button ("Copy URL Location"). +Locate  an URL location of the analysis script, such as [[https://atlaswww.hep.anl.gov/hepsim/info.php?item=15|ttbar_mg5]] (can be found under "Info" link). Then copy this link using the right mouse button ("Copy URL Location"). 
 Next, in the DMelt menu, go to "File"→"Read script from URL". Copy the URL link of the *.py file to the pop-up DataMelt  Next, in the DMelt menu, go to "File"→"Read script from URL". Copy the URL link of the *.py file to the pop-up DataMelt 
 URL dialog and click "run". The program will start reading data from the Web. At the end of the run, you will see  a pop-up URL dialog and click "run". The program will start reading data from the Web. At the end of the run, you will see  a pop-up
Line 406: Line 413:
 There is a simple example showing how to read multiple Monte Carlo files from HepSim, There is a simple example showing how to read multiple Monte Carlo files from HepSim,
 build anti-KT jets using FastJet, and fill ROOT histograms. Download  build anti-KT jets using FastJet, and fill ROOT histograms. Download 
-[[http://atlaswww.hep.anl.gov/asc/hepsim/soft/hepsim-cpp.tgz|hepsim-cpp package]]  and compile it:   +[[https://atlaswww.hep.anl.gov/asc/hepsim/soft/hepsim-cpp.tgz|hepsim-cpp package]]  and compile it:   
  
 <code> <code>
Line 424: Line 431:
 about how to read Delphes ROOT files.  about how to read Delphes ROOT files. 
  
-You can find all samples that contain fast simulations using [[http://atlaswww.hep.anl.gov/hepsim/list.php?find=rfast|this link]]. +You can find all samples that contain fast simulations using [[https://atlaswww.hep.anl.gov/hepsim/list.php?find=rfast|this link]]. 
  
 ===== Full simulation: LCIO files ===== ===== Full simulation: LCIO files =====
Line 437: Line 444:
      
  
-You can find all samples that contain full simulations using [[http://atlaswww.hep.anl.gov/hepsim/list.php?find=rfull|this link]]. +You can find all samples that contain full simulations using [[https://atlaswww.hep.anl.gov/hepsim/list.php?find=rfull|this link]].
- +
- +
- +
- +
  
  
Line 473: Line 475:
  
 Durham [[http://durpdg.dur.ac.uk/|HepData]] database maintains "DMelt" scripts compatible  Durham [[http://durpdg.dur.ac.uk/|HepData]] database maintains "DMelt" scripts compatible 
-with [[http://atlaswww.hep.anl.gov/hepsim/|HepSim]] analysis scripts, thus it is relatively easy to  overlay Monte Carlo predictions and data from published articles.+with [[https://atlaswww.hep.anl.gov/hepsim/|HepSim]] analysis scripts, thus it is relatively easy to  overlay Monte Carlo predictions and data from published articles.
 For example, look at the link  [[http://durpdg.dur.ac.uk/view/ins1253852|AAD 2013]] from [[http://durpdg.dur.ac.uk/|HepData]] and   For example, look at the link  [[http://durpdg.dur.ac.uk/view/ins1253852|AAD 2013]] from [[http://durpdg.dur.ac.uk/|HepData]] and  
 download a "DMelt" Jython script with published data.  download a "DMelt" Jython script with published data. 
hepsim/quick.txt · Last modified: 2023/03/02 18:28 by hepsim17
Except where otherwise noted, content on this wiki is licensed under the following license: CC Attribution-Share Alike 4.0 International


  • Show page
  • Old revisions
  • Backlinks
  • Recent Changes
  • Media Manager
  • Sitemap