User Tools

Site Tools


community:hepsim:dev_hepsim

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
Next revision
Previous revision
community:hepsim:dev_hepsim [2016/10/31 00:33]
asc [How to mirror entire dataset]
community:hepsim:dev_hepsim [2016/12/22 15:53] (current)
asc [Summary]
Line 3: Line 3:
 ====== How to link private samples to HepSim ====== ====== How to link private samples to HepSim ======
  
-Your files can be  published on HepSim and you  can maintain your own Hepim repository with PROMC/SLCIO/ROOT files. This is useful if:+Your files can be  published on [[http://atlaswww.hep.anl.gov/hepsim/|HepSim]] and you  can maintain your own HepSim repository with PROMC/SLCIO/ROOT files. This is useful if:
  
   * You want to share your own files, so they will be available from HepSim   * You want to share your own files, so they will be available from HepSim
Line 17: Line 17:
 You need the following: You need the following:
  
-  * A web server that can hold your data (>1 TB for /var/www/html is recommended)+  * A web server that can hold your data (>1 TB for /var/www/html is recommended). It is advisable to create a separate partition with RAID10, say, /data, and link this directory to /var/www/html/.
   * Linux OS (any flavor)   * Linux OS (any flavor)
-  * Installed Apache2 with PHP module and Java+  * Apache2 with PHP module that can serve/var/www/html/ 
 +  * Java 8 JDK or JRE (optionally, for tools to check data)
  
  
Line 76: Line 77:
  
 You can mirror an entire dataset by copying HepSim files to your mirror web server (or local computer). You can mirror an entire dataset by copying HepSim files to your mirror web server (or local computer).
-You can use the command "hs-mirror" program from the "hs-toolkit" package. For example, if you want+You can use the command "hs-mirror" from the "hs-toolkit" package. For example, if you want
 to mirror a dataset with known URL, use this example: to mirror a dataset with known URL, use this example:
  
 <code bash> <code bash>
 +wget http://atlaswww.hep.anl.gov/hepsim/soft/hs-toolkit.tgz -O - | tar -xz;
 +source hs-toolkit/setup.sh # setup HepSim programs
 +# now copy a dataset from URL to a new location
 SOURCE=http://cepcgit.ihep.ac.cn:81/hepsim/events/ee/250gev/pythia6_higgs_gamgam_test SOURCE=http://cepcgit.ihep.ac.cn:81/hepsim/events/ee/250gev/pythia6_higgs_gamgam_test
 OUTPUT_DIR=/var/www/html/ OUTPUT_DIR=/var/www/html/
Line 86: Line 90:
 This example creates the directory "/var/www/html/events/ee/250gev/pythia6_higgs_gamgam_test" and copies all files from the This example creates the directory "/var/www/html/events/ee/250gev/pythia6_higgs_gamgam_test" and copies all files from the
 URL. The URL can be found using the HepSim web page.  URL. The URL can be found using the HepSim web page. 
 +
 +If you want to download only EVGEN files, without reconstructed events, use this command:
 +<code bash>
 +hs-mirror -i $SOURCE-o $OUTPUT_DIR -t evgen
 +</code>
 +
  
 Generally, you do not need to index files in the mirror directory.  Generally, you do not need to index files in the mirror directory. 
Line 91: Line 101:
 ====== Summary ====== ====== Summary ======
  
-When everything is done, this is what you will expect:+When everything is done, this is what you should expect:
  
-  * You files will be visible on the main HepSim web page and on the mirrors (takes ~ few days to propagate the changes) +  * You files will be visible on the main HepSim web page and on the current mirrors (takes ~ few days to propagate the changes) 
-  * You can search your files etc. +  * You can search your files etc. using the main HepSim web page
-  * Since your files are public, there is good chance that somebody will make a mirror+
   * You can search, list and download files using hs-toolkit commands (hs-find, hs-ls, hs-get etc)   * You can search, list and download files using hs-toolkit commands (hs-find, hs-ls, hs-get etc)
 +  * Since your files are public, there is good chance that somebody will make a mirror to reduce the load on your server
   * You server will be listed on the page [[http://atlaswww.hep.anl.gov/hepsim/summary.php|statistics summary]]   * You server will be listed on the page [[http://atlaswww.hep.anl.gov/hepsim/summary.php|statistics summary]]
- 
- 
- 
  
  
community/hepsim/dev_hepsim.1477873985.txt.gz · Last modified: 2016/10/31 00:33 by asc