Differences

This shows you the differences between two versions of the page.

--- community:hepsim:dev_hepsim [2016/10/31 00:33] – [How to mirror entire dataset] asc
+++ community:hepsim:dev_hepsim [2016/12/22 15:53] (current) – [Summary] asc
@@ Line 3: / Line 3: @@
 ====== How to link private samples to HepSim ======
-Your files can be  published on HepSim and you  can maintain your own Hepim repository with PROMC/SLCIO/ROOT files. This is useful if:
+Your files can be  published on [[http://atlaswww.hep.anl.gov/hepsim/|HepSim]] and you  can maintain your own HepSim repository with PROMC/SLCIO/ROOT files. This is useful if:
   * You want to share your own files, so they will be available from HepSim
@@ Line 17: / Line 17: @@
 You need the following:
-  * A web server that can hold your data (>1 TB for /var/www/html is recommended)
+  * A web server that can hold your data (>1 TB for /var/www/html is recommended). It is advisable to create a separate partition with RAID10, say, /data, and link this directory to /var/www/html/.
   * Linux OS (any flavor)
-  * Installed Apache2 with PHP module and Java
+  * Apache2 with PHP module that can serve/var/www/html/
+  * Java 8 JDK or JRE (optionally, for tools to check data)
@@ Line 76: / Line 77: @@
 You can mirror an entire dataset by copying HepSim files to your mirror web server (or local computer).
-You can use the command "hs-mirror" program from the "hs-toolkit" package. For example, if you want
+You can use the command "hs-mirror" from the "hs-toolkit" package. For example, if you want
 to mirror a dataset with known URL, use this example:
 <code bash>
+wget http://atlaswww.hep.anl.gov/hepsim/soft/hs-toolkit.tgz -O - | tar -xz;
+source hs-toolkit/setup.sh # setup HepSim programs
+# now copy a dataset from URL to a new location
 SOURCE=http://cepcgit.ihep.ac.cn:81/hepsim/events/ee/250gev/pythia6_higgs_gamgam_test
 OUTPUT_DIR=/var/www/html/
@@ Line 86: / Line 90: @@
 This example creates the directory "/var/www/html/events/ee/250gev/pythia6_higgs_gamgam_test" and copies all files from the
 URL. The URL can be found using the HepSim web page.
+If you want to download only EVGEN files, without reconstructed events, use this command:
+<code bash>
+hs-mirror -i $SOURCE-o $OUTPUT_DIR -t evgen
+</code>
 Generally, you do not need to index files in the mirror directory.
@@ Line 91: / Line 101: @@
 ====== Summary ======
-When everything is done, this is what you will expect:
+When everything is done, this is what you should expect:
-  * You files will be visible on the main HepSim web page and on the mirrors (takes ~ few days to propagate the changes)
+  * You files will be visible on the main HepSim web page and on the current mirrors (takes ~ few days to propagate the changes)
-  * You can search your files etc.
+  * You can search your files etc. using the main HepSim web page
-  * Since your files are public, there is good chance that somebody will make a mirror
   * You can search, list and download files using hs-toolkit commands (hs-find, hs-ls, hs-get etc)
+  * Since your files are public, there is good chance that somebody will make a mirror to reduce the load on your server
   * You server will be listed on the page [[http://atlaswww.hep.anl.gov/hepsim/summary.php|statistics summary]]