This shows you the differences between two versions of the page.
Both sides previous revision Previous revision Next revision | Previous revision | ||
hpc:argobalsam [2015/01/21 16:13] jchilders [Git Tag Notes] |
hpc:argobalsam [2016/02/24 21:31] (current) jchilders [Installation] |
||
---|---|---|---|
Line 77: | Line 77: | ||
===== Installation ===== | ===== Installation ===== | ||
+ | - On Mira: '' | ||
- Install < | - Install < | ||
+ | - '' | ||
- Create install directory: '' | - Create install directory: '' | ||
- '' | - '' | ||
- '' | - '' | ||
- Create virtual environment: | - Create virtual environment: | ||
+ | - On Edison: | ||
+ | - '' | ||
+ | - '' | ||
- Activate virtual environment: | - Activate virtual environment: | ||
+ | - On Edison: | ||
+ | - To use '' | ||
- Install needed software: | - Install needed software: | ||
- | - '' | + | - '' |
+ | - if you have less than python-2.7 you need '' | ||
- '' | - '' | ||
- '' | - '' | ||
- | | + | - '' |
- | - Grab software from git repo: '' | + | - For this I had to install on SLC6 '' |
- | - Update the following | + | |
- | from mira_settings import * | + | - '' |
+ | - '' | ||
+ | - '' | ||
+ | - '' | ||
+ | - Update the following | ||
+ | | ||
+ | from site_settings.mira_settings import * | ||
</ | </ | ||
+ | - <code python> | ||
+ | INSTALLED_APPS = ( | ||
+ | ' | ||
+ | ' | ||
+ | ' | ||
+ | ' | ||
+ | ' | ||
+ | ' | ||
+ | ' | ||
+ | ' | ||
+ | ' | ||
+ | ) | ||
+ | </ | ||
+ | - If you are using MySQL: <code python> | ||
+ | DATABASES = { | ||
+ | ' | ||
+ | ' | ||
+ | ' | ||
+ | ' | ||
+ | ' | ||
+ | ' | ||
+ | ' | ||
+ | ' | ||
+ | } | ||
+ | } | ||
+ | </ | ||
+ | - Setup your database: | ||
+ | - For Older Django using South (pre-1.7): | ||
+ | - <code bash> python manage.py syncdb </ | ||
+ | - Create the first migration <code bash> python manage.py schemamigration balsam_core --initial </ | ||
+ | - Apply the first migration <code bash> python manage.py migrate balsam_core --fake </ | ||
+ | - Create the first migration <code bash> python manage.py schemamigration argo_core --initial </ | ||
+ | - Apply the first migration <code bash> python manage.py migrate argo_core --fake </ | ||
+ | - For newer Django (1.7, | ||
+ | - <code bash> python manage.py syncdb </ | ||
+ | - For Django (1.9+): | ||
+ | - <code bash> python manage.py migrate --fake-initial </ | ||
===== Git Tag Notes ===== | ===== Git Tag Notes ===== | ||
- | [[ https:// | + | < |
+ | |||
+ | 5.0 | ||
+ | * updated to MySQL database | ||
+ | * create filter website | ||
+ | * Added '' | ||
+ | 4.1 | ||
+ | * updated vesta balsam delays to 5 min | ||
+ | * making all settings files consistent. | ||
+ | * added code to deal with jobs after a crash, and added print statements | ||
+ | * added restart try of subprocesses in the service loop | ||
+ | * updated vesta settings | ||
+ | * Updated Balsam code to support tukey submit script with manual mpirun call. Mira handles the mpirun call for the user whereas tukey does not. | ||
+ | * added tukey balsam site to argo settings | ||
+ | * updated argo settings to reflect new install directory balsam_production | ||
+ | 4.0 | ||
+ | * adding condor command files which should have already been added. Fixed bugs with adding alpgen data to finished emails. | ||
+ | * adding logger.exception in the proper places. Fixed small bugs and added JobHold error | ||
+ | * Adding files for the condor scheduler changes to include dagman jobs and condor job files. | ||
+ | * Many updates to accomodate a Condor Scheduler ability to accept condor job files and condor dagman job files. Also includes updates to include more information on emails upon completion. | ||
+ | * fixing missing str() conversion | ||
+ | * fixed error messages where integers needed to be converted to strings | ||
+ | * updating only specific db fields instead of full object | ||
+ | 3.2 | ||
+ | * re-added JobStatusReceiver | ||
+ | 3.1 | ||
+ | * adding QueueMessage class to argo | ||
+ | * merging old and new? | ||
+ | * adding longer wait times to balsam on ascinode settings, and an error checking to the job status receiver. | ||
+ | 3.0 | ||
+ | * major change to ARGO so that each transition takes place in a subprocess and does not block argo from processing other jobs in parallel | ||
+ | * added error catching for job id mismatch | ||
- | * 4.1 | ||
- | * updated vesta balsam delays to 5 min | ||
- | * making all settings files consistent. | ||
- | * added code to deal with jobs after a crash, and added print statements | ||
- | * added restart try of subprocesses in the service loop | ||
- | * updated vesta settings | ||
- | * Updated Balsam code to support tukey submit script with manual mpirun call. Mira handles the mpirun call for the user whereas tukey does not. | ||
- | * added tukey balsam site to argo settings | ||
- | * updated argo settings to reflect new install directory balsam_production | ||
- | * 4.0 | ||
- | * adding condor command files which should have already been added. Fixed bugs with adding alpgen data to finished emails. | ||
- | * adding logger.exception in the proper places. Fixed small bugs and added JobHold error | ||
- | * Adding files for the condor scheduler changes to include dagman jobs and condor job files. | ||
- | * Many updates to accomodate a Condor Scheduler ability to accept condor job files and condor dagman job files. Also includes updates to include more information on emails upon completion. | ||
- | * fixing missing str() conversion | ||
- | * fixed error messages where integers needed to be converted to strings | ||
- | * updating only specific db fields instead of full object | ||
- | * 3.2 | ||
- | * re-added JobStatusReceiver | ||
- | * 3.1 | ||
- | * adding QueueMessage class to argo | ||
- | * merging old and new? | ||
- | * adding longer wait times to balsam on ascinode settings, and an error checking to the job status receiver. | ||
- | * 3.0 | ||
- | * major change to ARGO so that each transition takes place in a subprocess and does not block argo from processing other jobs in parallel | ||
- | * added error catching for job id mismatch | ||
- | - 2.2 | ||
- | - moved postprocessing to thread | ||
- | - grid proxy now valid for 96 hours | ||
- | - fixed loop iteration for postprocess list | ||
- | - fixed the postprocessing process tracking | ||
- | - testing running post processing in a subthread | ||
- | - adding a few more debug messages | ||
- | - added more debug messages and removed channel/ | ||
- | - added run_project to cobalt flags | ||
- | - Added job ID to email | ||
- | - removed fail current jobs on restart in balsam_service, | ||
- | - updated website with time | ||
- | - update vesta_dev settings | ||
- | - added subjob site to ls_jobs | ||
- | - removed some debug statements from GridFtp | ||
- | - updated mira queue to hadronsim | ||
- | - added 2048 bits to certificate security grid-proxy-init call | ||
- | - if job fails on sheduler status update, it runs the postprocessing | ||
- | - added vesta_dev_settings | ||
- | - added ability to specify balsam site explicitly | ||
- | - removed debug from grid ftp | ||
- | - fixes for condor | ||
- | - added balsam site to balsamjob fixed response to holding state | ||
- | - Adding site and fixing Holding state response. | ||
- | - added failed to list of messages sent by balsam_service and added command to remove all jobs | ||
- | - Updates to fix multiple job finished send message. Using Tom Urams excellent solution in the PreSave step :) |