User Tools
hpc:argobalsam
Differences
This shows you the differences between two versions of the page.
| Both sides previous revision Previous revision Next revision | Previous revision Last revision Both sides next revision | ||
|
hpc:argobalsam [2015/01/21 16:13] jchilders [Git Tag Notes] |
hpc:argobalsam [2016/01/26 18:58] jchilders [Installation] |
||
|---|---|---|---|
| Line 77: | Line 77: | ||
| ===== Installation ===== | ===== Installation ===== | ||
| + | - On Mira: '' | ||
| - Install < | - Install < | ||
| + | - '' | ||
| - Create install directory: '' | - Create install directory: '' | ||
| - '' | - '' | ||
| - '' | - '' | ||
| - Create virtual environment: | - Create virtual environment: | ||
| + | - On Edison: | ||
| + | - '' | ||
| + | - '' | ||
| - Activate virtual environment: | - Activate virtual environment: | ||
| + | - On Edison: | ||
| + | - To use '' | ||
| - Install needed software: | - Install needed software: | ||
| - | - '' | + | - '' |
| + | - if you have less than python-2.7 you need '' | ||
| - '' | - '' | ||
| - '' | - '' | ||
| - | | + | - '' |
| - | - Grab software from git repo: '' | + | - For this I had to install on SLC6 '' |
| - | - Update the following | + | |
| - | from mira_settings import * | + | - '' |
| + | - '' | ||
| + | - '' | ||
| + | - '' | ||
| + | - Update the following | ||
| + | | ||
| + | from site_settings.mira_settings import * | ||
| </ | </ | ||
| + | - <code python> | ||
| + | INSTALLED_APPS = ( | ||
| + | ' | ||
| + | ' | ||
| + | ' | ||
| + | ' | ||
| + | ' | ||
| + | ' | ||
| + | ' | ||
| + | ' | ||
| + | ' | ||
| + | ) | ||
| + | </ | ||
| + | - If you are using MySQL: <code python> | ||
| + | DATABASES = { | ||
| + | ' | ||
| + | ' | ||
| + | ' | ||
| + | ' | ||
| + | ' | ||
| + | ' | ||
| + | ' | ||
| + | ' | ||
| + | } | ||
| + | } | ||
| + | </ | ||
| + | - Setup your database: | ||
| + | - For Older Django using South (pre-1.7): | ||
| + | - <code bash> python manage.py syncdb </ | ||
| + | - Create the first migration <code bash> python manage.py schemamigration balsam_core --initial </ | ||
| + | - Apply the first migration <code bash> python manage.py migrate balsam_core --fake </ | ||
| + | - Create the first migration <code bash> python manage.py schemamigration argo_core --initial </ | ||
| + | - Apply the first migration <code bash> python manage.py migrate argo_core --fake </ | ||
| + | - For newer Django (1.7, | ||
| + | - <code bash> python manage.py syncdb </ | ||
| + | - For Django (1.9+): | ||
| + | - <code bash> python manage.py migration --fake-initial </ | ||
| ===== Git Tag Notes ===== | ===== Git Tag Notes ===== | ||
| - | [[ https:// | + | < |
| + | |||
| + | 5.0 | ||
| + | * updated to MySQL database | ||
| + | * create filter website | ||
| + | * Added '' | ||
| + | 4.1 | ||
| + | * updated vesta balsam delays to 5 min | ||
| + | * making all settings files consistent. | ||
| + | * added code to deal with jobs after a crash, and added print statements | ||
| + | * added restart try of subprocesses in the service loop | ||
| + | * updated vesta settings | ||
| + | * Updated Balsam code to support tukey submit script with manual mpirun call. Mira handles the mpirun call for the user whereas tukey does not. | ||
| + | * added tukey balsam site to argo settings | ||
| + | * updated argo settings to reflect new install directory balsam_production | ||
| + | 4.0 | ||
| + | * adding condor command files which should have already been added. Fixed bugs with adding alpgen data to finished emails. | ||
| + | * adding logger.exception in the proper places. Fixed small bugs and added JobHold error | ||
| + | * Adding files for the condor scheduler changes to include dagman jobs and condor job files. | ||
| + | * Many updates to accomodate a Condor Scheduler ability to accept condor job files and condor dagman job files. Also includes updates to include more information on emails upon completion. | ||
| + | * fixing missing str() conversion | ||
| + | * fixed error messages where integers needed to be converted to strings | ||
| + | * updating only specific db fields instead of full object | ||
| + | 3.2 | ||
| + | * re-added JobStatusReceiver | ||
| + | 3.1 | ||
| + | * adding QueueMessage class to argo | ||
| + | * merging old and new? | ||
| + | * adding longer wait times to balsam on ascinode settings, and an error checking to the job status receiver. | ||
| + | 3.0 | ||
| + | * major change to ARGO so that each transition takes place in a subprocess and does not block argo from processing other jobs in parallel | ||
| + | * added error catching for job id mismatch | ||
| - | * 4.1 | ||
| - | * updated vesta balsam delays to 5 min | ||
| - | * making all settings files consistent. | ||
| - | * added code to deal with jobs after a crash, and added print statements | ||
| - | * added restart try of subprocesses in the service loop | ||
| - | * updated vesta settings | ||
| - | * Updated Balsam code to support tukey submit script with manual mpirun call. Mira handles the mpirun call for the user whereas tukey does not. | ||
| - | * added tukey balsam site to argo settings | ||
| - | * updated argo settings to reflect new install directory balsam_production | ||
| - | * 4.0 | ||
| - | * adding condor command files which should have already been added. Fixed bugs with adding alpgen data to finished emails. | ||
| - | * adding logger.exception in the proper places. Fixed small bugs and added JobHold error | ||
| - | * Adding files for the condor scheduler changes to include dagman jobs and condor job files. | ||
| - | * Many updates to accomodate a Condor Scheduler ability to accept condor job files and condor dagman job files. Also includes updates to include more information on emails upon completion. | ||
| - | * fixing missing str() conversion | ||
| - | * fixed error messages where integers needed to be converted to strings | ||
| - | * updating only specific db fields instead of full object | ||
| - | * 3.2 | ||
| - | * re-added JobStatusReceiver | ||
| - | * 3.1 | ||
| - | * adding QueueMessage class to argo | ||
| - | * merging old and new? | ||
| - | * adding longer wait times to balsam on ascinode settings, and an error checking to the job status receiver. | ||
| - | * 3.0 | ||
| - | * major change to ARGO so that each transition takes place in a subprocess and does not block argo from processing other jobs in parallel | ||
| - | * added error catching for job id mismatch | ||
| - | - 2.2 | ||
| - | - moved postprocessing to thread | ||
| - | - grid proxy now valid for 96 hours | ||
| - | - fixed loop iteration for postprocess list | ||
| - | - fixed the postprocessing process tracking | ||
| - | - testing running post processing in a subthread | ||
| - | - adding a few more debug messages | ||
| - | - added more debug messages and removed channel/ | ||
| - | - added run_project to cobalt flags | ||
| - | - Added job ID to email | ||
| - | - removed fail current jobs on restart in balsam_service, | ||
| - | - updated website with time | ||
| - | - update vesta_dev settings | ||
| - | - added subjob site to ls_jobs | ||
| - | - removed some debug statements from GridFtp | ||
| - | - updated mira queue to hadronsim | ||
| - | - added 2048 bits to certificate security grid-proxy-init call | ||
| - | - if job fails on sheduler status update, it runs the postprocessing | ||
| - | - added vesta_dev_settings | ||
| - | - added ability to specify balsam site explicitly | ||
| - | - removed debug from grid ftp | ||
| - | - fixes for condor | ||
| - | - added balsam site to balsamjob fixed response to holding state | ||
| - | - Adding site and fixing Holding state response. | ||
| - | - added failed to list of messages sent by balsam_service and added command to remove all jobs | ||
| - | - Updates to fix multiple job finished send message. Using Tom Urams excellent solution in the PreSave step :) | ||
hpc/argobalsam.txt · Last modified: 2016/02/24 21:31 by jchilders
Page Tools
Except where otherwise noted, content on this wiki is licensed under the following license: Public Domain
