hltd 1.6.0 merge to master #60
Merged
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
/etc/appliance) and switchover to "cloud" mode for FUs
*futher improvements
instances (might handle with single merger instance if transfer options are written per run)
Conflicts: python/elasticbu.py
Conflicts: python/elasticbu.py
in name finding for closure checks (in case central cluster is used)
*not using same port for instances on BU, instead offset based on BU instance list order *modified init script *changed config file init
problem: hltd still writes to /etc/hltd.conf if started using all option of the init script (will execve or popen to start each variant)
processes of multiple instances (if only using double fork, logging was being taken to the log file of a first process)
in case of checksum error, fill in only error events and delete the file
*new CMSSW test script
*resources stay in quarantined until next run appears (accounting for if next ongoing run is already present) *number of non-zero exit codes are logged in boxinfo files
…art limit reached
*resolve a bug where already renamed and deleted file is closed by CMSSW very late
*logcollector will correctly push mapping *lock to protect from taking nss lock while forking with demote (can deadlock child process due to initiated DNS lookups in parent while fork is called)
*include and exclude cgi added
index anelastic queue status in ES
…script *monitoring and fixes to lumi queue status *fix blacklist file support *quicker appearance of box file (1s) after restart on FU *close index by default *better define types in aUtils
*fixed active run cleanup in BU *instances share same output and make symlink in main dir for mergers to work transparently
-fillresources.py always executed by configurefff.sh -subtract sub-mount sizes when calculating ramdisk total and used size -ramdisk occupancy in summary json -fixed anelastic accounting of queued lumis -worst-case number of queued lumis taken only for latest active run in appliance (if any) -silence messages about file deletion in elastic and anelastic (already obvious from other info)
*10s threshold for resource_summary file info collection
*retry writing and moving queue status file as it is sometimes not correctly written *log collector process can be restarted by creating 'logrestart' file in watch directory *update 1.6.0 release candidate rpm's
Conflicts: python/elastic.py python/elasticbu.py python/hltd.py python/setupmachine.py scripts/metarpm.sh
*box files indexing skipped when unable to have connection
*using os._exit to quit the process when there is processing loop exception in anelastic or elastic.py
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
1.5.3 is now branched into hltd-1.5.3, so merging current version into master. release will be created afterwards.