Skip to content

Add ability to throttle job #39

Open
PDmatrix opened this issue Apr 22, 2020 · 1 comment
Open

Add ability to throttle job #39

PDmatrix opened this issue Apr 22, 2020 · 1 comment

Comments

@PDmatrix
Copy link

Currently, the only way to decrease the load on the database is to increase IntervalStartJob, but there might be problems with it
I suggest that we add another setting JobThrottleSettings that will dynamically increase IntervalStartJob if there are no jobs available for a certain period

Algorithm:

  1. Try to get jobs with IntervalStartJob
  2. If there is no jobs after JobThrottleSettings.JobRetrievalAttempts we increase IntervalStartJobs by JobThrottleSettings.IntervalMultiplier
  3. To prevent massive IntervalStartJob, there will be JobThrottleSettings.MaxJobThrottleInterval so we won't wait too long
  4. After we successfully retrieve a job, IntervalStartJob will reset to its original value
@Bobreshovr
Copy link
Contributor

it's a good idea, add one comment to PR.
What about the load test of this throttle?

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants