Introduce forceAt and resetAt annotations
#823
Conversation
hiddeco
force-pushed
the
reset-force-annotations
branch
2 times, most recently
from
3dde8c2 to
2a5a56c
Compare
|
Please open an issue in flux2 repo for adding the |
hiddeco
force-pushed
the
reset-force-annotations
branch
3 times, most recently
from
6ace8c2 to
38aebfc
Compare
| // If the force annotation is set, we can attempt to upgrade the release | ||
| // without any further checks. | ||
| if forceRequested { | ||
| log.Info(msgWithReason("forcing upgrade for failed release", "force requested through annotation")) |
There was a problem hiding this comment.
There is a question here around user desire: one option is to do what I implemented here, which is to force a move forward.
The other option would be to ignore the fact that retries are exhausted, and continue with the remediation attempt.
There was a problem hiding this comment.
After thinking about this some more, and discussing it with @darkowlzz, I think the current behavior is what should be expected.
Given if someone wants to continue from the point where it runs into "retries exhausted", they can simply use the reset annotations. If force would do the same, it would bear no value to someone who has "unlimited retries" (retries: -1) configured, and this feature would be void.
There was a problem hiding this comment.
discussed this in a meeting, and i share this exact opinion.
| if forceRequested { | ||
| log.Info(msgWithReason("forcing upgrade for in-sync release", "force requested through annotation")) | ||
| return NewUpgrade(r.configFactory, r.eventRecorder), nil | ||
| } |
There was a problem hiding this comment.
Same question around user desire here: do they want to force an upgrade, or do they only want to force it forward when it is in some failed state?
There was a problem hiding this comment.
Same kind of applies here, if you do not want to force an upgrade. Just request a "normal" reconciliation and nothing will happen.
This introduces two new annotations: - `reconcile.fluxcd.io/resetAt`: to reset the failure counts for a `HelmRelease` object. - `reconcile.fluxcd.io/forceAt`: to allow a one-off Helm install or upgrade when the controller would otherwise do nothing (e.g. due to being out of retries, in-sync, in a failed state, etc.) Both annotations require the `reconcile.fluxcd.io/requestedAt` annotation to be set at the same time, with the same token value. Signed-off-by: Hidde Beydals <[email protected]>
This makes the controller actually take the `reconcile.fluxcd.io/forceAt` and `reconcile.fluxcd.io/resetAt` into account. For `reconcile.fluxcd.io/resetAt`, this means that the failure counts on the `HelmRelease` object are reset when the token value of the annotation equals `reconcile.fluxcd.io/requestedAt`. Allowing the controller to start over with attempting to install or upgrade the release until the retries count has been reached again. For `reconcile.fluxcd.io/forceAt`, this means that a one-off Helm install or upgrade is allowed to take place even if the object is out of retries, in a failed state where it should be remediated, or in-sync. Signed-off-by: Hidde Beydals <[email protected]>
hiddeco
force-pushed
the
reset-force-annotations
branch
from
38aebfc to
6b7789a
Compare
There was a problem hiding this comment.
LGTM
Thanks @hiddeco 🏅
PS. I tested the annotations with various failure conditions and works as expected!
Implementation of #366 (comment)
This introduces two new annotations:
reconcile.fluxcd.io/resetAt: to reset the failure counts for aHelmReleaseobject.reconcile.fluxcd.io/forceAt: to allow a one-off Helm install orupgrade when the controller would otherwise do nothing (e.g. due to
being out of retries, in-sync, in a failed state, etc.)
Both annotations require the
reconcile.fluxcd.io/requestedAtannotation to be set at the same time, with the same token value.
Example
Fixes #267
Fixes #366
Fixes #454
Fixes #297