[INFRA-1671] Let build sleep until incremental dependencies have been published #1390
Comments
|
Sketch of crude solution. Needs work. |
|
Most of the time, INFRA-1633 is responsible for the upstream build being so slow, though sometimes it is just an actually slow build (like core). |
|
The maven container agent label would be useful for reducing overhead of the Incremental Deps stage. Still, a full mvn validate would have to download a ton of unrelated dependencies, which seems slow. Would be best to directly look for incremental versions in the POM and check for them in the repository via HTTP HEAD calls. Or could use mvn dependency:resolve -DincludeArtifactIds=… after mvn dependency:collect for more precision at the cost of greater overhead. Or there could be a new mojo in incrementals-tools which does precisely this analysis. |
|
if using withMaven then snapshot triggers could be extended and then a new deployment of a snapshot or incremental could retrigger all jobs that use it (won't stop the first build failure) - but otherwise is a zero executor overhead option |
|
But you only want to trigger builds of jobs which tried to use it before and failed to download it at the time, which might be tricky. Not the same case as a snapshot trigger, where the snapshot is nondeterministic and you really want to retrigger builds. And does not seem like it belongs in withMaven since that is a general-purpose step whereas this is an RFE specific to the Jenkins org. |
|
withMaven is extensible (in the Jenkins way) (we have a proprietary extension for it) - was just suggesting that there could exist one for just the jenkinsci infra too. it should be able to trigger on releases too (basically anything) a incremental is a release version (even if it pretends not to be) and so even though you should not redpoly releases you can, the plugin could just trigger if a release is redeployed. |
I see what you are saying.
It does not pretend not to be!
Nor do we, and that is not the issue here. The problem is a build started before the release had been deployed. |
It is irritating to have to wait to push a commit in a downstream plugin because the upstream build has not yet completed and published to Incrementals, even though you have built the commit locally. Would be nice if buildPlugin knew how to detect a missing incremental dependency (some kind of failure pattern from mvn validate) and go to sleep for a while before trying again. Ideally it would even be able to locate the upstream build and wait for it to complete, which would perhaps have shorter wait times, and could handle the case that the upstream build in fact failed.
Originally reported by jglick, imported from: Let build sleep until incremental dependencies have been published
The text was updated successfully, but these errors were encountered: