Objects: Wait on jobs instead of datasets

[jmchilton]

In general it is better to wait on jobs instead of datasets when running tools and workflows - in case tools don't have any dataset outputs and to ensure all extra files have been captured at the end of the execution (I think Galaxy may mark the dataset as complete before extra files have been collected, jobs are marked as complete only at the very end).

[nsoranzo]

Would be good, but how can we get the job id from the run tool/workflow API calls?

[jmchilton]

Running a tool returns a list of jobs corresponding to the execution, workflow execution returns a workflow invocation - once the invocation has reached a state of scheduled - all the invocation steps corresponding to actual jobs should have a job_id. So workflows really need wait on both the invocation to be fully scheduled and then each job to be complete - this invocation step information is exposed as part of #170.

[nsoranzo]

So this can be done only for Galaxy release_15.03 or later, correct?

[jmchilton]

I'm not exactly sure, something in that time frame though yes. May be able to make 15.01 or 14.10 work also.