Implement "stage_file_with_retry" for robust file staging

[shunping]

Job creation involves staging multiple files (artifacts, pipeline proto, job file, template). While artifact staging has retry logic, these other types do not, leading to potential job failures due to transient service issues.

This commit introduces stage_file_with_retry, a new function with built-in retry logic. Several stage_file calls in apiclient.py have been replaced with this new function.

Internal bug id: 384579652.

[codecov]

Codecov Report

Attention: Patch coverage is 87.50000% with 2 lines in your changes missing coverage. Please review.

Project coverage is 57.14%. Comparing base (4a91890) to head (e891af8).
Report is 25 commits behind head on master.

Files with missing lines	Patch %	Lines
...apache_beam/runners/dataflow/internal/apiclient.py	87.50%	2 Missing ⚠️

Additional details and impacted files

@@             Coverage Diff              @@
##             master   #33436      +/-   ##
============================================
- Coverage     57.44%   57.14%   -0.30%     
  Complexity     1475     1475              
============================================
  Files           979      979              
  Lines        155237   155218      -19     
  Branches       1076     1076              
============================================
- Hits          89181    88705     -476     
- Misses        63840    64297     +457     
  Partials       2216     2216              

Flag	Coverage Δ
python	80.64% <87.50%> (-0.66%)	⬇️

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

[github-actions]

Assigning reviewers. If you would like to opt out of this review, comment assign to next reviewer:

R: @jrmccluskey for label python.

Available commands:

• stop reviewer notifications - opt out of the automated review tooling
• remind me after tests pass - tag the comment author after tests pass
• waiting on author - shift the attention set back to the author (any comment or push by the author will return the attention set to the reviewers)

The PR bot will only process comments in the main thread (not review comments).

[github-actions]

Reminder, please take a look at this pr: @jrmccluskey