Integrate Jenkins Job Cacher Plugin for improved build caching

[kennknowles]

See discussion on dev. With the new Gradle build, we are now able to build incrementally, but are not yet taking advantage of it on Jenkins. This would give us the benefit of much faster pre-commits for files that aren't changed. For example, A change in the Python which doesn't touch any Java would not need to re-run Java pre-commits.

By default, Gradle uses a build cache local to the workspace, and in Jenkins the workspace gets nuked on each build. There is a Jenkins Job Cacher Plugin which solves this exact plugin and integrates with Gradle's build cache support. I believe all we need to do is enable and configure this plugin to realize the benefits of incremental builds.

To enable the plugin, we likely need to reach out the Apache INFRA team.

Imported from Jira BEAM-4400. Original Jira may contain additional context.
Reported by: swegner.