Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: add --image-parallel-copies flag #2277

Merged
merged 1 commit into from
Apr 8, 2024

Conversation

Atry
Copy link
Contributor

@Atry Atry commented Mar 29, 2024

It would be useful when there are many layers while most of layers are unchanged between versions.

See discussion at nlewo/nix2container#125

@Atry Atry force-pushed the max-parallel-downloads branch 3 times, most recently from 5d1622f to 98312aa Compare March 29, 2024 17:56
Copy link
Contributor

@mtrmac mtrmac left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks!

Compare containers/image#1968 ; that might, or might not, also have a noticeable effect for that use case.

(Hypothetically even to the point of making this option unnecessary? I think that’s unlikely, but worth measuring.)

cmd/skopeo/copy.go Outdated Show resolved Hide resolved
cmd/skopeo/copy.go Outdated Show resolved Hide resolved
@Atry Atry force-pushed the max-parallel-downloads branch 2 times, most recently from 2f08be9 to 955a81d Compare April 2, 2024 16:54
@Atry Atry requested a review from mtrmac April 2, 2024 16:55
@Atry Atry changed the title feat: add --max-parallel-downloads flag feat: add --image-parallel-copies flag Apr 2, 2024
Copy link
Contributor

@mtrmac mtrmac left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Does containers/image#1968 change the need for this flag?

cmd/skopeo/copy.go Outdated Show resolved Hide resolved
@Atry Atry force-pushed the max-parallel-downloads branch from 955a81d to db8701c Compare April 3, 2024 18:48
@Atry
Copy link
Contributor Author

Atry commented Apr 3, 2024

Does containers/image#1968 change the need for this flag?

Both PRs can speed up skopeo copy. It's better to have both.

@Atry Atry requested a review from mtrmac April 3, 2024 18:53
Atry added a commit to Atry/nix-ml-ops that referenced this pull request Apr 4, 2024
@mtrmac mtrmac added the kind/feature A request for, or a PR adding, new functionality label Apr 5, 2024
@TomSweeneyRedHat
Copy link
Member

@Atry Looks like this needs a rebase.
Changes LGTM on a quick scan.

@Atry Atry force-pushed the max-parallel-downloads branch from 4948a7c to e9a930d Compare April 6, 2024 18:55
@Atry
Copy link
Contributor Author

Atry commented Apr 6, 2024

Rebased

@rhatdan
Copy link
Member

rhatdan commented Apr 8, 2024

LGTM
@mtrmac PTAL

Copy link
Contributor

@mtrmac mtrmac left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks again!

@mtrmac mtrmac force-pushed the max-parallel-downloads branch from e9a930d to 1c72e39 Compare April 8, 2024 15:40
@mtrmac mtrmac merged commit 9bfc125 into containers:main Apr 8, 2024
24 checks passed
@stale-locking-app stale-locking-app bot locked as resolved and limited conversation to collaborators Jul 8, 2024
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
kind/feature A request for, or a PR adding, new functionality locked - please file new issue/PR
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants