Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Bug]: Multiarch sdk container creation time at epoch causing cleaner agressively delete them #29341

Closed
16 tasks
Abacn opened this issue Nov 8, 2023 · 2 comments · Fixed by #29419
Closed
16 tasks

Comments

@Abacn
Copy link
Contributor

Abacn commented Nov 8, 2023

What happened?

and causing ongoing postcommits failure every day around 5 PM (PDT).

From the log of https://github.com/apache/beam/actions/runs/6778016000 one can see

Digests:
- us.gcr.io/***/github-actions/beam_go_sdk@sha256:07d1cda15436c9dd4608b0be6ae77e32103b96ca09eedecaed601224e425e50e
  Associated tags:
 - 20231106-160203
Deleted [us.gcr.io/***/github-actions/beam_go_sdk:20231106-160203].
Deleted [us.gcr.io/***/github-actions/beam_go_sdk@sha256:07d1cda15436c9dd4608b0be6ae77e32103b96ca09eedecaed601224e425e50e].
Deleting image. Command: gcloud container images delete us.gcr.io/***/github-

Issue Priority

Priority: 2 (default / most bugs should be filed as P2)

Issue Components

  • Component: Python SDK
  • Component: Java SDK
  • Component: Go SDK
  • Component: Typescript SDK
  • Component: IO connector
  • Component: Beam YAML
  • Component: Beam examples
  • Component: Beam playground
  • Component: Beam katas
  • Component: Website
  • Component: Spark Runner
  • Component: Flink Runner
  • Component: Samza Runner
  • Component: Twister2 Runner
  • Component: Hazelcast Jet Runner
  • Component: Google Cloud Dataflow Runner
@Abacn
Copy link
Contributor Author

Abacn commented Nov 8, 2023

Example containers:

as can be seen, some manifest has "Created" at epoch. However, because container registry CLI only supports sort by Timestamp (created). We may need to set create time at current time for testing containers.

Name Tags Virtual Size Created Uploaded Vulnerabilities  
c864b0e8bc3a   1.2 KB Dec 31, 1969 2 hours ago Not supported  
fa0191e6b4fb   213.6 MB 2 hours ago 2 hours ago 26  
89124f3fe410   208 MB 2 hours ago 2 hours ago 26  
b1f9dc6e8656 20231107-211804995803113 Dec 31, 1969 3 hours ago  
06e7bb78989b   1.2 KB Dec 31, 1969 3 hours ago Not supported  
242e187d1d8c   213.6 MB 3 hours ago 3 hours ago 26  
39320d763be6   1.2 KB Dec 31, 1969 3 hours ago Not supported  
ebeb66d5cc96   208.1 MB 3 hours ago 3 hours ago 26  
 

@Abacn
Copy link
Contributor Author

Abacn commented Nov 8, 2023

Also, go container is always build in multiarch, which is not necessary. This can cause both non-arm and arm test failing.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging a pull request may close this issue.

1 participant