Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Create a cronjob to autorelease Foyle. #321

Merged
merged 1 commit into from
Oct 23, 2024
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
34 changes: 34 additions & 0 deletions cicd/README.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,34 @@
# Foyle CICD

* We use a cronjob to regularly run [hydros](https://github.com/jlewi/hydros) to release Foyle

```bash
kustomize build releaser | kubectl apply -f -
```

## Create one off job

* You can fire off a job from the cron job

```bash {"id":"01JAX9F0VQW4RWK80WNCNANSWD","interactive":"true"}
kubectl create job --from=cronjob/release-cron one-off-release -n foyle-cicd
```

```bash {"id":"01JAX9G3MYCXPPHJP06G0CWDPY","interactive":"false"}
# 1. Check the status of the one-off job and its pods to ensure everything is running correctly.
kubectl -n foyle-cicd get jobs
kubectl -n foyle-cicd get pods -n foyle-cicd
```

```bash
kubectl -n foyle-cicd get pods -w
```

* Fetch the logs for the K8s job one-off-release
* Use gcloud to fetch them from gcloud
* I noticed that in some k8s the labels k8s-pod weren't attached. I wonder if that happens because the pod and VM didn't live long enough?

```bash {"id":"01JAX9PE1ZQATY0R0RTMVAWSEQ","interactive":"false"}
# Fetch the logs for the one-off K8s job using gcloud
gcloud logging read "resource.type=\"k8s_container\" AND labels.\"k8s-pod/batch_kubernetes_io/job-name\"=\"one-off-release\"" --limit=100
```
11 changes: 11 additions & 0 deletions cicd/releaser/config.yaml
Original file line number Diff line number Diff line change
@@ -0,0 +1,11 @@
apiVersion: ""
kind: ""
logging:
level: info
sinks:
- json: true
path: stderr
gitHub:
appID: 315982
privateKey: gcpsecretmanager:///projects/foyle-dev/secrets/foyle-ghapp-key/versions/latest
workDir: /tmp/hydros_work_dir
82 changes: 82 additions & 0 deletions cicd/releaser/cronjob.yaml
Original file line number Diff line number Diff line change
@@ -0,0 +1,82 @@
apiVersion: batch/v1
kind: CronJob
metadata:
name: release-cron
namespace: foyle-cicd
spec:
schedule: "0 20 * * *"
timeZone: "America/Los_Angeles"
jobTemplate:
spec:
template:
metadata:
labels:
component: hydros
spec:
initContainers:
- name: clone
image: us-west1-docker.pkg.dev/foyle-public/images/hydros/hydros
command:
- /hydros
- --config=/config/config.yaml
- clone
- --repo=https://github.com/jlewi/foyle.git
# TODO(https://github.com/jlewi/hydros/issues/89): Update clone to use viper configuration
- --ghapp-id=315982
- --private-key=gcpsecretmanager:///projects/foyle-dev/secrets/foyle-ghapp-key/versions/latest
- --work-dir=/tmp/hydros_work_dir
resources:
limits:
cpu: "4"
memory: 4Gi
requests:
cpu: "4"
memory: 4Gi
volumeMounts:
- name: config
mountPath: /config
readOnly: true
- name: data
mountPath: /tmp
readOnly: false
containers:
- image: us-west1-docker.pkg.dev/foyle-public/images/hydros/hydros
name: hydros
#image: amd64/busybox
# command:
# - tail
# - -f
# - /dev/null
command:
- /hydros
- --config=/config/config.yaml
- apply
- /tmp/hydros_work_dir/github.com/jlewi/foyle/releasing.yaml
env:
- name: GITHUB_TOKEN
valueFrom:
secretKeyRef:
name: github-token-ghcr
key: GITHUB_TOKEN
resources:
limits:
cpu: "4"
memory: 4Gi
requests:
cpu: "4"
memory: 4Gi
volumeMounts:
- name: config
mountPath: /config
readOnly: true
- name: data
mountPath: /tmp
readOnly: false
restartPolicy: OnFailure
serviceAccountName: foyle-cicd
volumes:
- name: config
configMap:
name: config
- name: data
emptyDir: {}
14 changes: 14 additions & 0 deletions cicd/releaser/kustomization.yaml
Original file line number Diff line number Diff line change
@@ -0,0 +1,14 @@
apiVersion: kustomize.config.k8s.io/v1beta1
kind: Kustomization
namespace: foyle-cicd
metadata:
labels:
environment: dev
resources:
- namespace.yaml
- cronjob.yaml
- serviceaccount.yaml
configMapGenerator:
- name: config
files:
- config.yaml
4 changes: 4 additions & 0 deletions cicd/releaser/namespace.yaml
Original file line number Diff line number Diff line change
@@ -0,0 +1,4 @@
apiVersion: v1
kind: Namespace
metadata:
name: foyle-cicd
7 changes: 7 additions & 0 deletions cicd/releaser/serviceaccount.yaml
Original file line number Diff line number Diff line change
@@ -0,0 +1,7 @@
apiVersion: v1
kind: ServiceAccount
metadata:
name: foyle-cicd
namespace: foyle-cicd
annotations:
iam.gke.io/gcp-service-account: [email protected]
Loading