Each of the following clouds are used for experimentation:
I tested a bunch, but I like resmoio/kubernetes-event-exporter because it provides exactly what I want and nothing more. Note that there are many "sinks" that it can export to, and I have been just testing with stdout. This means:
git clone https://github.com/resmoio/kubernetes-event-exporter
cd kubernetes-event-exporter
kubectl create namespace monitoring
# edit deploy/<config> yaml
kubectl apply -f deployAnd then you can watch events in the terminal and pipe to file:
kubectl logs -n monitoring event-exporter-6bf9c87d4d-v4rtr -f |& tee ./events-$(date +%s).jsonThis should be done by someone not running the experiments. Here are the resources the pod requires:
Non-terminated Pods: (4 in total)
Namespace Name CPU Requests CPU Limits Memory Requests Memory Limits Age
--------- ---- ------------ ---------- --------------- ------------- ---
kube-system aws-node-t96wm 50m (2%) 0 (0%) 0 (0%) 0 (0%) 116m
kube-system kube-proxy-rwbzj 100m (5%) 0 (0%) 0 (0%) 0 (0%) 116m
monitoring event-exporter-6bf9c87d4d-v4rtr 0 (0%) 0 (0%) 0 (0%) 0 (0%) 12m
operator-system operator-controller-manager-548664b97c-xkq5f 15m (0%) 1 (51%) 128Mi (1%) 256Mi (3%) 10m
Allocated resources:
(Total limits may be over 100 percent, i.e., overcommitted.)
Resource Requests Limits
-------- -------- ------
cpu 165m (8%) 1 (51%)
memory 128Mi (1%) 256Mi (3%)
ephemeral-storage 0 (0%) 0 (0%)
hugepages-1Gi 0 (0%) 0 (0%)
hugepages-2Mi 0 (0%) 0 (0%)
Events: <none>That seems like fairly low overhead! And example output is below. I started it up, created/deleted the flux operator a few times, creating an impossible minicluster (that would not leave pending, deleted it, then created a successful minicluster, let it run, and deleted it.
Example event output
{"level":"info","time":"2024-08-10T18:59:07Z","message":"Reading config file /data/config.yaml"}
{"metadata":{"name":"event-exporter-6bf9c87d4d-v4rtr.17ea731616a7a02e","namespace":"monitoring","uid":"3a7bd63a-e69e-4abf-9291-2b444611d696","resourceVersion":"21858","creationTimestamp":"2024-08-10T18:59:06Z"},"reason":"Scheduled","message":"Successfully assigned monitoring/event-exporter-6bf9c87d4d-v4rtr to ip-192-168-13-58.ec2.internal","source":{"component":"default-scheduler"},"firstTimestamp":"2024-08-10T18:59:06Z","lastTimestamp":"2024-08-10T18:59:06Z","count":1,"type":"Normal","eventTime":null,"reportingComponent":"default-scheduler","reportingInstance":"","clusterName":"","involvedObject":{"kind":"Pod","namespace":"monitoring","name":"event-exporter-6bf9c87d4d-v4rtr","uid":"a708b9e9-a941-4899-99c4-b7b42bd0174d","apiVersion":"v1","resourceVersion":"21854","labels":{"app":"event-exporter","pod-template-hash":"6bf9c87d4d","version":"v1"},"annotations":{"prometheus.io/path":"/metrics","prometheus.io/port":"2112","prometheus.io/scrape":"true"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"event-exporter-6bf9c87d4d","uid":"69e73394-7343-44ae-b5d0-f04684b77ace","controller":true,"blockOwnerDeletion":true}],"deleted":false}}
{"metadata":{"name":"event-exporter-6bf9c87d4d-v4rtr.17ea73163037bdfd","namespace":"monitoring","uid":"12696c24-057d-4920-9ecc-d8b455fa2f53","resourceVersion":"21863","creationTimestamp":"2024-08-10T18:59:06Z"},"reason":"Pulling","message":"Pulling image \"ghcr.io/resmoio/kubernetes-event-exporter:latest\"","source":{"component":"kubelet","host":"ip-192-168-13-58.ec2.internal"},"firstTimestamp":"2024-08-10T18:59:06Z","lastTimestamp":"2024-08-10T18:59:06Z","count":1,"type":"Normal","eventTime":null,"reportingComponent":"kubelet","reportingInstance":"ip-192-168-13-58.ec2.internal","clusterName":"","involvedObject":{"kind":"Pod","namespace":"monitoring","name":"event-exporter-6bf9c87d4d-v4rtr","uid":"a708b9e9-a941-4899-99c4-b7b42bd0174d","apiVersion":"v1","resourceVersion":"21855","fieldPath":"spec.containers{event-exporter}","labels":{"app":"event-exporter","pod-template-hash":"6bf9c87d4d","version":"v1"},"annotations":{"prometheus.io/path":"/metrics","prometheus.io/port":"2112","prometheus.io/scrape":"true"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"event-exporter-6bf9c87d4d","uid":"69e73394-7343-44ae-b5d0-f04684b77ace","controller":true,"blockOwnerDeletion":true}],"deleted":false}}
{"metadata":{"name":"event-exporter-6bf9c87d4d-v4rtr.17ea73167691bde3","namespace":"monitoring","uid":"bdd4a3fb-ee64-4579-819a-fa363265ccee","resourceVersion":"21868","creationTimestamp":"2024-08-10T18:59:07Z"},"reason":"Pulled","message":"Successfully pulled image \"ghcr.io/resmoio/kubernetes-event-exporter:latest\" in 1.18s (1.18s including waiting). Image size: 20956222 bytes.","source":{"component":"kubelet","host":"ip-192-168-13-58.ec2.internal"},"firstTimestamp":"2024-08-10T18:59:07Z","lastTimestamp":"2024-08-10T18:59:07Z","count":1,"type":"Normal","eventTime":null,"reportingComponent":"kubelet","reportingInstance":"ip-192-168-13-58.ec2.internal","clusterName":"","involvedObject":{"kind":"Pod","namespace":"monitoring","name":"event-exporter-6bf9c87d4d-v4rtr","uid":"a708b9e9-a941-4899-99c4-b7b42bd0174d","apiVersion":"v1","resourceVersion":"21855","fieldPath":"spec.containers{event-exporter}","labels":{"app":"event-exporter","pod-template-hash":"6bf9c87d4d","version":"v1"},"annotations":{"prometheus.io/path":"/metrics","prometheus.io/port":"2112","prometheus.io/scrape":"true"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"event-exporter-6bf9c87d4d","uid":"69e73394-7343-44ae-b5d0-f04684b77ace","controller":true,"blockOwnerDeletion":true}],"deleted":false}}
{"metadata":{"name":"event-exporter-6bf9c87d4d-v4rtr.17ea73167be78ce7","namespace":"monitoring","uid":"72bc81c4-7644-4bae-a1e8-f85649121cb4","resourceVersion":"21871","creationTimestamp":"2024-08-10T18:59:07Z"},"reason":"Started","message":"Started container event-exporter","source":{"component":"kubelet","host":"ip-192-168-13-58.ec2.internal"},"firstTimestamp":"2024-08-10T18:59:07Z","lastTimestamp":"2024-08-10T18:59:07Z","count":1,"type":"Normal","eventTime":null,"reportingComponent":"kubelet","reportingInstance":"ip-192-168-13-58.ec2.internal","clusterName":"","involvedObject":{"kind":"Pod","namespace":"monitoring","name":"event-exporter-6bf9c87d4d-v4rtr","uid":"a708b9e9-a941-4899-99c4-b7b42bd0174d","apiVersion":"v1","resourceVersion":"21855","fieldPath":"spec.containers{event-exporter}","labels":{"app":"event-exporter","pod-template-hash":"6bf9c87d4d","version":"v1"},"annotations":{"prometheus.io/path":"/metrics","prometheus.io/port":"2112","prometheus.io/scrape":"true"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"event-exporter-6bf9c87d4d","uid":"69e73394-7343-44ae-b5d0-f04684b77ace","controller":true,"blockOwnerDeletion":true}],"deleted":false}}
{"metadata":{"name":"event-exporter-6bf9c87d4d-v4rtr.17ea731677a0e932","namespace":"monitoring","uid":"f4fefdfc-8925-43c7-9278-47742b88c3df","resourceVersion":"21870","creationTimestamp":"2024-08-10T18:59:07Z"},"reason":"Created","message":"Created container event-exporter","source":{"component":"kubelet","host":"ip-192-168-13-58.ec2.internal"},"firstTimestamp":"2024-08-10T18:59:07Z","lastTimestamp":"2024-08-10T18:59:07Z","count":1,"type":"Normal","eventTime":null,"reportingComponent":"kubelet","reportingInstance":"ip-192-168-13-58.ec2.internal","clusterName":"","involvedObject":{"kind":"Pod","namespace":"monitoring","name":"event-exporter-6bf9c87d4d-v4rtr","uid":"a708b9e9-a941-4899-99c4-b7b42bd0174d","apiVersion":"v1","resourceVersion":"21855","fieldPath":"spec.containers{event-exporter}","labels":{"app":"event-exporter","pod-template-hash":"6bf9c87d4d","version":"v1"},"annotations":{"prometheus.io/path":"/metrics","prometheus.io/port":"2112","prometheus.io/scrape":"true"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"event-exporter-6bf9c87d4d","uid":"69e73394-7343-44ae-b5d0-f04684b77ace","controller":true,"blockOwnerDeletion":true}],"deleted":false}}
{"metadata":{"name":"event-exporter-6bf9c87d4d.17ea7316163e022c","namespace":"monitoring","uid":"7e2ad439-b5b5-4f73-b00c-042e7a6f5b10","resourceVersion":"21857","creationTimestamp":"2024-08-10T18:59:06Z"},"reason":"SuccessfulCreate","message":"Created pod: event-exporter-6bf9c87d4d-v4rtr","source":{"component":"replicaset-controller"},"firstTimestamp":"2024-08-10T18:59:06Z","lastTimestamp":"2024-08-10T18:59:06Z","count":1,"type":"Normal","eventTime":null,"reportingComponent":"replicaset-controller","reportingInstance":"","clusterName":"","involvedObject":{"kind":"ReplicaSet","namespace":"monitoring","name":"event-exporter-6bf9c87d4d","uid":"69e73394-7343-44ae-b5d0-f04684b77ace","apiVersion":"apps/v1","resourceVersion":"21850","labels":{"app":"event-exporter","pod-template-hash":"6bf9c87d4d","version":"v1"},"annotations":{"deployment.kubernetes.io/desired-replicas":"1","deployment.kubernetes.io/max-replicas":"2","deployment.kubernetes.io/revision":"1"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"Deployment","name":"event-exporter","uid":"c0c4f88c-93eb-4abe-bd62-87199a977add","controller":true,"blockOwnerDeletion":true}],"deleted":false}}
{"metadata":{"name":"event-exporter.17ea73161453b93b","namespace":"monitoring","uid":"8e447990-48c1-4f01-a43a-9dc82b55d936","resourceVersion":"21852","creationTimestamp":"2024-08-10T18:59:06Z"},"reason":"ScalingReplicaSet","message":"Scaled up replica set event-exporter-6bf9c87d4d to 1","source":{"component":"deployment-controller"},"firstTimestamp":"2024-08-10T18:59:06Z","lastTimestamp":"2024-08-10T18:59:06Z","count":1,"type":"Normal","eventTime":null,"reportingComponent":"deployment-controller","reportingInstance":"","clusterName":"","involvedObject":{"kind":"Deployment","namespace":"monitoring","name":"event-exporter","uid":"c0c4f88c-93eb-4abe-bd62-87199a977add","apiVersion":"apps/v1","resourceVersion":"21849","annotations":{"deployment.kubernetes.io/revision":"1","kubectl.kubernetes.io/last-applied-configuration":"{\"apiVersion\":\"apps/v1\",\"kind\":\"Deployment\",\"metadata\":{\"annotations\":{},\"name\":\"event-exporter\",\"namespace\":\"monitoring\"},\"spec\":{\"replicas\":1,\"selector\":{\"matchLabels\":{\"app\":\"event-exporter\",\"version\":\"v1\"}},\"template\":{\"metadata\":{\"annotations\":{\"prometheus.io/path\":\"/metrics\",\"prometheus.io/port\":\"2112\",\"prometheus.io/scrape\":\"true\"},\"labels\":{\"app\":\"event-exporter\",\"version\":\"v1\"}},\"spec\":{\"containers\":[{\"args\":[\"-conf=/data/config.yaml\"],\"image\":\"ghcr.io/resmoio/kubernetes-event-exporter:latest\",\"imagePullPolicy\":\"IfNotPresent\",\"name\":\"event-exporter\",\"securityContext\":{\"allowPrivilegeEscalation\":false,\"capabilities\":{\"drop\":[\"ALL\"]}},\"volumeMounts\":[{\"mountPath\":\"/data\",\"name\":\"cfg\"}]}],\"securityContext\":{\"runAsNonRoot\":true,\"seccompProfile\":{\"type\":\"RuntimeDefault\"}},\"serviceAccountName\":\"event-exporter\",\"volumes\":[{\"configMap\":{\"name\":\"event-exporter-cfg\"},\"name\":\"cfg\"}]}}}}\n"},"deleted":false}}
{"metadata":{"name":"operator-controller-manager.17ea732edb826593","namespace":"operator-system","uid":"9d750655-fb3d-40cb-9feb-41a208b436d8","resourceVersion":"22267","creationTimestamp":"2024-08-10T19:00:52Z"},"reason":"ScalingReplicaSet","message":"Scaled up replica set operator-controller-manager-548664b97c to 1","source":{"component":"deployment-controller"},"firstTimestamp":"2024-08-10T19:00:52Z","lastTimestamp":"2024-08-10T19:00:52Z","count":1,"type":"Normal","eventTime":null,"reportingComponent":"deployment-controller","reportingInstance":"","clusterName":"","involvedObject":{"kind":"Deployment","namespace":"operator-system","name":"operator-controller-manager","uid":"62295ce2-239f-44cb-b5f8-189893a1bcb4","apiVersion":"apps/v1","resourceVersion":"22264","labels":{"control-plane":"controller-manager"},"annotations":{"deployment.kubernetes.io/revision":"1","kubectl.kubernetes.io/last-applied-configuration":"{\"apiVersion\":\"apps/v1\",\"kind\":\"Deployment\",\"metadata\":{\"annotations\":{},\"labels\":{\"control-plane\":\"controller-manager\"},\"name\":\"operator-controller-manager\",\"namespace\":\"operator-system\"},\"spec\":{\"replicas\":1,\"selector\":{\"matchLabels\":{\"control-plane\":\"controller-manager\"}},\"template\":{\"metadata\":{\"annotations\":{\"kubectl.kubernetes.io/default-container\":\"manager\"},\"labels\":{\"control-plane\":\"controller-manager\"}},\"spec\":{\"containers\":[{\"args\":[\"--secure-listen-address=0.0.0.0:8443\",\"--upstream=http://127.0.0.1:8080/\",\"--logtostderr=true\",\"--v=0\"],\"image\":\"gcr.io/kubebuilder/kube-rbac-proxy:v0.11.0\",\"name\":\"kube-rbac-proxy\",\"ports\":[{\"containerPort\":8443,\"name\":\"https\",\"protocol\":\"TCP\"}],\"resources\":{\"limits\":{\"cpu\":\"500m\",\"memory\":\"128Mi\"},\"requests\":{\"cpu\":\"5m\",\"memory\":\"64Mi\"}},\"securityContext\":{\"allowPrivilegeEscalation\":false}},{\"args\":[\"--health-probe-bind-address=:8081\",\"--metrics-bind-address=127.0.0.1:8080\",\"--leader-elect\"],\"command\":[\"/manager\"],\"image\":\"ghcr.io/flux-framework/flux-operator:latest@sha256:0f61b69f36cc28d4c6c38daef6b1b96eaf9f76ca37528950380f7372f25ef973\",\"imagePullPolicy\":\"Always\",\"livenessProbe\":{\"httpGet\":{\"path\":\"/healthz\",\"port\":8081},\"initialDelaySeconds\":15,\"periodSeconds\":20},\"name\":\"manager\",\"readinessProbe\":{\"httpGet\":{\"path\":\"/readyz\",\"port\":8081},\"initialDelaySeconds\":5,\"periodSeconds\":10},\"resources\":{\"limits\":{\"cpu\":\"500m\",\"memory\":\"128Mi\"},\"requests\":{\"cpu\":\"10m\",\"memory\":\"64Mi\"}},\"securityContext\":{\"allowPrivilegeEscalation\":false}}],\"securityContext\":{\"runAsNonRoot\":true},\"serviceAccountName\":\"operator-controller-manager\",\"terminationGracePeriodSeconds\":10}}}}\n"},"deleted":false}}
{"metadata":{"name":"operator-controller-manager-548664b97c.17ea732edcfd8594","namespace":"operator-system","uid":"528f3afc-dabf-4960-a9e3-51a1415ad8a7","resourceVersion":"22270","creationTimestamp":"2024-08-10T19:00:52Z"},"reason":"SuccessfulCreate","message":"Created pod: operator-controller-manager-548664b97c-xkq5f","source":{"component":"replicaset-controller"},"firstTimestamp":"2024-08-10T19:00:52Z","lastTimestamp":"2024-08-10T19:00:52Z","count":1,"type":"Normal","eventTime":null,"reportingComponent":"replicaset-controller","reportingInstance":"","clusterName":"","involvedObject":{"kind":"ReplicaSet","namespace":"operator-system","name":"operator-controller-manager-548664b97c","uid":"7c3cd720-83ae-4adc-9f07-ca2f92361ce0","apiVersion":"apps/v1","resourceVersion":"22265","labels":{"control-plane":"controller-manager","pod-template-hash":"548664b97c"},"annotations":{"deployment.kubernetes.io/desired-replicas":"1","deployment.kubernetes.io/max-replicas":"2","deployment.kubernetes.io/revision":"1"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"Deployment","name":"operator-controller-manager","uid":"62295ce2-239f-44cb-b5f8-189893a1bcb4","controller":true,"blockOwnerDeletion":true}],"deleted":false}}
{"metadata":{"name":"operator-controller-manager-548664b97c-xkq5f.17ea732eddadbf34","namespace":"operator-system","uid":"56d2484b-7043-4d24-89d5-b7ce30278dd8","resourceVersion":"22273","creationTimestamp":"2024-08-10T19:00:52Z"},"reason":"Scheduled","message":"Successfully assigned operator-system/operator-controller-manager-548664b97c-xkq5f to ip-192-168-13-58.ec2.internal","source":{"component":"default-scheduler"},"firstTimestamp":"2024-08-10T19:00:52Z","lastTimestamp":"2024-08-10T19:00:52Z","count":1,"type":"Normal","eventTime":null,"reportingComponent":"default-scheduler","reportingInstance":"","clusterName":"","involvedObject":{"kind":"Pod","namespace":"operator-system","name":"operator-controller-manager-548664b97c-xkq5f","uid":"a8900e7e-87ea-4900-b8d2-44d3dd974f35","apiVersion":"v1","resourceVersion":"22268","labels":{"control-plane":"controller-manager","pod-template-hash":"548664b97c"},"annotations":{"kubectl.kubernetes.io/default-container":"manager"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"operator-controller-manager-548664b97c","uid":"7c3cd720-83ae-4adc-9f07-ca2f92361ce0","controller":true,"blockOwnerDeletion":true}],"deleted":false}}
{"metadata":{"name":"operator-controller-manager-548664b97c-xkq5f.17ea732ef8b6f151","namespace":"operator-system","uid":"68769c82-b31e-43e6-a2de-5b80f8f51df4","resourceVersion":"22278","creationTimestamp":"2024-08-10T19:00:53Z"},"reason":"Pulled","message":"Container image \"gcr.io/kubebuilder/kube-rbac-proxy:v0.11.0\" already present on machine","source":{"component":"kubelet","host":"ip-192-168-13-58.ec2.internal"},"firstTimestamp":"2024-08-10T19:00:53Z","lastTimestamp":"2024-08-10T19:00:53Z","count":1,"type":"Normal","eventTime":null,"reportingComponent":"kubelet","reportingInstance":"ip-192-168-13-58.ec2.internal","clusterName":"","involvedObject":{"kind":"Pod","namespace":"operator-system","name":"operator-controller-manager-548664b97c-xkq5f","uid":"a8900e7e-87ea-4900-b8d2-44d3dd974f35","apiVersion":"v1","resourceVersion":"22271","fieldPath":"spec.containers{kube-rbac-proxy}","labels":{"control-plane":"controller-manager","pod-template-hash":"548664b97c"},"annotations":{"kubectl.kubernetes.io/default-container":"manager"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"operator-controller-manager-548664b97c","uid":"7c3cd720-83ae-4adc-9f07-ca2f92361ce0","controller":true,"blockOwnerDeletion":true}],"deleted":false}}
{"metadata":{"name":"operator-controller-manager-548664b97c-xkq5f.17ea732efa255c79","namespace":"operator-system","uid":"09986649-6c85-4668-8ce2-7fb13fbaaada","resourceVersion":"22279","creationTimestamp":"2024-08-10T19:00:53Z"},"reason":"Created","message":"Created container kube-rbac-proxy","source":{"component":"kubelet","host":"ip-192-168-13-58.ec2.internal"},"firstTimestamp":"2024-08-10T19:00:53Z","lastTimestamp":"2024-08-10T19:00:53Z","count":1,"type":"Normal","eventTime":null,"reportingComponent":"kubelet","reportingInstance":"ip-192-168-13-58.ec2.internal","clusterName":"","involvedObject":{"kind":"Pod","namespace":"operator-system","name":"operator-controller-manager-548664b97c-xkq5f","uid":"a8900e7e-87ea-4900-b8d2-44d3dd974f35","apiVersion":"v1","resourceVersion":"22271","fieldPath":"spec.containers{kube-rbac-proxy}","labels":{"control-plane":"controller-manager","pod-template-hash":"548664b97c"},"annotations":{"kubectl.kubernetes.io/default-container":"manager"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"operator-controller-manager-548664b97c","uid":"7c3cd720-83ae-4adc-9f07-ca2f92361ce0","controller":true,"blockOwnerDeletion":true}],"deleted":false}}
{"metadata":{"name":"operator-controller-manager-548664b97c-xkq5f.17ea732efd43f27c","namespace":"operator-system","uid":"e001f1e1-de47-4ad5-8517-afa653d847a9","resourceVersion":"22281","creationTimestamp":"2024-08-10T19:00:53Z"},"reason":"Started","message":"Started container kube-rbac-proxy","source":{"component":"kubelet","host":"ip-192-168-13-58.ec2.internal"},"firstTimestamp":"2024-08-10T19:00:53Z","lastTimestamp":"2024-08-10T19:00:53Z","count":1,"type":"Normal","eventTime":null,"reportingComponent":"kubelet","reportingInstance":"ip-192-168-13-58.ec2.internal","clusterName":"","involvedObject":{"kind":"Pod","namespace":"operator-system","name":"operator-controller-manager-548664b97c-xkq5f","uid":"a8900e7e-87ea-4900-b8d2-44d3dd974f35","apiVersion":"v1","resourceVersion":"22271","fieldPath":"spec.containers{kube-rbac-proxy}","labels":{"control-plane":"controller-manager","pod-template-hash":"548664b97c"},"annotations":{"kubectl.kubernetes.io/default-container":"manager"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"operator-controller-manager-548664b97c","uid":"7c3cd720-83ae-4adc-9f07-ca2f92361ce0","controller":true,"blockOwnerDeletion":true}],"deleted":false}}
{"metadata":{"name":"operator-controller-manager-548664b97c-xkq5f.17ea732efd5840ab","namespace":"operator-system","uid":"7dede363-856e-4a76-ab69-54f69a0bcbf6","resourceVersion":"22282","creationTimestamp":"2024-08-10T19:00:53Z"},"reason":"Pulling","message":"Pulling image \"ghcr.io/flux-framework/flux-operator:latest@sha256:0f61b69f36cc28d4c6c38daef6b1b96eaf9f76ca37528950380f7372f25ef973\"","source":{"component":"kubelet","host":"ip-192-168-13-58.ec2.internal"},"firstTimestamp":"2024-08-10T19:00:53Z","lastTimestamp":"2024-08-10T19:00:53Z","count":1,"type":"Normal","eventTime":null,"reportingComponent":"kubelet","reportingInstance":"ip-192-168-13-58.ec2.internal","clusterName":"","involvedObject":{"kind":"Pod","namespace":"operator-system","name":"operator-controller-manager-548664b97c-xkq5f","uid":"a8900e7e-87ea-4900-b8d2-44d3dd974f35","apiVersion":"v1","resourceVersion":"22271","fieldPath":"spec.containers{manager}","labels":{"control-plane":"controller-manager","pod-template-hash":"548664b97c"},"annotations":{"kubectl.kubernetes.io/default-container":"manager"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"operator-controller-manager-548664b97c","uid":"7c3cd720-83ae-4adc-9f07-ca2f92361ce0","controller":true,"blockOwnerDeletion":true}],"deleted":false}}
{"metadata":{"name":"operator-controller-manager-548664b97c-xkq5f.17ea732f034af857","namespace":"operator-system","uid":"c697a41e-1759-4392-a137-c04beafb90aa","resourceVersion":"22284","creationTimestamp":"2024-08-10T19:00:53Z"},"reason":"Created","message":"Created container manager","source":{"component":"kubelet","host":"ip-192-168-13-58.ec2.internal"},"firstTimestamp":"2024-08-10T19:00:53Z","lastTimestamp":"2024-08-10T19:00:53Z","count":1,"type":"Normal","eventTime":null,"reportingComponent":"kubelet","reportingInstance":"ip-192-168-13-58.ec2.internal","clusterName":"","involvedObject":{"kind":"Pod","namespace":"operator-system","name":"operator-controller-manager-548664b97c-xkq5f","uid":"a8900e7e-87ea-4900-b8d2-44d3dd974f35","apiVersion":"v1","resourceVersion":"22271","fieldPath":"spec.containers{manager}","labels":{"control-plane":"controller-manager","pod-template-hash":"548664b97c"},"annotations":{"kubectl.kubernetes.io/default-container":"manager"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"operator-controller-manager-548664b97c","uid":"7c3cd720-83ae-4adc-9f07-ca2f92361ce0","controller":true,"blockOwnerDeletion":true}],"deleted":false}}
{"metadata":{"name":"operator-controller-manager-548664b97c-xkq5f.17ea732f0229983f","namespace":"operator-system","uid":"5c197235-fa45-4bf4-8546-946598ac9cac","resourceVersion":"22283","creationTimestamp":"2024-08-10T19:00:53Z"},"reason":"Pulled","message":"Successfully pulled image \"ghcr.io/flux-framework/flux-operator:latest@sha256:0f61b69f36cc28d4c6c38daef6b1b96eaf9f76ca37528950380f7372f25ef973\" in 80ms (80ms including waiting). Image size: 134008941 bytes.","source":{"component":"kubelet","host":"ip-192-168-13-58.ec2.internal"},"firstTimestamp":"2024-08-10T19:00:53Z","lastTimestamp":"2024-08-10T19:00:53Z","count":1,"type":"Normal","eventTime":null,"reportingComponent":"kubelet","reportingInstance":"ip-192-168-13-58.ec2.internal","clusterName":"","involvedObject":{"kind":"Pod","namespace":"operator-system","name":"operator-controller-manager-548664b97c-xkq5f","uid":"a8900e7e-87ea-4900-b8d2-44d3dd974f35","apiVersion":"v1","resourceVersion":"22271","fieldPath":"spec.containers{manager}","labels":{"control-plane":"controller-manager","pod-template-hash":"548664b97c"},"annotations":{"kubectl.kubernetes.io/default-container":"manager"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"operator-controller-manager-548664b97c","uid":"7c3cd720-83ae-4adc-9f07-ca2f92361ce0","controller":true,"blockOwnerDeletion":true}],"deleted":false}}
{"metadata":{"name":"operator-controller-manager-548664b97c-xkq5f.17ea732f08947c07","namespace":"operator-system","uid":"8368ac85-9218-49d0-8d96-ca0107d44e3a","resourceVersion":"22285","creationTimestamp":"2024-08-10T19:00:53Z"},"reason":"Started","message":"Started container manager","source":{"component":"kubelet","host":"ip-192-168-13-58.ec2.internal"},"firstTimestamp":"2024-08-10T19:00:53Z","lastTimestamp":"2024-08-10T19:00:53Z","count":1,"type":"Normal","eventTime":null,"reportingComponent":"kubelet","reportingInstance":"ip-192-168-13-58.ec2.internal","clusterName":"","involvedObject":{"kind":"Pod","namespace":"operator-system","name":"operator-controller-manager-548664b97c-xkq5f","uid":"a8900e7e-87ea-4900-b8d2-44d3dd974f35","apiVersion":"v1","resourceVersion":"22271","fieldPath":"spec.containers{manager}","labels":{"control-plane":"controller-manager","pod-template-hash":"548664b97c"},"annotations":{"kubectl.kubernetes.io/default-container":"manager"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"operator-controller-manager-548664b97c","uid":"7c3cd720-83ae-4adc-9f07-ca2f92361ce0","controller":true,"blockOwnerDeletion":true}],"deleted":false}}
{"metadata":{"name":"14dde902.flux-framework.org.17ea732f0bf42535","namespace":"operator-system","uid":"80d2d025-0338-4160-aaa3-83a35714511e","resourceVersion":"22287","creationTimestamp":"2024-08-10T19:00:53Z"},"reason":"LeaderElection","message":"operator-controller-manager-548664b97c-xkq5f_3326b0e1-8e83-477d-8784-c7b00c16adc2 became leader","source":{"component":"operator-controller-manager-548664b97c-xkq5f_3326b0e1-8e83-477d-8784-c7b00c16adc2"},"firstTimestamp":"2024-08-10T19:00:53Z","lastTimestamp":"2024-08-10T19:00:53Z","count":1,"type":"Normal","eventTime":null,"reportingComponent":"","reportingInstance":"","clusterName":"","involvedObject":{"kind":"Lease","namespace":"operator-system","name":"14dde902.flux-framework.org","uid":"08bef3cc-9e4b-4151-98d3-d6829e5510f4","apiVersion":"coordination.k8s.io/v1","resourceVersion":"22286","deleted":false}}
{"metadata":{"name":"flux-sample.17ea733e047d0f21","namespace":"default","uid":"88a313cc-f174-4446-91f4-8133da7a143f","resourceVersion":"22508","creationTimestamp":"2024-08-10T19:01:57Z"},"reason":"SuccessfulCreate","message":"Created pod: flux-sample-0-k7d8m","source":{"component":"job-controller"},"firstTimestamp":"2024-08-10T19:01:57Z","lastTimestamp":"2024-08-10T19:01:57Z","count":1,"type":"Normal","eventTime":null,"reportingComponent":"job-controller","reportingInstance":"","clusterName":"","involvedObject":{"kind":"Job","namespace":"default","name":"flux-sample","uid":"f2ab7b8d-41b1-4ab8-908f-2a0b09a4a318","apiVersion":"batch/v1","resourceVersion":"22502","labels":{"app.kubernetes.io/name":"flux-sample","batch.kubernetes.io/controller-uid":"f2ab7b8d-41b1-4ab8-908f-2a0b09a4a318","batch.kubernetes.io/job-name":"flux-sample","controller-uid":"f2ab7b8d-41b1-4ab8-908f-2a0b09a4a318","hpa-selector":"flux-sample","job-name":"flux-sample","namespace":"default"},"ownerReferences":[{"apiVersion":"flux-framework.org/v1alpha2","kind":"MiniCluster","name":"flux-sample","uid":"16e2ba84-d177-49d7-8f02-e80d22aa94de","controller":true,"blockOwnerDeletion":true}],"deleted":false}}
{"metadata":{"name":"flux-sample-0-k7d8m.17ea733e04aef4b1","namespace":"default","uid":"cd46ac70-32c5-441a-a8f0-faae350f262b","resourceVersion":"22509","creationTimestamp":"2024-08-10T19:01:57Z"},"reason":"FailedScheduling","message":"0/2 nodes are available: 2 Insufficient vpc.amazonaws.com/efa. preemption: 0/2 nodes are available: 2 No preemption victims found for incoming pod.","source":{"component":"default-scheduler"},"firstTimestamp":"2024-08-10T19:01:57Z","lastTimestamp":"2024-08-10T19:01:57Z","count":1,"type":"Warning","eventTime":null,"reportingComponent":"default-scheduler","reportingInstance":"","clusterName":"","involvedObject":{"kind":"Pod","namespace":"default","name":"flux-sample-0-k7d8m","uid":"dfe23086-de36-42cb-ac45-ca82d04a1325","apiVersion":"v1","resourceVersion":"22506","labels":{"app.kubernetes.io/name":"flux-sample","batch.kubernetes.io/controller-uid":"f2ab7b8d-41b1-4ab8-908f-2a0b09a4a318","batch.kubernetes.io/job-completion-index":"0","batch.kubernetes.io/job-name":"flux-sample","controller-uid":"f2ab7b8d-41b1-4ab8-908f-2a0b09a4a318","hpa-selector":"flux-sample","job-name":"flux-sample","namespace":"default"},"annotations":{"batch.kubernetes.io/job-completion-index":"0"},"ownerReferences":[{"apiVersion":"batch/v1","kind":"Job","name":"flux-sample","uid":"f2ab7b8d-41b1-4ab8-908f-2a0b09a4a318","controller":true,"blockOwnerDeletion":true}],"deleted":false}}
{"metadata":{"name":"flux-sample.17ea733e06671c0b","namespace":"default","uid":"ebf3980f-235d-414e-bb99-b801ec593739","resourceVersion":"22513","creationTimestamp":"2024-08-10T19:01:57Z"},"reason":"SuccessfulCreate","message":"Created pod: flux-sample-2-rl576","source":{"component":"job-controller"},"firstTimestamp":"2024-08-10T19:01:57Z","lastTimestamp":"2024-08-10T19:01:57Z","count":1,"type":"Normal","eventTime":null,"reportingComponent":"job-controller","reportingInstance":"","clusterName":"","involvedObject":{"kind":"Job","namespace":"default","name":"flux-sample","uid":"f2ab7b8d-41b1-4ab8-908f-2a0b09a4a318","apiVersion":"batch/v1","resourceVersion":"22502","labels":{"app.kubernetes.io/name":"flux-sample","batch.kubernetes.io/controller-uid":"f2ab7b8d-41b1-4ab8-908f-2a0b09a4a318","batch.kubernetes.io/job-name":"flux-sample","controller-uid":"f2ab7b8d-41b1-4ab8-908f-2a0b09a4a318","hpa-selector":"flux-sample","job-name":"flux-sample","namespace":"default"},"ownerReferences":[{"apiVersion":"flux-framework.org/v1alpha2","kind":"MiniCluster","name":"flux-sample","uid":"16e2ba84-d177-49d7-8f02-e80d22aa94de","controller":true,"blockOwnerDeletion":true}],"deleted":false}}
{"metadata":{"name":"flux-sample.17ea733e066b5383","namespace":"default","uid":"63ec7522-e664-4403-810c-8c30fb64e1ee","resourceVersion":"22516","creationTimestamp":"2024-08-10T19:01:57Z"},"reason":"SuccessfulCreate","message":"Created pod: flux-sample-1-q7xdc","source":{"component":"job-controller"},"firstTimestamp":"2024-08-10T19:01:57Z","lastTimestamp":"2024-08-10T19:01:57Z","count":1,"type":"Normal","eventTime":null,"reportingComponent":"job-controller","reportingInstance":"","clusterName":"","involvedObject":{"kind":"Job","namespace":"default","name":"flux-sample","uid":"f2ab7b8d-41b1-4ab8-908f-2a0b09a4a318","apiVersion":"batch/v1","resourceVersion":"22502","labels":{"app.kubernetes.io/name":"flux-sample","batch.kubernetes.io/controller-uid":"f2ab7b8d-41b1-4ab8-908f-2a0b09a4a318","batch.kubernetes.io/job-name":"flux-sample","controller-uid":"f2ab7b8d-41b1-4ab8-908f-2a0b09a4a318","hpa-selector":"flux-sample","job-name":"flux-sample","namespace":"default"},"ownerReferences":[{"apiVersion":"flux-framework.org/v1alpha2","kind":"MiniCluster","name":"flux-sample","uid":"16e2ba84-d177-49d7-8f02-e80d22aa94de","controller":true,"blockOwnerDeletion":true}],"deleted":false}}
{"metadata":{"name":"flux-sample-2-rl576.17ea733e063fd7f2","namespace":"default","uid":"613f2224-476f-4255-8582-5902314940f0","resourceVersion":"22517","creationTimestamp":"2024-08-10T19:01:57Z"},"reason":"FailedScheduling","message":"0/2 nodes are available: 2 Insufficient vpc.amazonaws.com/efa. preemption: 0/2 nodes are available: 2 No preemption victims found for incoming pod.","source":{"component":"default-scheduler"},"firstTimestamp":"2024-08-10T19:01:57Z","lastTimestamp":"2024-08-10T19:01:57Z","count":1,"type":"Warning","eventTime":null,"reportingComponent":"default-scheduler","reportingInstance":"","clusterName":"","involvedObject":{"kind":"Pod","namespace":"default","name":"flux-sample-2-rl576","uid":"be8fb510-69e2-4676-a525-449d214d2bf1","apiVersion":"v1","resourceVersion":"22511","labels":{"app.kubernetes.io/name":"flux-sample","batch.kubernetes.io/controller-uid":"f2ab7b8d-41b1-4ab8-908f-2a0b09a4a318","batch.kubernetes.io/job-completion-index":"2","batch.kubernetes.io/job-name":"flux-sample","controller-uid":"f2ab7b8d-41b1-4ab8-908f-2a0b09a4a318","hpa-selector":"flux-sample","job-name":"flux-sample","namespace":"default"},"annotations":{"batch.kubernetes.io/job-completion-index":"2"},"ownerReferences":[{"apiVersion":"batch/v1","kind":"Job","name":"flux-sample","uid":"f2ab7b8d-41b1-4ab8-908f-2a0b09a4a318","controller":true,"blockOwnerDeletion":true}],"deleted":false}}
{"metadata":{"name":"flux-sample.17ea733e0752e57f","namespace":"default","uid":"240d3471-71df-4690-90fd-d4fde45756d3","resourceVersion":"22521","creationTimestamp":"2024-08-10T19:01:57Z"},"reason":"SuccessfulCreate","message":"Created pod: flux-sample-3-977hg","source":{"component":"job-controller"},"firstTimestamp":"2024-08-10T19:01:57Z","lastTimestamp":"2024-08-10T19:01:57Z","count":1,"type":"Normal","eventTime":null,"reportingComponent":"job-controller","reportingInstance":"","clusterName":"","involvedObject":{"kind":"Job","namespace":"default","name":"flux-sample","uid":"f2ab7b8d-41b1-4ab8-908f-2a0b09a4a318","apiVersion":"batch/v1","resourceVersion":"22502","labels":{"app.kubernetes.io/name":"flux-sample","batch.kubernetes.io/controller-uid":"f2ab7b8d-41b1-4ab8-908f-2a0b09a4a318","batch.kubernetes.io/job-name":"flux-sample","controller-uid":"f2ab7b8d-41b1-4ab8-908f-2a0b09a4a318","hpa-selector":"flux-sample","job-name":"flux-sample","namespace":"default"},"ownerReferences":[{"apiVersion":"flux-framework.org/v1alpha2","kind":"MiniCluster","name":"flux-sample","uid":"16e2ba84-d177-49d7-8f02-e80d22aa94de","controller":true,"blockOwnerDeletion":true}],"deleted":false}}
{"metadata":{"name":"flux-sample-1-q7xdc.17ea733e077d08da","namespace":"default","uid":"a0cd87b8-e31e-4d4e-8f0a-1160681d4c05","resourceVersion":"22520","creationTimestamp":"2024-08-10T19:01:57Z"},"reason":"FailedScheduling","message":"0/2 nodes are available: 2 Insufficient vpc.amazonaws.com/efa. preemption: 0/2 nodes are available: 2 No preemption victims found for incoming pod.","source":{"component":"default-scheduler"},"firstTimestamp":"2024-08-10T19:01:57Z","lastTimestamp":"2024-08-10T19:01:57Z","count":1,"type":"Warning","eventTime":null,"reportingComponent":"default-scheduler","reportingInstance":"","clusterName":"","involvedObject":{"kind":"Pod","namespace":"default","name":"flux-sample-1-q7xdc","uid":"63ae53f4-e340-4164-88e0-304658001b7d","apiVersion":"v1","resourceVersion":"22512","labels":{"app.kubernetes.io/name":"flux-sample","batch.kubernetes.io/controller-uid":"f2ab7b8d-41b1-4ab8-908f-2a0b09a4a318","batch.kubernetes.io/job-completion-index":"1","batch.kubernetes.io/job-name":"flux-sample","controller-uid":"f2ab7b8d-41b1-4ab8-908f-2a0b09a4a318","hpa-selector":"flux-sample","job-name":"flux-sample","namespace":"default"},"annotations":{"batch.kubernetes.io/job-completion-index":"1"},"ownerReferences":[{"apiVersion":"batch/v1","kind":"Job","name":"flux-sample","uid":"f2ab7b8d-41b1-4ab8-908f-2a0b09a4a318","controller":true,"blockOwnerDeletion":true}],"deleted":false}}
{"metadata":{"name":"flux-sample-3-977hg.17ea733e0876f66e","namespace":"default","uid":"05b2850c-35aa-4ca4-b9fc-ab3c22373260","resourceVersion":"22524","creationTimestamp":"2024-08-10T19:01:57Z"},"reason":"FailedScheduling","message":"0/2 nodes are available: 2 Insufficient vpc.amazonaws.com/efa. preemption: 0/2 nodes are available: 2 No preemption victims found for incoming pod.","source":{"component":"default-scheduler"},"firstTimestamp":"2024-08-10T19:01:57Z","lastTimestamp":"2024-08-10T19:01:57Z","count":1,"type":"Warning","eventTime":null,"reportingComponent":"default-scheduler","reportingInstance":"","clusterName":"","involvedObject":{"kind":"Pod","namespace":"default","name":"flux-sample-3-977hg","uid":"704f55a7-fd29-4620-9d35-19bbb03147ff","apiVersion":"v1","resourceVersion":"22515","labels":{"app.kubernetes.io/name":"flux-sample","batch.kubernetes.io/controller-uid":"f2ab7b8d-41b1-4ab8-908f-2a0b09a4a318","batch.kubernetes.io/job-completion-index":"3","batch.kubernetes.io/job-name":"flux-sample","controller-uid":"f2ab7b8d-41b1-4ab8-908f-2a0b09a4a318","hpa-selector":"flux-sample","job-name":"flux-sample","namespace":"default"},"annotations":{"batch.kubernetes.io/job-completion-index":"3"},"ownerReferences":[{"apiVersion":"batch/v1","kind":"Job","name":"flux-sample","uid":"f2ab7b8d-41b1-4ab8-908f-2a0b09a4a318","controller":true,"blockOwnerDeletion":true}],"deleted":false}}
{"metadata":{"name":"flux-sample-3-977hg.17ea7341ec07d4e3","namespace":"default","uid":"b20cd209-e128-4371-aef7-47c07307ab8d","resourceVersion":"22600","creationTimestamp":"2024-08-10T19:02:14Z"},"reason":"FailedScheduling","message":"skip schedule deleting pod: default/flux-sample-3-977hg","source":{"component":"default-scheduler"},"firstTimestamp":"2024-08-10T19:02:14Z","lastTimestamp":"2024-08-10T19:02:14Z","count":1,"type":"Warning","eventTime":null,"reportingComponent":"default-scheduler","reportingInstance":"","clusterName":"","involvedObject":{"kind":"Pod","namespace":"default","name":"flux-sample-3-977hg","uid":"704f55a7-fd29-4620-9d35-19bbb03147ff","apiVersion":"v1","resourceVersion":"22596","deleted":true}}
{"level":"error","error":"pods \"flux-sample-3-977hg\" not found","time":"2024-08-10T19:02:14Z","message":"Object not found, likely deleted"}
{"metadata":{"name":"flux-sample-0-k7d8m.17ea7341ec2b173b","namespace":"default","uid":"5e2e1a75-4d2e-4622-88a9-b413d2d1e4e5","resourceVersion":"22602","creationTimestamp":"2024-08-10T19:02:14Z"},"reason":"FailedScheduling","message":"skip schedule deleting pod: default/flux-sample-0-k7d8m","source":{"component":"default-scheduler"},"firstTimestamp":"2024-08-10T19:02:14Z","lastTimestamp":"2024-08-10T19:02:14Z","count":1,"type":"Warning","eventTime":null,"reportingComponent":"default-scheduler","reportingInstance":"","clusterName":"","involvedObject":{"kind":"Pod","namespace":"default","name":"flux-sample-0-k7d8m","uid":"dfe23086-de36-42cb-ac45-ca82d04a1325","apiVersion":"v1","resourceVersion":"22597","labels":{"app.kubernetes.io/name":"flux-sample","batch.kubernetes.io/controller-uid":"f2ab7b8d-41b1-4ab8-908f-2a0b09a4a318","batch.kubernetes.io/job-completion-index":"0","batch.kubernetes.io/job-name":"flux-sample","controller-uid":"f2ab7b8d-41b1-4ab8-908f-2a0b09a4a318","hpa-selector":"flux-sample","job-index":"0","job-name":"flux-sample","namespace":"default"},"annotations":{"batch.kubernetes.io/job-completion-index":"0"},"ownerReferences":[{"apiVersion":"batch/v1","kind":"Job","name":"flux-sample","uid":"f2ab7b8d-41b1-4ab8-908f-2a0b09a4a318","controller":true,"blockOwnerDeletion":true}],"deleted":true}}
{"metadata":{"name":"flux-sample-2-rl576.17ea7341ec9029ad","namespace":"default","uid":"5a322528-92e1-4cb5-b947-4342f6788b69","resourceVersion":"22604","creationTimestamp":"2024-08-10T19:02:14Z"},"reason":"FailedScheduling","message":"skip schedule deleting pod: default/flux-sample-2-rl576","source":{"component":"default-scheduler"},"firstTimestamp":"2024-08-10T19:02:14Z","lastTimestamp":"2024-08-10T19:02:14Z","count":1,"type":"Warning","eventTime":null,"reportingComponent":"default-scheduler","reportingInstance":"","clusterName":"","involvedObject":{"kind":"Pod","namespace":"default","name":"flux-sample-2-rl576","uid":"be8fb510-69e2-4676-a525-449d214d2bf1","apiVersion":"v1","resourceVersion":"22598","labels":{"app.kubernetes.io/name":"flux-sample","batch.kubernetes.io/controller-uid":"f2ab7b8d-41b1-4ab8-908f-2a0b09a4a318","batch.kubernetes.io/job-completion-index":"2","batch.kubernetes.io/job-name":"flux-sample","controller-uid":"f2ab7b8d-41b1-4ab8-908f-2a0b09a4a318","hpa-selector":"flux-sample","job-index":"2","job-name":"flux-sample","namespace":"default"},"annotations":{"batch.kubernetes.io/job-completion-index":"2"},"ownerReferences":[{"apiVersion":"batch/v1","kind":"Job","name":"flux-sample","uid":"f2ab7b8d-41b1-4ab8-908f-2a0b09a4a318","controller":true,"blockOwnerDeletion":true}],"deleted":true}}
{"metadata":{"name":"flux-sample-1-q7xdc.17ea7341ec906bf6","namespace":"default","uid":"a8f631ba-dc42-40bb-821d-2fc55661fb87","resourceVersion":"22605","creationTimestamp":"2024-08-10T19:02:14Z"},"reason":"FailedScheduling","message":"skip schedule deleting pod: default/flux-sample-1-q7xdc","source":{"component":"default-scheduler"},"firstTimestamp":"2024-08-10T19:02:14Z","lastTimestamp":"2024-08-10T19:02:14Z","count":1,"type":"Warning","eventTime":null,"reportingComponent":"default-scheduler","reportingInstance":"","clusterName":"","involvedObject":{"kind":"Pod","namespace":"default","name":"flux-sample-1-q7xdc","uid":"63ae53f4-e340-4164-88e0-304658001b7d","apiVersion":"v1","resourceVersion":"22599","deleted":true}}
{"level":"error","error":"pods \"flux-sample-1-q7xdc\" not found","time":"2024-08-10T19:02:14Z","message":"Object not found, likely deleted"}
{"metadata":{"name":"flux-sample.17ea734635f042da","namespace":"default","uid":"c583516e-8361-4f85-bc52-df49e1ca18ea","resourceVersion":"22676","creationTimestamp":"2024-08-10T19:02:32Z"},"reason":"SuccessfulCreate","message":"Created pod: flux-sample-0-dc6dr","source":{"component":"job-controller"},"firstTimestamp":"2024-08-10T19:02:32Z","lastTimestamp":"2024-08-10T19:02:32Z","count":1,"type":"Normal","eventTime":null,"reportingComponent":"job-controller","reportingInstance":"","clusterName":"","involvedObject":{"kind":"Job","namespace":"default","name":"flux-sample","uid":"7b5908be-3d77-4d51-a1e5-a70bb0eefb0e","apiVersion":"batch/v1","resourceVersion":"22669","labels":{"app.kubernetes.io/name":"flux-sample","batch.kubernetes.io/controller-uid":"7b5908be-3d77-4d51-a1e5-a70bb0eefb0e","batch.kubernetes.io/job-name":"flux-sample","controller-uid":"7b5908be-3d77-4d51-a1e5-a70bb0eefb0e","hpa-selector":"flux-sample","job-name":"flux-sample","namespace":"default"},"ownerReferences":[{"apiVersion":"flux-framework.org/v1alpha2","kind":"MiniCluster","name":"flux-sample","uid":"dcfdbef2-cd2a-4af9-9f2a-5566194bc6fa","controller":true,"blockOwnerDeletion":true}],"deleted":false}}
{"metadata":{"name":"flux-sample-0-dc6dr.17ea73463660e1d2","namespace":"default","uid":"d776742f-4674-4984-aa48-52917df856c7","resourceVersion":"22678","creationTimestamp":"2024-08-10T19:02:32Z"},"reason":"Scheduled","message":"Successfully assigned default/flux-sample-0-dc6dr to ip-192-168-13-58.ec2.internal","source":{"component":"default-scheduler"},"firstTimestamp":"2024-08-10T19:02:32Z","lastTimestamp":"2024-08-10T19:02:32Z","count":1,"type":"Normal","eventTime":null,"reportingComponent":"default-scheduler","reportingInstance":"","clusterName":"","involvedObject":{"kind":"Pod","namespace":"default","name":"flux-sample-0-dc6dr","uid":"3d9534a0-1f15-491e-a469-cba9cf2f3f29","apiVersion":"v1","resourceVersion":"22673","labels":{"app.kubernetes.io/name":"flux-sample","batch.kubernetes.io/controller-uid":"7b5908be-3d77-4d51-a1e5-a70bb0eefb0e","batch.kubernetes.io/job-completion-index":"0","batch.kubernetes.io/job-name":"flux-sample","controller-uid":"7b5908be-3d77-4d51-a1e5-a70bb0eefb0e","hpa-selector":"flux-sample","job-index":"0","job-name":"flux-sample","namespace":"default"},"annotations":{"batch.kubernetes.io/job-completion-index":"0"},"ownerReferences":[{"apiVersion":"batch/v1","kind":"Job","name":"flux-sample","uid":"7b5908be-3d77-4d51-a1e5-a70bb0eefb0e","controller":true,"blockOwnerDeletion":true}],"deleted":false}}
{"metadata":{"name":"flux-sample.17ea734636c6d0f9","namespace":"default","uid":"a8482081-314e-47c4-b7c8-23adbbf8a925","resourceVersion":"22682","creationTimestamp":"2024-08-10T19:02:32Z"},"reason":"SuccessfulCreate","message":"Created pod: flux-sample-1-ghl62","source":{"component":"job-controller"},"firstTimestamp":"2024-08-10T19:02:32Z","lastTimestamp":"2024-08-10T19:02:32Z","count":1,"type":"Normal","eventTime":null,"reportingComponent":"job-controller","reportingInstance":"","clusterName":"","involvedObject":{"kind":"Job","namespace":"default","name":"flux-sample","uid":"7b5908be-3d77-4d51-a1e5-a70bb0eefb0e","apiVersion":"batch/v1","resourceVersion":"22669","labels":{"app.kubernetes.io/name":"flux-sample","batch.kubernetes.io/controller-uid":"7b5908be-3d77-4d51-a1e5-a70bb0eefb0e","batch.kubernetes.io/job-name":"flux-sample","controller-uid":"7b5908be-3d77-4d51-a1e5-a70bb0eefb0e","hpa-selector":"flux-sample","job-name":"flux-sample","namespace":"default"},"ownerReferences":[{"apiVersion":"flux-framework.org/v1alpha2","kind":"MiniCluster","name":"flux-sample","uid":"dcfdbef2-cd2a-4af9-9f2a-5566194bc6fa","controller":true,"blockOwnerDeletion":true}],"deleted":false}}
{"metadata":{"name":"flux-sample-1-ghl62.17ea734637231950","namespace":"default","uid":"ec0d5a86-76ec-4dc4-9de4-d377fc0dd5a5","resourceVersion":"22683","creationTimestamp":"2024-08-10T19:02:32Z"},"reason":"Scheduled","message":"Successfully assigned default/flux-sample-1-ghl62 to ip-192-168-48-119.ec2.internal","source":{"component":"default-scheduler"},"firstTimestamp":"2024-08-10T19:02:32Z","lastTimestamp":"2024-08-10T19:02:32Z","count":1,"type":"Normal","eventTime":null,"reportingComponent":"default-scheduler","reportingInstance":"","clusterName":"","involvedObject":{"kind":"Pod","namespace":"default","name":"flux-sample-1-ghl62","uid":"17ea70af-4c56-415a-9cb8-78184e183760","apiVersion":"v1","resourceVersion":"22677","labels":{"app.kubernetes.io/name":"flux-sample","batch.kubernetes.io/controller-uid":"7b5908be-3d77-4d51-a1e5-a70bb0eefb0e","batch.kubernetes.io/job-completion-index":"1","batch.kubernetes.io/job-name":"flux-sample","controller-uid":"7b5908be-3d77-4d51-a1e5-a70bb0eefb0e","hpa-selector":"flux-sample","job-index":"1","job-name":"flux-sample","namespace":"default"},"annotations":{"batch.kubernetes.io/job-completion-index":"1"},"ownerReferences":[{"apiVersion":"batch/v1","kind":"Job","name":"flux-sample","uid":"7b5908be-3d77-4d51-a1e5-a70bb0eefb0e","controller":true,"blockOwnerDeletion":true}],"deleted":false}}
{"metadata":{"name":"flux-sample-0-dc6dr.17ea734651e026bf","namespace":"default","uid":"168ef8f1-48a6-40f8-b156-01a376082b4b","resourceVersion":"22688","creationTimestamp":"2024-08-10T19:02:33Z"},"reason":"Pulling","message":"Pulling image \"ghcr.io/converged-computing/flux-view-rocky:tag-9\"","source":{"component":"kubelet","host":"ip-192-168-13-58.ec2.internal"},"firstTimestamp":"2024-08-10T19:02:33Z","lastTimestamp":"2024-08-10T19:02:33Z","count":1,"type":"Normal","eventTime":null,"reportingComponent":"kubelet","reportingInstance":"ip-192-168-13-58.ec2.internal","clusterName":"","involvedObject":{"kind":"Pod","namespace":"default","name":"flux-sample-0-dc6dr","uid":"3d9534a0-1f15-491e-a469-cba9cf2f3f29","apiVersion":"v1","resourceVersion":"22675","fieldPath":"spec.initContainers{flux-view}","labels":{"app.kubernetes.io/name":"flux-sample","batch.kubernetes.io/controller-uid":"7b5908be-3d77-4d51-a1e5-a70bb0eefb0e","batch.kubernetes.io/job-completion-index":"0","batch.kubernetes.io/job-name":"flux-sample","controller-uid":"7b5908be-3d77-4d51-a1e5-a70bb0eefb0e","hpa-selector":"flux-sample","job-index":"0","job-name":"flux-sample","namespace":"default"},"annotations":{"batch.kubernetes.io/job-completion-index":"0"},"ownerReferences":[{"apiVersion":"batch/v1","kind":"Job","name":"flux-sample","uid":"7b5908be-3d77-4d51-a1e5-a70bb0eefb0e","controller":true,"blockOwnerDeletion":true}],"deleted":false}}
{"metadata":{"name":"flux-sample-1-ghl62.17ea734652f11d4a","namespace":"default","uid":"f7f33434-228d-4766-bbb2-88f502742734","resourceVersion":"22689","creationTimestamp":"2024-08-10T19:02:33Z"},"reason":"Pulling","message":"Pulling image \"ghcr.io/converged-computing/flux-view-rocky:tag-9\"","source":{"component":"kubelet","host":"ip-192-168-48-119.ec2.internal"},"firstTimestamp":"2024-08-10T19:02:33Z","lastTimestamp":"2024-08-10T19:02:33Z","count":1,"type":"Normal","eventTime":null,"reportingComponent":"kubelet","reportingInstance":"ip-192-168-48-119.ec2.internal","clusterName":"","involvedObject":{"kind":"Pod","namespace":"default","name":"flux-sample-1-ghl62","uid":"17ea70af-4c56-415a-9cb8-78184e183760","apiVersion":"v1","resourceVersion":"22679","fieldPath":"spec.initContainers{flux-view}","labels":{"app.kubernetes.io/name":"flux-sample","batch.kubernetes.io/controller-uid":"7b5908be-3d77-4d51-a1e5-a70bb0eefb0e","batch.kubernetes.io/job-completion-index":"1","batch.kubernetes.io/job-name":"flux-sample","controller-uid":"7b5908be-3d77-4d51-a1e5-a70bb0eefb0e","hpa-selector":"flux-sample","job-index":"1","job-name":"flux-sample","namespace":"default"},"annotations":{"batch.kubernetes.io/job-completion-index":"1"},"ownerReferences":[{"apiVersion":"batch/v1","kind":"Job","name":"flux-sample","uid":"7b5908be-3d77-4d51-a1e5-a70bb0eefb0e","controller":true,"blockOwnerDeletion":true}],"deleted":false}}
{"metadata":{"name":"flux-sample-0-dc6dr.17ea734a90891263","namespace":"default","uid":"dbbf4d4b-9566-4a2b-b00b-6d7bbc85d75a","resourceVersion":"22750","creationTimestamp":"2024-08-10T19:02:51Z"},"reason":"Pulled","message":"Successfully pulled image \"ghcr.io/converged-computing/flux-view-rocky:tag-9\" in 18.231s (18.231s including waiting). Image size: 234951572 bytes.","source":{"component":"kubelet","host":"ip-192-168-13-58.ec2.internal"},"firstTimestamp":"2024-08-10T19:02:51Z","lastTimestamp":"2024-08-10T19:02:51Z","count":1,"type":"Normal","eventTime":null,"reportingComponent":"kubelet","reportingInstance":"ip-192-168-13-58.ec2.internal","clusterName":"","involvedObject":{"kind":"Pod","namespace":"default","name":"flux-sample-0-dc6dr","uid":"3d9534a0-1f15-491e-a469-cba9cf2f3f29","apiVersion":"v1","resourceVersion":"22675","fieldPath":"spec.initContainers{flux-view}","labels":{"app.kubernetes.io/name":"flux-sample","batch.kubernetes.io/controller-uid":"7b5908be-3d77-4d51-a1e5-a70bb0eefb0e","batch.kubernetes.io/job-completion-index":"0","batch.kubernetes.io/job-name":"flux-sample","controller-uid":"7b5908be-3d77-4d51-a1e5-a70bb0eefb0e","hpa-selector":"flux-sample","job-index":"0","job-name":"flux-sample","namespace":"default"},"annotations":{"batch.kubernetes.io/job-completion-index":"0"},"ownerReferences":[{"apiVersion":"batch/v1","kind":"Job","name":"flux-sample","uid":"7b5908be-3d77-4d51-a1e5-a70bb0eefb0e","controller":true,"blockOwnerDeletion":true}],"deleted":false}}
{"metadata":{"name":"flux-sample-0-dc6dr.17ea734a9199a3e5","namespace":"default","uid":"96c9981c-e901-424b-84cc-a1e368ab5463","resourceVersion":"22751","creationTimestamp":"2024-08-10T19:02:51Z"},"reason":"Created","message":"Created container flux-view","source":{"component":"kubelet","host":"ip-192-168-13-58.ec2.internal"},"firstTimestamp":"2024-08-10T19:02:51Z","lastTimestamp":"2024-08-10T19:02:51Z","count":1,"type":"Normal","eventTime":null,"reportingComponent":"kubelet","reportingInstance":"ip-192-168-13-58.ec2.internal","clusterName":"","involvedObject":{"kind":"Pod","namespace":"default","name":"flux-sample-0-dc6dr","uid":"3d9534a0-1f15-491e-a469-cba9cf2f3f29","apiVersion":"v1","resourceVersion":"22675","fieldPath":"spec.initContainers{flux-view}","labels":{"app.kubernetes.io/name":"flux-sample","batch.kubernetes.io/controller-uid":"7b5908be-3d77-4d51-a1e5-a70bb0eefb0e","batch.kubernetes.io/job-completion-index":"0","batch.kubernetes.io/job-name":"flux-sample","controller-uid":"7b5908be-3d77-4d51-a1e5-a70bb0eefb0e","hpa-selector":"flux-sample","job-index":"0","job-name":"flux-sample","namespace":"default"},"annotations":{"batch.kubernetes.io/job-completion-index":"0"},"ownerReferences":[{"apiVersion":"batch/v1","kind":"Job","name":"flux-sample","uid":"7b5908be-3d77-4d51-a1e5-a70bb0eefb0e","controller":true,"blockOwnerDeletion":true}],"deleted":false}}
{"metadata":{"name":"flux-sample-0-dc6dr.17ea734a94f3049f","namespace":"default","uid":"169b2ec0-2f89-4209-b4cc-2c4f542b3b61","resourceVersion":"22752","creationTimestamp":"2024-08-10T19:02:51Z"},"reason":"Started","message":"Started container flux-view","source":{"component":"kubelet","host":"ip-192-168-13-58.ec2.internal"},"firstTimestamp":"2024-08-10T19:02:51Z","lastTimestamp":"2024-08-10T19:02:51Z","count":1,"type":"Normal","eventTime":null,"reportingComponent":"kubelet","reportingInstance":"ip-192-168-13-58.ec2.internal","clusterName":"","involvedObject":{"kind":"Pod","namespace":"default","name":"flux-sample-0-dc6dr","uid":"3d9534a0-1f15-491e-a469-cba9cf2f3f29","apiVersion":"v1","resourceVersion":"22675","fieldPath":"spec.initContainers{flux-view}","labels":{"app.kubernetes.io/name":"flux-sample","batch.kubernetes.io/controller-uid":"7b5908be-3d77-4d51-a1e5-a70bb0eefb0e","batch.kubernetes.io/job-completion-index":"0","batch.kubernetes.io/job-name":"flux-sample","controller-uid":"7b5908be-3d77-4d51-a1e5-a70bb0eefb0e","hpa-selector":"flux-sample","job-index":"0","job-name":"flux-sample","namespace":"default"},"annotations":{"batch.kubernetes.io/job-completion-index":"0"},"ownerReferences":[{"apiVersion":"batch/v1","kind":"Job","name":"flux-sample","uid":"7b5908be-3d77-4d51-a1e5-a70bb0eefb0e","controller":true,"blockOwnerDeletion":true}],"deleted":false}}
{"metadata":{"name":"flux-sample-1-ghl62.17ea734aaaa72363","namespace":"default","uid":"938a47a8-cc7a-48a2-92ba-079ee729bd95","resourceVersion":"22755","creationTimestamp":"2024-08-10T19:02:51Z"},"reason":"Pulled","message":"Successfully pulled image \"ghcr.io/converged-computing/flux-view-rocky:tag-9\" in 18.651s (18.651s including waiting). Image size: 234951572 bytes.","source":{"component":"kubelet","host":"ip-192-168-48-119.ec2.internal"},"firstTimestamp":"2024-08-10T19:02:51Z","lastTimestamp":"2024-08-10T19:02:51Z","count":1,"type":"Normal","eventTime":null,"reportingComponent":"kubelet","reportingInstance":"ip-192-168-48-119.ec2.internal","clusterName":"","involvedObject":{"kind":"Pod","namespace":"default","name":"flux-sample-1-ghl62","uid":"17ea70af-4c56-415a-9cb8-78184e183760","apiVersion":"v1","resourceVersion":"22679","fieldPath":"spec.initContainers{flux-view}","labels":{"app.kubernetes.io/name":"flux-sample","batch.kubernetes.io/controller-uid":"7b5908be-3d77-4d51-a1e5-a70bb0eefb0e","batch.kubernetes.io/job-completion-index":"1","batch.kubernetes.io/job-name":"flux-sample","controller-uid":"7b5908be-3d77-4d51-a1e5-a70bb0eefb0e","hpa-selector":"flux-sample","job-index":"1","job-name":"flux-sample","namespace":"default"},"annotations":{"batch.kubernetes.io/job-completion-index":"1"},"ownerReferences":[{"apiVersion":"batch/v1","kind":"Job","name":"flux-sample","uid":"7b5908be-3d77-4d51-a1e5-a70bb0eefb0e","controller":true,"blockOwnerDeletion":true}],"deleted":false}}
{"metadata":{"name":"flux-sample-1-ghl62.17ea734aadd91c79","namespace":"default","uid":"b6b31670-92a4-4e1c-ab58-7a4e10d122ef","resourceVersion":"22756","creationTimestamp":"2024-08-10T19:02:52Z"},"reason":"Created","message":"Created container flux-view","source":{"component":"kubelet","host":"ip-192-168-48-119.ec2.internal"},"firstTimestamp":"2024-08-10T19:02:52Z","lastTimestamp":"2024-08-10T19:02:52Z","count":1,"type":"Normal","eventTime":null,"reportingComponent":"kubelet","reportingInstance":"ip-192-168-48-119.ec2.internal","clusterName":"","involvedObject":{"kind":"Pod","namespace":"default","name":"flux-sample-1-ghl62","uid":"17ea70af-4c56-415a-9cb8-78184e183760","apiVersion":"v1","resourceVersion":"22679","fieldPath":"spec.initContainers{flux-view}","labels":{"app.kubernetes.io/name":"flux-sample","batch.kubernetes.io/controller-uid":"7b5908be-3d77-4d51-a1e5-a70bb0eefb0e","batch.kubernetes.io/job-completion-index":"1","batch.kubernetes.io/job-name":"flux-sample","controller-uid":"7b5908be-3d77-4d51-a1e5-a70bb0eefb0e","hpa-selector":"flux-sample","job-index":"1","job-name":"flux-sample","namespace":"default"},"annotations":{"batch.kubernetes.io/job-completion-index":"1"},"ownerReferences":[{"apiVersion":"batch/v1","kind":"Job","name":"flux-sample","uid":"7b5908be-3d77-4d51-a1e5-a70bb0eefb0e","controller":true,"blockOwnerDeletion":true}],"deleted":false}}
{"metadata":{"name":"flux-sample-1-ghl62.17ea734abed948f7","namespace":"default","uid":"935b4f12-4f06-401c-9354-52f0e91becf1","resourceVersion":"22761","creationTimestamp":"2024-08-10T19:02:52Z"},"reason":"Started","message":"Started container flux-view","source":{"component":"kubelet","host":"ip-192-168-48-119.ec2.internal"},"firstTimestamp":"2024-08-10T19:02:52Z","lastTimestamp":"2024-08-10T19:02:52Z","count":1,"type":"Normal","eventTime":null,"reportingComponent":"kubelet","reportingInstance":"ip-192-168-48-119.ec2.internal","clusterName":"","involvedObject":{"kind":"Pod","namespace":"default","name":"flux-sample-1-ghl62","uid":"17ea70af-4c56-415a-9cb8-78184e183760","apiVersion":"v1","resourceVersion":"22679","fieldPath":"spec.initContainers{flux-view}","labels":{"app.kubernetes.io/name":"flux-sample","batch.kubernetes.io/controller-uid":"7b5908be-3d77-4d51-a1e5-a70bb0eefb0e","batch.kubernetes.io/job-completion-index":"1","batch.kubernetes.io/job-name":"flux-sample","controller-uid":"7b5908be-3d77-4d51-a1e5-a70bb0eefb0e","hpa-selector":"flux-sample","job-index":"1","job-name":"flux-sample","namespace":"default"},"annotations":{"batch.kubernetes.io/job-completion-index":"1"},"ownerReferences":[{"apiVersion":"batch/v1","kind":"Job","name":"flux-sample","uid":"7b5908be-3d77-4d51-a1e5-a70bb0eefb0e","controller":true,"blockOwnerDeletion":true}],"deleted":false}}
{"metadata":{"name":"flux-sample-0-dc6dr.17ea734af16fa859","namespace":"default","uid":"dddd096d-43f0-4f3a-83e8-a5c3b13844da","resourceVersion":"22764","creationTimestamp":"2024-08-10T19:02:53Z"},"reason":"Pulling","message":"Pulling image \"ghcr.io/converged-computing/metric-osu-cpu:libfabric\"","source":{"component":"kubelet","host":"ip-192-168-13-58.ec2.internal"},"firstTimestamp":"2024-08-10T19:02:53Z","lastTimestamp":"2024-08-10T19:02:53Z","count":1,"type":"Normal","eventTime":null,"reportingComponent":"kubelet","reportingInstance":"ip-192-168-13-58.ec2.internal","clusterName":"","involvedObject":{"kind":"Pod","namespace":"default","name":"flux-sample-0-dc6dr","uid":"3d9534a0-1f15-491e-a469-cba9cf2f3f29","apiVersion":"v1","resourceVersion":"22675","fieldPath":"spec.containers{flux-sample}","labels":{"app.kubernetes.io/name":"flux-sample","batch.kubernetes.io/controller-uid":"7b5908be-3d77-4d51-a1e5-a70bb0eefb0e","batch.kubernetes.io/job-completion-index":"0","batch.kubernetes.io/job-name":"flux-sample","controller-uid":"7b5908be-3d77-4d51-a1e5-a70bb0eefb0e","hpa-selector":"flux-sample","job-index":"0","job-name":"flux-sample","namespace":"default"},"annotations":{"batch.kubernetes.io/job-completion-index":"0"},"ownerReferences":[{"apiVersion":"batch/v1","kind":"Job","name":"flux-sample","uid":"7b5908be-3d77-4d51-a1e5-a70bb0eefb0e","controller":true,"blockOwnerDeletion":true}],"deleted":false}}
{"metadata":{"name":"flux-sample-1-ghl62.17ea734badf431b6","namespace":"default","uid":"ecf95b93-0644-41f1-a4e0-743ab8a210c1","resourceVersion":"22778","creationTimestamp":"2024-08-10T19:02:56Z"},"reason":"Pulling","message":"Pulling image \"ghcr.io/converged-computing/metric-osu-cpu:libfabric\"","source":{"component":"kubelet","host":"ip-192-168-48-119.ec2.internal"},"firstTimestamp":"2024-08-10T19:02:56Z","lastTimestamp":"2024-08-10T19:02:56Z","count":1,"type":"Normal","eventTime":null,"reportingComponent":"kubelet","reportingInstance":"ip-192-168-48-119.ec2.internal","clusterName":"","involvedObject":{"kind":"Pod","namespace":"default","name":"flux-sample-1-ghl62","uid":"17ea70af-4c56-415a-9cb8-78184e183760","apiVersion":"v1","resourceVersion":"22679","fieldPath":"spec.containers{flux-sample}","labels":{"app.kubernetes.io/name":"flux-sample","batch.kubernetes.io/controller-uid":"7b5908be-3d77-4d51-a1e5-a70bb0eefb0e","batch.kubernetes.io/job-completion-index":"1","batch.kubernetes.io/job-name":"flux-sample","controller-uid":"7b5908be-3d77-4d51-a1e5-a70bb0eefb0e","hpa-selector":"flux-sample","job-index":"1","job-name":"flux-sample","namespace":"default"},"annotations":{"batch.kubernetes.io/job-completion-index":"1"},"ownerReferences":[{"apiVersion":"batch/v1","kind":"Job","name":"flux-sample","uid":"7b5908be-3d77-4d51-a1e5-a70bb0eefb0e","controller":true,"blockOwnerDeletion":true}],"deleted":false}}
{"metadata":{"name":"flux-sample-0-dc6dr.17ea7355a0c6c846","namespace":"default","uid":"96d88f71-9ca3-4690-bddd-e46aacf24e4c","resourceVersion":"22917","creationTimestamp":"2024-08-10T19:03:39Z"},"reason":"Pulled","message":"Successfully pulled image \"ghcr.io/converged-computing/metric-osu-cpu:libfabric\" in 45.891s (45.891s including waiting). Image size: 1382040938 bytes.","source":{"component":"kubelet","host":"ip-192-168-13-58.ec2.internal"},"firstTimestamp":"2024-08-10T19:03:39Z","lastTimestamp":"2024-08-10T19:03:39Z","count":1,"type":"Normal","eventTime":null,"reportingComponent":"kubelet","reportingInstance":"ip-192-168-13-58.ec2.internal","clusterName":"","involvedObject":{"kind":"Pod","namespace":"default","name":"flux-sample-0-dc6dr","uid":"3d9534a0-1f15-491e-a469-cba9cf2f3f29","apiVersion":"v1","resourceVersion":"22675","fieldPath":"spec.containers{flux-sample}","labels":{"app.kubernetes.io/name":"flux-sample","batch.kubernetes.io/controller-uid":"7b5908be-3d77-4d51-a1e5-a70bb0eefb0e","batch.kubernetes.io/job-completion-index":"0","batch.kubernetes.io/job-name":"flux-sample","controller-uid":"7b5908be-3d77-4d51-a1e5-a70bb0eefb0e","hpa-selector":"flux-sample","job-index":"0","job-name":"flux-sample","namespace":"default"},"annotations":{"batch.kubernetes.io/job-completion-index":"0"},"ownerReferences":[{"apiVersion":"batch/v1","kind":"Job","name":"flux-sample","uid":"7b5908be-3d77-4d51-a1e5-a70bb0eefb0e","controller":true,"blockOwnerDeletion":true}],"deleted":false}}
{"metadata":{"name":"flux-sample-0-dc6dr.17ea7355a1c1ee7e","namespace":"default","uid":"3d117ce4-639b-42ec-bef4-919197ac0785","resourceVersion":"22918","creationTimestamp":"2024-08-10T19:03:39Z"},"reason":"Created","message":"Created container flux-sample","source":{"component":"kubelet","host":"ip-192-168-13-58.ec2.internal"},"firstTimestamp":"2024-08-10T19:03:39Z","lastTimestamp":"2024-08-10T19:03:39Z","count":1,"type":"Normal","eventTime":null,"reportingComponent":"kubelet","reportingInstance":"ip-192-168-13-58.ec2.internal","clusterName":"","involvedObject":{"kind":"Pod","namespace":"default","name":"flux-sample-0-dc6dr","uid":"3d9534a0-1f15-491e-a469-cba9cf2f3f29","apiVersion":"v1","resourceVersion":"22675","fieldPath":"spec.containers{flux-sample}","labels":{"app.kubernetes.io/name":"flux-sample","batch.kubernetes.io/controller-uid":"7b5908be-3d77-4d51-a1e5-a70bb0eefb0e","batch.kubernetes.io/job-completion-index":"0","batch.kubernetes.io/job-name":"flux-sample","controller-uid":"7b5908be-3d77-4d51-a1e5-a70bb0eefb0e","hpa-selector":"flux-sample","job-index":"0","job-name":"flux-sample","namespace":"default"},"annotations":{"batch.kubernetes.io/job-completion-index":"0"},"ownerReferences":[{"apiVersion":"batch/v1","kind":"Job","name":"flux-sample","uid":"7b5908be-3d77-4d51-a1e5-a70bb0eefb0e","controller":true,"blockOwnerDeletion":true}],"deleted":false}}
{"metadata":{"name":"flux-sample-0-dc6dr.17ea7355a4d46d4b","namespace":"default","uid":"e3d460af-2620-4a20-8008-a72a60719984","resourceVersion":"22919","creationTimestamp":"2024-08-10T19:03:39Z"},"reason":"Started","message":"Started container flux-sample","source":{"component":"kubelet","host":"ip-192-168-13-58.ec2.internal"},"firstTimestamp":"2024-08-10T19:03:39Z","lastTimestamp":"2024-08-10T19:03:39Z","count":1,"type":"Normal","eventTime":null,"reportingComponent":"kubelet","reportingInstance":"ip-192-168-13-58.ec2.internal","clusterName":"","involvedObject":{"kind":"Pod","namespace":"default","name":"flux-sample-0-dc6dr","uid":"3d9534a0-1f15-491e-a469-cba9cf2f3f29","apiVersion":"v1","resourceVersion":"22675","fieldPath":"spec.containers{flux-sample}","labels":{"app.kubernetes.io/name":"flux-sample","batch.kubernetes.io/controller-uid":"7b5908be-3d77-4d51-a1e5-a70bb0eefb0e","batch.kubernetes.io/job-completion-index":"0","batch.kubernetes.io/job-name":"flux-sample","controller-uid":"7b5908be-3d77-4d51-a1e5-a70bb0eefb0e","hpa-selector":"flux-sample","job-index":"0","job-name":"flux-sample","namespace":"default"},"annotations":{"batch.kubernetes.io/job-completion-index":"0"},"ownerReferences":[{"apiVersion":"batch/v1","kind":"Job","name":"flux-sample","uid":"7b5908be-3d77-4d51-a1e5-a70bb0eefb0e","controller":true,"blockOwnerDeletion":true}],"deleted":false}}
{"metadata":{"name":"flux-sample-1-ghl62.17ea73562dc41ddc","namespace":"default","uid":"e5c26a99-c04e-4fea-a7ad-e2109504789c","resourceVersion":"22935","creationTimestamp":"2024-08-10T19:03:41Z"},"reason":"Pulled","message":"Successfully pulled image \"ghcr.io/converged-computing/metric-osu-cpu:libfabric\" in 45.093s (45.093s including waiting). Image size: 1382040938 bytes.","source":{"component":"kubelet","host":"ip-192-168-48-119.ec2.internal"},"firstTimestamp":"2024-08-10T19:03:41Z","lastTimestamp":"2024-08-10T19:03:41Z","count":1,"type":"Normal","eventTime":null,"reportingComponent":"kubelet","reportingInstance":"ip-192-168-48-119.ec2.internal","clusterName":"","involvedObject":{"kind":"Pod","namespace":"default","name":"flux-sample-1-ghl62","uid":"17ea70af-4c56-415a-9cb8-78184e183760","apiVersion":"v1","resourceVersion":"22679","fieldPath":"spec.containers{flux-sample}","labels":{"app.kubernetes.io/name":"flux-sample","batch.kubernetes.io/controller-uid":"7b5908be-3d77-4d51-a1e5-a70bb0eefb0e","batch.kubernetes.io/job-completion-index":"1","batch.kubernetes.io/job-name":"flux-sample","controller-uid":"7b5908be-3d77-4d51-a1e5-a70bb0eefb0e","hpa-selector":"flux-sample","job-index":"1","job-name":"flux-sample","namespace":"default"},"annotations":{"batch.kubernetes.io/job-completion-index":"1"},"ownerReferences":[{"apiVersion":"batch/v1","kind":"Job","name":"flux-sample","uid":"7b5908be-3d77-4d51-a1e5-a70bb0eefb0e","controller":true,"blockOwnerDeletion":true}],"deleted":false}}
{"metadata":{"name":"flux-sample-1-ghl62.17ea735630735b6e","namespace":"default","uid":"9154f0ca-0745-4aed-adc5-a51cfbc7705e","resourceVersion":"22936","creationTimestamp":"2024-08-10T19:03:41Z"},"reason":"Created","message":"Created container flux-sample","source":{"component":"kubelet","host":"ip-192-168-48-119.ec2.internal"},"firstTimestamp":"2024-08-10T19:03:41Z","lastTimestamp":"2024-08-10T19:03:41Z","count":1,"type":"Normal","eventTime":null,"reportingComponent":"kubelet","reportingInstance":"ip-192-168-48-119.ec2.internal","clusterName":"","involvedObject":{"kind":"Pod","namespace":"default","name":"flux-sample-1-ghl62","uid":"17ea70af-4c56-415a-9cb8-78184e183760","apiVersion":"v1","resourceVersion":"22679","fieldPath":"spec.containers{flux-sample}","labels":{"app.kubernetes.io/name":"flux-sample","batch.kubernetes.io/controller-uid":"7b5908be-3d77-4d51-a1e5-a70bb0eefb0e","batch.kubernetes.io/job-completion-index":"1","batch.kubernetes.io/job-name":"flux-sample","controller-uid":"7b5908be-3d77-4d51-a1e5-a70bb0eefb0e","hpa-selector":"flux-sample","job-index":"1","job-name":"flux-sample","namespace":"default"},"annotations":{"batch.kubernetes.io/job-completion-index":"1"},"ownerReferences":[{"apiVersion":"batch/v1","kind":"Job","name":"flux-sample","uid":"7b5908be-3d77-4d51-a1e5-a70bb0eefb0e","controller":true,"blockOwnerDeletion":true}],"deleted":false}}
{"metadata":{"name":"flux-sample-1-ghl62.17ea73563ce77a9f","namespace":"default","uid":"6263687c-ff17-4fcd-8dd3-cda0529788fa","resourceVersion":"22938","creationTimestamp":"2024-08-10T19:03:41Z"},"reason":"Started","message":"Started container flux-sample","source":{"component":"kubelet","host":"ip-192-168-48-119.ec2.internal"},"firstTimestamp":"2024-08-10T19:03:41Z","lastTimestamp":"2024-08-10T19:03:41Z","count":1,"type":"Normal","eventTime":null,"reportingComponent":"kubelet","reportingInstance":"ip-192-168-48-119.ec2.internal","clusterName":"","involvedObject":{"kind":"Pod","namespace":"default","name":"flux-sample-1-ghl62","uid":"17ea70af-4c56-415a-9cb8-78184e183760","apiVersion":"v1","resourceVersion":"22679","fieldPath":"spec.containers{flux-sample}","labels":{"app.kubernetes.io/name":"flux-sample","batch.kubernetes.io/controller-uid":"7b5908be-3d77-4d51-a1e5-a70bb0eefb0e","batch.kubernetes.io/job-completion-index":"1","batch.kubernetes.io/job-name":"flux-sample","controller-uid":"7b5908be-3d77-4d51-a1e5-a70bb0eefb0e","hpa-selector":"flux-sample","job-index":"1","job-name":"flux-sample","namespace":"default"},"annotations":{"batch.kubernetes.io/job-completion-index":"1"},"ownerReferences":[{"apiVersion":"batch/v1","kind":"Job","name":"flux-sample","uid":"7b5908be-3d77-4d51-a1e5-a70bb0eefb0e","controller":true,"blockOwnerDeletion":true}],"deleted":false}}
{"metadata":{"name":"flux-sample-0-dc6dr.17ea7376242f216a","namespace":"default","uid":"e0d02dd7-b0bd-4186-bc8d-fd458d6d4a50","resourceVersion":"23393","creationTimestamp":"2024-08-10T19:05:58Z"},"reason":"Killing","message":"Stopping container flux-sample","source":{"component":"kubelet","host":"ip-192-168-13-58.ec2.internal"},"firstTimestamp":"2024-08-10T19:05:58Z","lastTimestamp":"2024-08-10T19:05:58Z","count":1,"type":"Normal","eventTime":null,"reportingComponent":"kubelet","reportingInstance":"ip-192-168-13-58.ec2.internal","clusterName":"","involvedObject":{"kind":"Pod","namespace":"default","name":"flux-sample-0-dc6dr","uid":"3d9534a0-1f15-491e-a469-cba9cf2f3f29","apiVersion":"v1","resourceVersion":"22675","fieldPath":"spec.containers{flux-sample}","labels":{"app.kubernetes.io/name":"flux-sample","batch.kubernetes.io/controller-uid":"7b5908be-3d77-4d51-a1e5-a70bb0eefb0e","batch.kubernetes.io/job-completion-index":"0","batch.kubernetes.io/job-name":"flux-sample","controller-uid":"7b5908be-3d77-4d51-a1e5-a70bb0eefb0e","hpa-selector":"flux-sample","job-index":"0","job-name":"flux-sample","namespace":"default"},"annotations":{"batch.kubernetes.io/job-completion-index":"0"},"ownerReferences":[{"apiVersion":"batch/v1","kind":"Job","name":"flux-sample","uid":"7b5908be-3d77-4d51-a1e5-a70bb0eefb0e","controller":true,"blockOwnerDeletion":true}],"deleted":false}}
{"metadata":{"name":"flux-sample-1-ghl62.17ea7376246be9a0","namespace":"default","uid":"6a4db905-ac07-4925-a0ff-f1b844db720c","resourceVersion":"23394","creationTimestamp":"2024-08-10T19:05:58Z"},"reason":"Killing","message":"Stopping container flux-sample","source":{"component":"kubelet","host":"ip-192-168-48-119.ec2.internal"},"firstTimestamp":"2024-08-10T19:05:58Z","lastTimestamp":"2024-08-10T19:05:58Z","count":1,"type":"Normal","eventTime":null,"reportingComponent":"kubelet","reportingInstance":"ip-192-168-48-119.ec2.internal","clusterName":"","involvedObject":{"kind":"Pod","namespace":"default","name":"flux-sample-1-ghl62","uid":"17ea70af-4c56-415a-9cb8-78184e183760","apiVersion":"v1","resourceVersion":"22679","fieldPath":"spec.containers{flux-sample}","labels":{"app.kubernetes.io/name":"flux-sample","batch.kubernetes.io/controller-uid":"7b5908be-3d77-4d51-a1e5-a70bb0eefb0e","batch.kubernetes.io/job-completion-index":"1","batch.kubernetes.io/job-name":"flux-sample","controller-uid":"7b5908be-3d77-4d51-a1e5-a70bb0eefb0e","hpa-selector":"flux-sample","job-index":"1","job-name":"flux-sample","namespace":"default"},"annotations":{"batch.kubernetes.io/job-completion-index":"1"},"ownerReferences":[{"apiVersion":"batch/v1","kind":"Job","name":"flux-sample","uid":"7b5908be-3d77-4d51-a1e5-a70bb0eefb0e","controller":true,"blockOwnerDeletion":true}],"deleted":false}}