Adding default configmap and secret to promtail-app

[marieroque]

towards giantswarm/roadmap#2054

This PR:

• adds default configmap and secret to promtail-app

Checklist

• Update changelog in CHANGELOG.md.
• Make sure values.yaml and values.schema.json are valid.

How do we test it ?

First, we need to deploy manually:

• gauss-logging-secret secret:

promtail:
  config:
    clients:
      - url: https://loki.XXXXX
        tenant_id: gauss-gauss
        basic_auth:
          username: lokiwrite
          password: XXXXXXXXXX
        backoff_config:
          max_period: 10m
        external_labels:
          installation: gauss
          cluster_id: gauss

• gauss-logging-config configmap:

apiVersion: v1                                                                                                                                                                                                                                                                            
data:                                                                                                                                                                                                                                                                                     
  values: |
    promtail:
      rbac:
        create: true
        pspEnabled: true
      extraArgs:
        - '-log-config-reverse-order'
      config:
        clients:
          - url: https://loki.XXX
            # the whole client config for this URL
            # including but not limited to authentication credentials
            # is stored in Flux secret
        snippets:
          extraScrapeConfigs: |
            # this one includes also system logs reported by systemd-journald
            - job_name: systemd_journal_run
              journal:
                path: /run/log/journal
                max_age: 12h
                json: true
              relabel_configs:
                - source_labels: ['__journal__systemd_unit']
                  target_label: 'systemd_unit'
                - source_labels: ['__journal__hostname']
                  target_label: 'hostname'
            - job_name: systemd_journal_var
              journal:
                path: /var/log/journal
                max_age: 12h
                json: true
              relabel_configs:
                - source_labels: ['__journal__systemd_unit']
                  target_label: 'systemd_unit'
                - source_labels: ['__journal__hostname']
                  target_label: 'hostname'
      extraVolumes:
        - name: journal-run
          hostPath:
            path: /run/log/journal/
        - name: journal-var
          hostPath:
            path: /var/log/journal/
      extraVolumeMounts:
        - name: journal-run
          mountPath: /run/log/journal/
          readOnly: true
        - name: journal-var
          mountPath: /var/log/journal/
          readOnly: true
kind: ConfigMap
metadata:
  name: gauss-logging-config
  namespace: giantswarm

Once specific branch deployed:

• Check promtail pods are running
• Check logs are present on gorilla grafana

[marieroque]

Process validated on MC gauss.

Pods are running:

[observability-bundle]$ k get po -A| grep promt
kube-system           promtail-app-2jhfm                                                1/1     Running            0                  3m7s
kube-system           promtail-app-7w8wr                                                1/1     Running            0                  3m7s
kube-system           promtail-app-8j6f4                                                1/1     Running            0                  3m7s
kube-system           promtail-app-8kj5k                                                1/1     Running            0                  3m7s
kube-system           promtail-app-hfk2g                                                1/1     Running            0                  3m7s
kube-system           promtail-app-ltzz9                                                1/1     Running            0                  3m7s
kube-system           promtail-app-pglt8                                                1/1     Running            0                  3m7s
kube-system           promtail-app-sjfg6                                                1/1     Running            0                  3m7s
kube-system           promtail-app-wbxhs                                                1/1     Running            0                  3m7s

Logs are sent to gorilla grafana:

[QuentinBisson]

If that works, that's wonderful

[marieroque]

If that works, that's wonderful

It doesn't work:

reason: 'Upgrade "observability-bundle" failed: cannot patch "promtail-app" with                                                                                                                                                                                                      
      kind App: admission webhook "apps.app-admission-controller.giantswarm.io" denied                                                                                                                                                                                                    
      the request: parsing failed error: unable to parse app: &errors.errorString{s:"v1alpha1.App.Spec:                                                                                                                                                                                   
      v1alpha1.AppSpec.ExtraConfigs: []v1alpha1.AppExtraConfig: v1alpha1.AppExtraConfig.Name:                                                                                                                                                                                             
      ReadString: expects \" or n, but found [, error found in #10 byte of ...|\",\"name\":[\"-logging-|...,                                                                                                                                                                              
      bigger context ...|ntswarm\",\"extraConfigs\":[{\"kind\":\"secret\",\"name\":[\"-logging-secret\"],\"namespace\":\"giantswarm\",\"prior|..."}'

[QuentinBisson]

@marieroque can you add the changelog entry?