Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

how to minikube's system logs share in opensearch via fluentbit? #556

Open
Ommkwn2001 opened this issue Jun 27, 2024 · 3 comments
Open

how to minikube's system logs share in opensearch via fluentbit? #556

Ommkwn2001 opened this issue Jun 27, 2024 · 3 comments
Labels
question Further information is requested

Comments

@Ommkwn2001
Copy link

Please describe the end goal of this project

So i have a three helm charts opensearch, opensearch dashboard and fluentbit.

so when i try to minikube logs pass in the opensearch via fluentbit,
there are give me an error in the fluentbit logs and my fluentbit version is 3.0.7 .

The error is :

[2024/06/27 05:32:52] [error] [upstream] connection opensearch-project/OpenSearch#68 to tcp://10.244.0.83:9600 timed out after 10 seconds (connection timeout) [2024/06/27 05:32:52] [error] [upstream] connection opensearch-project/OpenSearch#72 to tcp://10.244.0.83:9600 timed out after 10 seconds (connection timeout) [2024/06/27 05:32:52] [ warn] [engine] failed to flush chunk '1-1719466229.993033463.flb', retry in 87 seconds: task_id=601, input=cpu.0 > output=opensearch.0 (out_id=0) [2024/06/27 05:32:52] [ warn] [engine] failed to flush chunk '1-1719466254.994056245.flb', retry in 49 seconds: task_id=626, input=cpu.0 > output=opensearch.0 (out_id=0)

when i install fluentbit via helm i pass also this config code
The code is:
`config:
inputs: |
[INPUT]
Name cpu
Tag cpu

outputs: |
[OUTPUT]
Name opensearch
Match *
Host opensearch-cluster-master-headless.default.svc.cluster.local
Port 9600
HTTP_User admin
HTTP_Passwd TadhakDev01
Suppress_Type_Name On
Trace_Error On
Trace_Output On
Logstash_Format On
Replace_Dots On
Retry_Limit 100
Index minikubelogs `

And I edit this below code in my opensearch's value.yaml file
ssl: http: false allow_unsafe_democertificates: true

Supporting References

https://opensearch.org/

Issues

So I want all logs are get from the minikube system and pass in the opensearch via fluentbit.

Related component

Clients

@Ommkwn2001 Ommkwn2001 added the untriaged Issues that have not yet been triaged label Jun 27, 2024
@peternied
Copy link
Member

[Triage - attendees 1 2 3]
@Ommkwn2001 Thanks for creating this issue, transferring to the helm-charts repo

@opensearch-project/admin Could you please transfer this issue to the https://github.com/opensearch-project/helm-charts repo?

@peternied peternied added question Further information is requested and removed untriaged Issues that have not yet been triaged labels Jul 3, 2024
@gaiksaya gaiksaya transferred this issue from opensearch-project/OpenSearch Jul 3, 2024
@github-actions github-actions bot added the untriaged Issues that have not yet been triaged label Jul 3, 2024
@Ommkwn2001
Copy link
Author

when i try to use data prepper, so there are all logs get in opensearch dashboard through flyintbit.

@dblock
Copy link
Member

dblock commented Jul 15, 2024

[Catch All Triage - 1, 2, 3]

@dblock dblock removed the untriaged Issues that have not yet been triaged label Jul 15, 2024
@getsaurabh02 getsaurabh02 moved this from 🆕 New to Later (6 months plus) in Engineering Effectiveness Board Jul 18, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
question Further information is requested
Projects
Status: Backlog
Development

No branches or pull requests

3 participants