Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Better Handling of this ERROR: logdna_agent::_main] Couldn't batch lines Io(Os { code: 24, kind: Uncategorized, message: "No file descriptors available" }) #434

Open
Piponater opened this issue Oct 24, 2022 · 4 comments

Comments

@Piponater
Copy link

Piponater commented Oct 24, 2022

I seem to be getting this ERROR more often than I would like on ubuntu 20.04 (agent v2, 3.6.0-1).

logdna_agent::_main] Couldn't batch lines Io(Os { code: 24, kind: Uncategorized, message: "No file descriptors available" })

On occasion when I get an error I don't get 1 or 2 of them but ~1243140 lines, or ~1056301 lines, ~277752 of it (according to the alerts I have for it from mezmo being ingested), which fills up my root filesystem grinding my server to a halt and secondly all the millions of the lines (which I can guess is couple Gbs, gets sent to mezmo for ingestion which we get charged for).

Could some sort of Handling of this error be put in place e.g. for the agent to log a maximum of 100 lines and then stop, not continue into the millions of lines, this doesn't feel appropriate and wasteful, maybe 100 would make sense.

@vegetableZucchini
Copy link

Why is there no response to this?

@dkhokhlov
Copy link
Contributor

We've reproduced the log flood issue. Working on the fix.

@vegetableZucchini
Copy link

We've reproduced the log flood issue. Working on the fix.

We have been forced to disable all agents until a fix is released.
Is there an estimated time to resolution?

@gjanco
Copy link
Contributor

gjanco commented Nov 12, 2022

It will be in our next release (3.8). We do not have an exact time for this release.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants