-
Notifications
You must be signed in to change notification settings - Fork 18
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Spurious bursts of errors connecting to logz.io #4
Comments
Hey @edevil! This log is printing every time there is an exception while sending logs. I just pushed another version of the plugin (0.0.5) to RubyGems that prints the exception instead of this not so informative message. Can you please update your plugin version and comment here again with the exception? Thanks, |
I should add that this fluentd daemon is running as a daemonset on my Kubernetes cluster hosted on Azure, so there can be some aggressive pruning of idle persistent connections, but Net::HTTP::Persistent is supposed to have a 5s timeout on those... |
That seems to be a known issue without a specific solution. Can you try and change the "flush_interval" parameter? |
I used tcpdump and I actually see connection attempts (SYN) not being answered from listener.logz.io:8071. Some kind of DoS protection perhaps?
|
@noniperi Can kick in? |
This seems to be related to opening connections in a small amount of time. Using a flush_interval of 2s and a constant stream of log traffic I haven't yet encountered problems since it keeps using the same connection. This is because the default value of Net:HTTP:Persistent:idle_timeout 5, so the connection is never considered idle. Using my previous flush_interval of 10s kept recycling the connection since it was idle for more than "idle_timeout". Is there a way to set this "idle_timeout" via configuration of the plugin? |
Version 0.0.6 is live in RubyGems.org Thanks! |
Periodically I get bursts of errors from this plugin:
I see logs on logz.io, so obviously this is not a permanent problem, but it would help if more specific information can be provided on the error. Is it a problem connecting to the remote host? A bad response from the server? A persistent connection that has failed?
Thanks.
The text was updated successfully, but these errors were encountered: