You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Ingestion coming from a variety of log sources like beats and syslog and sending to Kafka.
The INFO level log lines do not give a lot of detail into what is causing the failure.
2018-01-09T09:31:46,097][INFO ][logstash.outputs.kafka ] Sending batch to Kafka failed. Will retry after a delay. {:batch_size=>1, :failures=>1, :sleep=>0.01}
[2018-01-09T09:31:46,113][INFO ][logstash.outputs.kafka ] Sending batch to Kafka failed. Will retry after a delay. {:batch_size=>1, :failures=>1, :sleep=>0.01}
[2018-01-09T09:31:46,129][INFO ][logstash.outputs.kafka ] Sending batch to Kafka failed. Will retry after a delay. {:batch_size=>1, :failures=>1, :sleep=>0.01}
Once DEBUG logging is enabled then we see the particular:
[2018-01-09T15:58:26,995][DEBUG][logstash.outputs.kafka ] KafkaProducer.send() failed: org.apache.kafka.common.errors.RecordTooLargeException: The message is
10486822 bytes when serialized which is larger than the maximum request size you have configured with the max.request.size configuration. {:exception=>java.util
.concurrent.ExecutionException: org.apache.kafka.common.errors.RecordTooLargeException: The message is 10486822 bytes when serialized which is larger than the maximum request size you have configured with the max.request.size configuration.}
[2018-01-09T15:58:26,997][INFO ][logstash.outputs.kafka ] Sending batch to Kafka failed. Will retry after a delay. {:batch_size=>1, :failures=>1, :sleep=>0.01
Is it possible to have better error logging with this plugin?
The text was updated successfully, but these errors were encountered:
Logstash v5.6.4
Kafka version : 0.10.0.1
Ingestion coming from a variety of log sources like beats and syslog and sending to Kafka.
The INFO level log lines do not give a lot of detail into what is causing the failure.
Once DEBUG logging is enabled then we see the particular:
Is it possible to have better error logging with this plugin?
The text was updated successfully, but these errors were encountered: