Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Figure out why events had been "late" at the hackathon #344

Open
jbtrystram opened this issue Oct 27, 2022 · 2 comments
Open

Figure out why events had been "late" at the hackathon #344

jbtrystram opened this issue Oct 27, 2022 · 2 comments
Assignees
Labels
need info More information is required

Comments

@jbtrystram
Copy link
Member

WS does not give an offset when subscribing to kafka

@ctron
Copy link
Member

ctron commented Nov 3, 2022

I just peeked into the code and tested this a bit. To me it looks like the WebSocket service doesn't to anything special here, and the default is to use an anonymous group, with not offset reset specified, which should result in "latest". So each new connection should stream from the end of the stream. Using drg stream and the example application (websocket-client) confirm this.

So it looks more like a bottleneck somewhere. We had the gateways streaming data to the cloud, the cloud processing messages (around 15 msgs/s), and the consumer receiving events.

I could imagine that there was an issue with the conference WiFi. Leading to a buildup of messages, either from the gateway to the cloud, or from the cloud to the consumer.

@ctron ctron added the need info More information is required label Nov 3, 2022
@ctron ctron changed the title WS integration service streams from the beginning of the log Figure out why events had been "late" at the hackathon Nov 3, 2022
@ctron
Copy link
Member

ctron commented Nov 3, 2022

I also think that a scale test might bring some insight here.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
need info More information is required
Projects
None yet
Development

No branches or pull requests

4 participants