Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Stream service events into BigQuery #620

Closed
cortadocodes opened this issue Dec 1, 2023 · 0 comments
Closed

Stream service events into BigQuery #620

cortadocodes opened this issue Dec 1, 2023 · 0 comments
Assignees

Comments

@cortadocodes
Copy link
Member

cortadocodes commented Dec 1, 2023

Feature request

IMPORTANT: We need to test this before merging the breaking services communication change in case we need to change the format of event attributes (see #603).

Use Case

This will allow advanced querying of events at a lower storage cost and database server cost (as fewer concurrent connections to the database server will be needed e.g. by django-twined's service usage events.

Current state

Events are stored by django-twined in a postgresql database and the database server has to be upgraded to cope with many questions being asked at once.

More info

@cortadocodes cortadocodes moved this to Priority 3 (High) in Octue Board Dec 1, 2023
@github-project-automation github-project-automation bot moved this from Priority 3 (High) to Done in Octue Board Jun 24, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
Status: Done
Development

No branches or pull requests

2 participants