Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Feat/state #13

Merged
merged 5 commits into from
Feb 6, 2018
Merged

Feat/state #13

merged 5 commits into from
Feb 6, 2018

Conversation

Pierozi
Copy link
Owner

@Pierozi Pierozi commented Jan 28, 2018

Refer to #6
Refer to #8

  • Use State object to persist reading state in json file
  • Prevent data loss when new token declared by API, the read are now retry with the new token

- Use State object ot persist reading state in json file
- Prevent data loss when new token declared by API, the read are now
retry whith new token
- Determine the size of next buffer based on size of previous one
- Optimize the batch size of aws put_event_log without reaching API limit
@Pierozi Pierozi merged commit e4fbf3b into master Feb 6, 2018
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant