Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
feat: performance enhancement (#527)
* fix: performance enhancement (#483) * fix: change the default udpConnectionTimeout to 3 (#441) * chore(release): 1.6.1-beta.1 ## [1.6.1-beta.1](v1.6.0...v1.6.1-beta.1) (2022-03-21) ### Bug Fixes * change the default udpConnectionTimeout to 3 ([#441](#441)) ([e1004ca](e1004ca)) * build(pip): (deps): bump mongoengine from 0.23.1 to 0.24.1 (#444) Bumps [mongoengine](https://github.com/MongoEngine/mongoengine) from 0.23.1 to 0.24.1. - [Release notes](https://github.com/MongoEngine/mongoengine/releases) - [Changelog](https://github.com/MongoEngine/mongoengine/blob/master/docs/changelog.rst) - [Commits](MongoEngine/mongoengine@v0.23.1...v0.24.1) --- updated-dependencies: - dependency-name: mongoengine dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> * test: add retry mechanism to splunk queries of integration tests (#445) * test: add retry mechanism to splunk queries of integration tests [run-int-tests] * fix: apply pre-commit * fix: enhancing SC4SNMP Telemetry (#443) * fix: add headers for enhancing Telemetry * test: increase static profiles time delay after the upgrade to 30 seconds [run-int-tests] * chore(release): 1.6.1-beta.2 ## [1.6.1-beta.2](v1.6.1-beta.1...v1.6.1-beta.2) (2022-03-23) ### Bug Fixes * enhancing SC4SNMP Telemetry ([#443](#443)) ([43785fb](43785fb)) * build(pip): (deps-dev): bump mkdocs-material from 8.2.5 to 8.2.6 (#446) Bumps [mkdocs-material](https://github.com/squidfunk/mkdocs-material) from 8.2.5 to 8.2.6. - [Release notes](https://github.com/squidfunk/mkdocs-material/releases) - [Changelog](https://github.com/squidfunk/mkdocs-material/blob/master/CHANGELOG) - [Commits](squidfunk/mkdocs-material@8.2.5...8.2.6) --- updated-dependencies: - dependency-name: mkdocs-material dependency-type: direct:development update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> * fix: replace celerybeatmongo repo (#448) * fix: replace celerybeatmongo repo * fix: modify poetry.lock * chore(release): 1.6.1-beta.3 ## [1.6.1-beta.3](v1.6.1-beta.2...v1.6.1-beta.3) (2022-03-25) ### Bug Fixes * replace celerybeatmongo repo ([#448](#448)) ([ddd25aa](ddd25aa)) * chore(release): 1.6.1-beta.1 ## [1.6.1-beta.1](v1.6.0...v1.6.1-beta.1) (2022-04-07) ### Bug Fixes * enhance SC4SNMP telemetry, improve integration tests ([#457](#457)) ([6dd7c1e](6dd7c1e)), closes [#441](#441) [#441](#441) [#444](#444) * feat: experimental change to divide tasks on 2 queues (poller and trap) and workers that consumes from them * feat: experimental change to divide tasks on 2 queues (poller and trap) and workers that consumes from them * feat: change the way worker are initialized * feat: change dpeloyment name * feat: change deployment name * feat: use different replicaCount and concurrency for trap and poller workers * build(pip): (deps): bump pyrate-limiter from 2.6.0 to 2.8.1 (#463) Bumps [pyrate-limiter](https://github.com/vutran1710/PyrateLimiter) from 2.6.0 to 2.8.1. - [Release notes](https://github.com/vutran1710/PyrateLimiter/releases) - [Changelog](https://github.com/vutran1710/PyrateLimiter/blob/master/CHANGELOG.md) - [Commits](https://github.com/vutran1710/PyrateLimiter/commits) --- updated-dependencies: - dependency-name: pyrate-limiter dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> * feat: add another queue only for prepare and send * feat: test redis as a celerybeat tool * fix: redis port * fix: redis url in inventory pod * feat: add autoscaling for poller pods * feat: change RabbitMQ to Redis * feat: add autoscaling * fix: workers cleanup * fix: default values file * fix: delete RabbitMQ * fix: enable autoscaling for traps * fix: move tolerations and podAffinity up * fix: worker annotation typo * fix: change directory name * fix: add _helper for worker * fix: ident of labels in poller * fix: update hpa version * fix: delete memory check in horizontal autoscaling * fix: set default resources for pods * fix: fix typo * fix: define resources for workers * fix: refactor traps to trap * fix: adjust poetry packages and wait-for-dep * fix: local installation for integration tests script * fix: microk8s documentation and integration tests (#466) * fix: change the default udpConnectionTimeout to 3 (#441) * chore(release): 1.6.1-beta.1 ## [1.6.1-beta.1](v1.6.0...v1.6.1-beta.1) (2022-03-21) ### Bug Fixes * change the default udpConnectionTimeout to 3 ([#441](#441)) ([e1004ca](e1004ca)) * build(pip): (deps): bump mongoengine from 0.23.1 to 0.24.1 (#444) Bumps [mongoengine](https://github.com/MongoEngine/mongoengine) from 0.23.1 to 0.24.1. - [Release notes](https://github.com/MongoEngine/mongoengine/releases) - [Changelog](https://github.com/MongoEngine/mongoengine/blob/master/docs/changelog.rst) - [Commits](MongoEngine/mongoengine@v0.23.1...v0.24.1) --- updated-dependencies: - dependency-name: mongoengine dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> * test: add retry mechanism to splunk queries of integration tests (#445) * test: add retry mechanism to splunk queries of integration tests [run-int-tests] * fix: apply pre-commit * fix: enhancing SC4SNMP Telemetry (#443) * fix: add headers for enhancing Telemetry * test: increase static profiles time delay after the upgrade to 30 seconds [run-int-tests] * chore(release): 1.6.1-beta.2 ## [1.6.1-beta.2](v1.6.1-beta.1...v1.6.1-beta.2) (2022-03-23) ### Bug Fixes * enhancing SC4SNMP Telemetry ([#443](#443)) ([43785fb](43785fb)) * build(pip): (deps-dev): bump mkdocs-material from 8.2.5 to 8.2.6 (#446) Bumps [mkdocs-material](https://github.com/squidfunk/mkdocs-material) from 8.2.5 to 8.2.6. - [Release notes](https://github.com/squidfunk/mkdocs-material/releases) - [Changelog](https://github.com/squidfunk/mkdocs-material/blob/master/CHANGELOG) - [Commits](squidfunk/mkdocs-material@8.2.5...8.2.6) --- updated-dependencies: - dependency-name: mkdocs-material dependency-type: direct:development update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> * fix: replace celerybeatmongo repo (#448) * fix: replace celerybeatmongo repo * fix: modify poetry.lock * chore(release): 1.6.1-beta.3 ## [1.6.1-beta.3](v1.6.1-beta.2...v1.6.1-beta.3) (2022-03-25) ### Bug Fixes * replace celerybeatmongo repo ([#448](#448)) ([ddd25aa](ddd25aa)) * fix: microk8s installation enabling addons * [run-int-tests] * fix: change test to 2/3 retries, as one retry to splunk takes about 1 minute * [run-int-tests] * fix: delete unnecessary part from the documentation * fix: clarify index requirements * fix: typo Co-authored-by: semantic-release-bot <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> * fix: make task timeout configurable (#476) * fix: make task timeout configurable * fix: add debug for monitoring the state of walk * chore(release): 1.6.2-beta.1 ## [1.6.2-beta.1](v1.6.1...v1.6.2-beta.1) (2022-05-25) ### Bug Fixes * make task timeout configurable ([#476](#476)) ([79e05d2](79e05d2)) * fix: disable first full walk when small walk is enabled (#477) * fix: disable first full walk when small walk is enabled * fix: apply pre-commit and rename tests * fix: unit tests * chore(release): 1.6.2-beta.2 ## [1.6.2-beta.2](v1.6.2-beta.1...v1.6.2-beta.2) (2022-05-26) ### Bug Fixes * disable first full walk when small walk is enabled ([#477](#477)) ([d8570cb](d8570cb)) * doc: clarification and adjust integration tests (#478) * doc: add information about small walk, fix broken link * fix: delete stale integration tests for small walk * fix: apply pre-commit * fix: metadata flags for workers * fix: metadata flags for workers selectorLabels * fix: default selectorLabel * fix: unit tests * fix: comment out v3 test that doesn't work * fix: profiles schedules calculating starting from every walk operation * fix: waiting for trap pod initialization in integration tests * fix: add redis default config to base values.yaml * fix: migration to the new version, refactor of tasks generator * fix: set of profiles to list * fix: add unit tests to task_generator.py * doc: autoscaling doc update * refactor: Helm files * fix: wrong env variables for traps * fix: increase resources for traps * test: add unit tests for schema migration * test: fix unit tests for schema migration * test: apply pre-commit * doc: update documentation * doc: update performance specs * fix: increase resources for poller pod * fix: update poetry dependencies * doc: bring back previous performance specs for GETs Co-authored-by: semantic-release-bot <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> * chore(release): 1.6.3-beta.1 ## [1.6.3-beta.1](v1.6.2...v1.6.3-beta.1) (2022-06-23) ### Bug Fixes * performance enhancement ([#483](#483)) ([8965301](8965301)), closes [#441](#441) [#441](#441) [#444](#444) * fix: cleanup after performance enhancement (#485) * fix: deployment replicaCount value and enhance documentation with visualisation of application working * doc: trap example * fix: crop images, expand images after click * chore(release): 1.6.3-beta.2 ## [1.6.3-beta.2](v1.6.3-beta.1...v1.6.3-beta.2) (2022-06-24) ### Bug Fixes * cleanup after performance enhancement ([#485](#485)) ([1d4fde6](1d4fde6)) * doc: simplify hard to understand parts of the docs and update perf specs for GETs (#486) * chore: fossa integration (#488) * chore: fossa integration * fix: delete flower unused dependency Co-authored-by: omrozowicz-splunk <[email protected]> * chore: piepline documentation publishing fix (#493) * chore: piepline documentation publishing fix * chore: documentation versioning cleanup * chore: run list of versions to delete * chore: change grep * chore: version cleanup * chore: delete one version * chore: build documentation for tag versions * chore: delete -next branches * chore: hardcode next latest version * chore: delete mike cleanup (#498) * fix: refactor of inventory fields (#494) * fix: refactor of inventory fields * fix: deleted unnecessary line in tasks.py and .gitignore after pull request review * fix: changes after pre-commit * fix: added preprocessing of old inventory fields names to from_dict method in InventoryRecord class. Updated reference to class attributes in test_utils.py * fix: removed from_dict() method from InventoryRecord class and changed InventoryRecord creation in test_auth.py so that it doesn't use from_dict() method * fix: changed InventoryRecord creation in unit tests so that it doesn't use from_dict() method * fix: increased test coverage of inventory_record.py * fix: run pre-commit on all files * chore(release): 1.6.3-beta.3 ## [1.6.3-beta.3](v1.6.3-beta.2...v1.6.3-beta.3) (2022-07-13) ### Bug Fixes * refactor of inventory fields ([#494](#494)) ([148280f](148280f)) * fix: worker pods recreation (#499) * fix: worker environmental variables, add configurable walk retry max interval * chore(release): 1.6.3-beta.4 ## [1.6.3-beta.4](v1.6.3-beta.3...v1.6.3-beta.4) (2022-07-19) ### Bug Fixes * worker pods recreation ([#499](#499)) ([6ac95a5](6ac95a5)) * fix: bump version of redbeat (#501) * chore(release): 1.6.3-beta.5 ## [1.6.3-beta.5](v1.6.3-beta.4...v1.6.3-beta.5) (2022-07-22) ### Bug Fixes * bump version of redbeat ([#501](#501)) ([93c2132](93c2132)) * doc: typos fixes, reorganisation of profiles configuration instructions (#500) * doc: typos fixes, reorganisation of profiles configuration instructions * doc: delete walk type form smart profiles * doc: apply PR review suggestions * test: I added test of snmpv3 walk (#502) * test: add test of snmpv3 walk * test: decrease wait time for v3 polling case * refactor: apply pre-commit Co-authored-by: omrozowicz-splunk <[email protected]> * fix: add logging for profiles assigned, update monit for SC4SNMP upgrade (#505) * fix: add logging for profiles assigned, update monit for SC4SNMP upgrade * chore: apply pre-commit * chore: update Contact information in Readme * fix: monit content * chore(release): 1.6.3-beta.6 ## [1.6.3-beta.6](v1.6.3-beta.5...v1.6.3-beta.6) (2022-07-27) ### Bug Fixes * add logging for profiles assigned, update monit for SC4SNMP upgrade ([#505](#505)) ([adf87ae](adf87ae)) * fix: creating packages for offline installation in the pipeline (#507) * fix: Creating packages for offline installation in the pipeline * fix: changed create_packages.sh script so that version of splunk-connect-for-snmp package downloaded from helm isn't hardcoded * fix: changed action trigger to push and added release * chore(release): 1.6.3-beta.7 ## [1.6.3-beta.7](v1.6.3-beta.6...v1.6.3-beta.7) (2022-07-28) ### Bug Fixes * creating packages for offline installation in the pipeline ([#507](#507)) ([5aa51f3](5aa51f3)) * fix: offline installation workflow, small walk frequency not updating… (#508) * fix: offline installation workflow, small walk frequency not updating, add logging for using smart profile as a static one * fix: bring back gh release upload * chore(release): 1.6.3-beta.8 ## [1.6.3-beta.8](v1.6.3-beta.7...v1.6.3-beta.8) (2022-07-28) ### Bug Fixes * offline installation workflow, small walk frequency not updating… ([#508](#508)) ([ace577f](ace577f)) * fix: small walk issue (#511) * fix: walk profile as a static profile + unit tests * fix: updating profiles to mongo instead of a mount file * fix: apply pre-commit and [run-int-tests] * fix: PROFILES_RELOAD_DELAY back to env variable * chore(release): 1.6.3-beta.9 ## [1.6.3-beta.9](v1.6.3-beta.8...v1.6.3-beta.9) (2022-07-30) ### Bug Fixes * small walk issue ([#511](#511)) ([7c5834b](7c5834b)) * fix: added automatic sim_image and otel helm chart packages creation … (#512) * fix: Added automatic sim_image and otel helm chart packages creation for offline installation * fix: downloading of one more image for mongodb * chore(release): 1.6.3-beta.10 ## [1.6.3-beta.10](v1.6.3-beta.9...v1.6.3-beta.10) (2022-08-03) ### Bug Fixes * added automatic sim_image and otel helm chart packages creation … ([#512](#512)) ([aebee37](aebee37)) * fix: otel package upload for offline installation (#513) * fix: otel package upload so that it works in the workflow * fix: check if fossa passes * chore(release): 1.6.3-beta.11 ## [1.6.3-beta.11](v1.6.3-beta.10...v1.6.3-beta.11) (2022-08-03) ### Bug Fixes * otel package upload for offline installation ([#513](#513)) ([b6eb532](b6eb532)) * doc: documentation of SC4SNMP offline installation (#510) * doc: documentation of SC4SNMP offline installation * doc: instead of 'lab' use 'sc4snmp installation server', added pullPolicy: Never to sim and redis, corrected other suggestions from review * doc: added documentation of the OpenTelemetry offline installation * doc: removed explicit <tag> specification in splunk image in sc4snmp offlinie installation doc * fix: add handling exceptions for loading mibs, fix sender priority, change autoscaling parametrs from entrypoint (#514) * chore(release): 1.6.3-beta.12 ## [1.6.3-beta.12](v1.6.3-beta.11...v1.6.3-beta.12) (2022-08-05) ### Bug Fixes * add handling exceptions for loading mibs, fix sender priority, change autoscaling parametrs from entrypoint ([#514](#514)) ([7ac35e7](7ac35e7)) * doc: snmpv3 (#518) * doc: update trap v3 configuration * fix: security engines in traps (#519) * fix: define list of security engines * fix: default value of security engine * fix: join security engines * fix: subpaths of secrets * fix: write *** instead of passwords in debug logs * fix: upgrade default replicaCounts for workers * fix: setup default securityEngineId * doc: update snmptrap v3 documentation * chore(release): 1.6.3-beta.13 ## [1.6.3-beta.13](v1.6.3-beta.12...v1.6.3-beta.13) (2022-08-11) ### Bug Fixes * security engines in traps ([#519](#519)) ([de16713](de16713)) * fix: performance adjustment (#515) * fix: add handling exceptions for loading mibs, fix sender priority, change autoscaling parameters from an entrypoint * fix: update default resources of pods * fix: remove hpa for ram and resources for ram * fix: decrease requests and limits for traps * fix: change the way trap's loading mibs * fix: refactor oid_values variable * fix: increase cpu limits * doc: add upgrading section ot the documentation * doc: fix documentation * test: fix unit tests * doc: describe autoscaling more and update planning section * chore(release): 1.6.3-beta.14 ## [1.6.3-beta.14](v1.6.3-beta.13...v1.6.3-beta.14) (2022-08-11) ### Bug Fixes * performance adjustment ([#515](#515)) ([34db1d2](34db1d2)) * fix: update develop versioning (#525) * doc: snmpv3 traps issues (#516) * doc: traps v3 * doc: update creation os snmpv3 secrets * fix: trap secrets mount and security engine defining (#521) * fix: trap secrets mount and security engine defining * doc: add documentation about upgrading SC4SNMP * chore(release): 1.6.3 ## [1.6.3](v1.6.2...v1.6.3) (2022-08-12) ### Bug Fixes * trap secrets mount and security engine defining ([#521](#521)) ([bbe4bce](bbe4bce)) Co-authored-by: semantic-release-bot <[email protected]> * chore(release): 1.6.3-beta.15 ## [1.6.3-beta.15](v1.6.3-beta.14...v1.6.3-beta.15) (2022-08-23) ### Bug Fixes * update develop versioning ([#525](#525)) ([7520ed4](7520ed4)), closes [#516](#516) [#521](#521) [#521](#521) * doc: documentation for installation on small environments (#520) * doc: documentation for installation on small environments * doc: applied changes from the review * doc: update helm NOTES * chore: set semantic release dry run mode to true * chore: delete dry run from semantic release * feat: update version in chart notes to 1.7 Co-authored-by: semantic-release-bot <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: Adam Ryznar <[email protected]> Co-authored-by: wojtekzyla <[email protected]>
- Loading branch information
5 people
authored
Aug 23, 2022
1 parent
8cacf83
commit 6cdeec2