Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add s3 benchmark and deploy pipeline #66

Merged
merged 46 commits into from
Mar 25, 2024

Conversation

velomatt
Copy link
Contributor

Moving latest development changes to Open Source:

  • Add support for KVFS format
  • Move all logs to /var/log
  • Move all conf files to /etc/dss
  • Add enhanced error handling for KVFS / BlobFS
  • Do not install / require dss-GCC if not needed
  • Don't run compaction if using KVFS
  • Fix broken s3-benchmark playbooks
  • Add s3-benchmark test suites
  • Add deploy pipeline stage

Build rocev2_ip_list for disaggregated hosts (#49)

See merge request dss/dss-ansible!11
- remove both blobfs and kvfs files
- put the format script in conf dir, not bin dir
- put the log file in log dir, not bin dir
- use abs paths for everything
- stat for dss_formatter and set var
- rename substasks
- use abs path of target script
- put target script in conf dir, not bin dir
- incorrectly used inverse logic
- blobfs logfile now created from template script
- kvfs format logfile created after format task
- if kvfs format fails - no logfile
- missing logfile used for criteria for future format decision
- this accommodates dss_formatter returns non-0 on failed format
…zation'

Add support for new KV FS formatter (dss_formatter)

See merge request dss/dss-ansible!32
- put script in /etc/dss not bin dir
- output logs to /var/log/dss
- don't needlessly loop through dss_host.py tasks
@velomatt velomatt requested a review from a team as a code owner March 25, 2024 21:35
@velomatt velomatt requested a review from snubatreus March 25, 2024 21:36
Copy link

@snubatreus snubatreus left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good

@velomatt velomatt merged commit 847688c into master Mar 25, 2024
1 check passed
@velomatt velomatt deleted the add-s3-benchmark-and-deploy-pipeline branch March 25, 2024 22:23
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants