Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

docs: Describe how to use ADLS instead of HDFS #560

Merged
merged 2 commits into from
Sep 16, 2024
Merged

Conversation

siegfriedweber
Copy link
Member

@siegfriedweber siegfriedweber commented Sep 13, 2024

Description

Describe how to use ADLS instead of HDFS

The ADLS support could also be properly implemented into the operator. The CRD could be extended and the operator could create the ConfigMap for ADLS. On the one hand, this would be a lot of work, on the other hand, this cannot be tested without an actual Azure storage account. Azure storage clones like Azurite do currently not support ADLS Gen2, see
Azure/Azurite#553. Adding a feature which cannot be integrated into Stackable's test landscape, is not sensible. And as the hurdle is low for the customer to define the ADLS ConfigMap themselves, only a documentation is provided.

Closes #539

Definition of Done Checklist

  • Not all of these items are applicable to all PRs, the author should update this template to only leave the boxes in that are relevant
  • Please make sure all these things are done and tick the boxes

Author

Preview Give feedback
No tasks being tracked yet.

Reviewer

Preview Give feedback

Acceptance

Preview Give feedback

Copy link
Contributor

@fhennig fhennig left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM (but I see you also requested lars' review)

@lfrancke
Copy link
Member

Thanks Sigi. I agree with Felix: Looks good to me. And I agree with you. Let's not do a deeper integration for now. Thank you for the thorough work.

@siegfriedweber siegfriedweber added this pull request to the merge queue Sep 16, 2024
Merged via the queue into main with commit efd862f Sep 16, 2024
31 checks passed
@siegfriedweber siegfriedweber deleted the doc/adls branch September 16, 2024 12:41
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
Archived in project
Development

Successfully merging this pull request may close these issues.

Support Azure Data Lake Storage Gen2 (ADLS)
3 participants