Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Sagemaker extension wrapper #57

Merged

Conversation

ahsimb
Copy link
Collaborator

@ahsimb ahsimb commented Jan 8, 2024

closes #47

@ahsimb ahsimb added the feature Product feature label Jan 8, 2024
@ahsimb ahsimb self-assigned this Jan 8, 2024
@ahsimb ahsimb changed the base branch from main to feature/46-transformers-ext-wrapper January 9, 2024 14:39
exasol/sagemaker_extension_wrapper.py Outdated Show resolved Hide resolved
)
from exasol.extension_wrapper_common import (
encapsulate_aws_credentials,
str_to_bool
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
str_to_bool
str_to_bool,

)
from exasol.language_container_activation import (
ACTIVATION_KEY_PREFIX,
get_activation_sql
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
get_activation_sql
get_activation_sql,

exasol/sagemaker_extension_wrapper.py Show resolved Hide resolved
Parameters:
conf:
The secret store. The store should contain all the required
parameters for accessing the database, bucket-fs and AWS.
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
parameters for accessing the database, bucket-fs and AWS.
parameters for accessing the database, BucketFS, and AWS.

* Using AILabConfig internally

* Fixing errors picked by mypy

* Using config.name instead of the value

* Added aws_role to the AILabConfig

* Advanced the version to 0.2.6 (#64)

* Added aws_role to the AILabConfig

* Rolling back the adulteration by nox
@ahsimb ahsimb merged commit 1dd3ccb into feature/46-transformers-ext-wrapper Jan 16, 2024
12 checks passed
@ahsimb ahsimb deleted the feature/47-sagemaker-ext-wrapper branch January 16, 2024 16:05
ahsimb added a commit that referenced this pull request Jan 16, 2024
* Added the transformers extension wrapper

* Move setup code from cloud-storage notebooks to lib (#41)

* Github get version and dl url

* Requests types for types checking

* Retrieve jar function and tests

* Small comment

* BFS upload function, no tests

* BFS basic test

* BFS bucket mocking

* Unused import

* Cloud storage extension scripts

* Make lint happy

* #44: Added ITDE manager (#49)

Co-authored-by: Torsten Kilias <[email protected]>

* Fixing the integration test

* Updating poetry lock

* Changing the scope of the itde fixture

* Update exasol/transformers_extension_wrapper.py

Co-authored-by: Torsten Kilias <[email protected]>

* Added upload_model function

* Fixing typo

* Getting the mypy shut up

* Sagemaker extension wrapper (#57)

* Added the sagemaker extension wrapper

* Updated extension_wrapper_common.py

* Fixing the integration test

* Update exasol/sagemaker_extension_wrapper.py

Co-authored-by: Torsten Kilias <[email protected]>

* Typo and lock

* Using config enumeration internally (#61)

* Using AILabConfig internally

* Fixing errors picked by mypy

* Using config.name instead of the value

* Added aws_role to the AILabConfig

* Advanced the version to 0.2.6 (#64)

* Added aws_role to the AILabConfig

* Rolling back the adulteration by nox

---------

Co-authored-by: Torsten Kilias <[email protected]>

---------

Co-authored-by: Max Lapan <[email protected]>
Co-authored-by: Torsten Kilias <[email protected]>
Co-authored-by: Torsten Kilias <[email protected]>
ahsimb added a commit that referenced this pull request Jan 16, 2024
* Added language_container_activation module

* Transformers extension wrapper (#56)

* Added the transformers extension wrapper

* Move setup code from cloud-storage notebooks to lib (#41)

* Github get version and dl url

* Requests types for types checking

* Retrieve jar function and tests

* Small comment

* BFS upload function, no tests

* BFS basic test

* BFS bucket mocking

* Unused import

* Cloud storage extension scripts

* Make lint happy

* #44: Added ITDE manager (#49)

Co-authored-by: Torsten Kilias <[email protected]>

* Fixing the integration test

* Updating poetry lock

* Changing the scope of the itde fixture

* Update exasol/transformers_extension_wrapper.py

Co-authored-by: Torsten Kilias <[email protected]>

* Added upload_model function

* Fixing typo

* Getting the mypy shut up

* Sagemaker extension wrapper (#57)

* Added the sagemaker extension wrapper

* Updated extension_wrapper_common.py

* Fixing the integration test

* Update exasol/sagemaker_extension_wrapper.py

Co-authored-by: Torsten Kilias <[email protected]>

* Typo and lock

* Using config enumeration internally (#61)

* Using AILabConfig internally

* Fixing errors picked by mypy

* Using config.name instead of the value

* Added aws_role to the AILabConfig

* Advanced the version to 0.2.6 (#64)

* Added aws_role to the AILabConfig

* Rolling back the adulteration by nox

---------

Co-authored-by: Torsten Kilias <[email protected]>

---------

Co-authored-by: Max Lapan <[email protected]>
Co-authored-by: Torsten Kilias <[email protected]>
Co-authored-by: Torsten Kilias <[email protected]>

---------

Co-authored-by: Max Lapan <[email protected]>
Co-authored-by: Torsten Kilias <[email protected]>
Co-authored-by: Torsten Kilias <[email protected]>
ahsimb added a commit that referenced this pull request Jan 16, 2024
* Moved optional_str_to_bool to utils.py

* Update exasol/utils.py

Co-authored-by: Nicola Coretti <[email protected]>

* Unified language activation SQL command (#55)

* Added language_container_activation module

* Transformers extension wrapper (#56)

* Added the transformers extension wrapper

* Move setup code from cloud-storage notebooks to lib (#41)

* Github get version and dl url

* Requests types for types checking

* Retrieve jar function and tests

* Small comment

* BFS upload function, no tests

* BFS basic test

* BFS bucket mocking

* Unused import

* Cloud storage extension scripts

* Make lint happy

* #44: Added ITDE manager (#49)

Co-authored-by: Torsten Kilias <[email protected]>

* Fixing the integration test

* Updating poetry lock

* Changing the scope of the itde fixture

* Update exasol/transformers_extension_wrapper.py

Co-authored-by: Torsten Kilias <[email protected]>

* Added upload_model function

* Fixing typo

* Getting the mypy shut up

* Sagemaker extension wrapper (#57)

* Added the sagemaker extension wrapper

* Updated extension_wrapper_common.py

* Fixing the integration test

* Update exasol/sagemaker_extension_wrapper.py

Co-authored-by: Torsten Kilias <[email protected]>

* Typo and lock

* Using config enumeration internally (#61)

* Using AILabConfig internally

* Fixing errors picked by mypy

* Using config.name instead of the value

* Added aws_role to the AILabConfig

* Advanced the version to 0.2.6 (#64)

* Added aws_role to the AILabConfig

* Rolling back the adulteration by nox

---------

Co-authored-by: Torsten Kilias <[email protected]>

---------

Co-authored-by: Max Lapan <[email protected]>
Co-authored-by: Torsten Kilias <[email protected]>
Co-authored-by: Torsten Kilias <[email protected]>

---------

Co-authored-by: Max Lapan <[email protected]>
Co-authored-by: Torsten Kilias <[email protected]>
Co-authored-by: Torsten Kilias <[email protected]>

---------

Co-authored-by: Nicola Coretti <[email protected]>
Co-authored-by: Max Lapan <[email protected]>
Co-authored-by: Torsten Kilias <[email protected]>
Co-authored-by: Torsten Kilias <[email protected]>
ahsimb added a commit that referenced this pull request Jan 17, 2024
* Made secret store iterable

* Refactoring/52 data conv utility (#53)

* Moved optional_str_to_bool to utils.py

* Update exasol/utils.py

Co-authored-by: Nicola Coretti <[email protected]>

* Unified language activation SQL command (#55)

* Added language_container_activation module

* Transformers extension wrapper (#56)

* Added the transformers extension wrapper

* Move setup code from cloud-storage notebooks to lib (#41)

* Github get version and dl url

* Requests types for types checking

* Retrieve jar function and tests

* Small comment

* BFS upload function, no tests

* BFS basic test

* BFS bucket mocking

* Unused import

* Cloud storage extension scripts

* Make lint happy

* #44: Added ITDE manager (#49)

Co-authored-by: Torsten Kilias <[email protected]>

* Fixing the integration test

* Updating poetry lock

* Changing the scope of the itde fixture

* Update exasol/transformers_extension_wrapper.py

Co-authored-by: Torsten Kilias <[email protected]>

* Added upload_model function

* Fixing typo

* Getting the mypy shut up

* Sagemaker extension wrapper (#57)

* Added the sagemaker extension wrapper

* Updated extension_wrapper_common.py

* Fixing the integration test

* Update exasol/sagemaker_extension_wrapper.py

Co-authored-by: Torsten Kilias <[email protected]>

* Typo and lock

* Using config enumeration internally (#61)

* Using AILabConfig internally

* Fixing errors picked by mypy

* Using config.name instead of the value

* Added aws_role to the AILabConfig

* Advanced the version to 0.2.6 (#64)

* Added aws_role to the AILabConfig

* Rolling back the adulteration by nox

---------

Co-authored-by: Torsten Kilias <[email protected]>

---------

Co-authored-by: Max Lapan <[email protected]>
Co-authored-by: Torsten Kilias <[email protected]>
Co-authored-by: Torsten Kilias <[email protected]>

---------

Co-authored-by: Max Lapan <[email protected]>
Co-authored-by: Torsten Kilias <[email protected]>
Co-authored-by: Torsten Kilias <[email protected]>

---------

Co-authored-by: Nicola Coretti <[email protected]>
Co-authored-by: Max Lapan <[email protected]>
Co-authored-by: Torsten Kilias <[email protected]>
Co-authored-by: Torsten Kilias <[email protected]>

---------

Co-authored-by: Nicola Coretti <[email protected]>
Co-authored-by: Max Lapan <[email protected]>
Co-authored-by: Torsten Kilias <[email protected]>
Co-authored-by: Torsten Kilias <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
feature Product feature
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Create a Sagemaker Extension wrapper
3 participants