Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Emr migrate #20

Merged
merged 3 commits into from
Apr 15, 2024
Merged

Emr migrate #20

merged 3 commits into from
Apr 15, 2024

Conversation

sgtBurns7
Copy link

No description provided.

fixing mistake

one more fix

returning key

typecast into string

testing

fixing error

jar path change

stage testing

installing credstash

added apt

pressing automatic yes

locking versions

testing venv

no venv

confirming credstash is available

correct command

added cred init in main script

adding executable permissions

trying local path

removing chmod

init in function

yum for emr

pip3 install

add credstash install script

removing init and keeping it in bootstrap

credstash table name change

refactor code

assuming role to get credstash secrets

command corrections

different variable name

cleaning cli commands

cleaner approach

doing simple get on credstash table

cli update

using seq

refactor code

remove log

remove log
@@ -6,7 +6,7 @@ cd /app
upload_jar()
{
local_jar_path="sql-delta-import/target/scala-2.12/sql-delta-import-assembly-0.2.1-SNAPSHOT.jar"
jar_s3_url="s3://${SQOOP_BUCKET}/application-jars"
jar_s3_url="s3://rzp-edh-dev/application-jars"

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

no need to hard code

@RajkaranSh RajkaranSh merged commit 15ccc7b into master Apr 15, 2024
5 checks passed
@RajkaranSh RajkaranSh deleted the emr_migrate branch April 15, 2024 04:51
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants