SQL Server to Snowflake data transfer.
Copy data from SQL Server to Snowflake using pyodbc.
1. Connect to SQL Server
-> loop
- fetchmany
- multipart upload to s3
-> Bulk COPY INTO Snowflake table
https://github.com/pydemo/snowcli - Snowflake cli.
https://github.com/pydemo/large-file-split-compress-parallel-upload-to-S3 - Chunked large file upload to S3.