Code

1014 - Optimizing the Sync Command#1018

Code

Merged

avrohomgottlieb merged 8 commits intodevAlexsLemonade/scpca-portal:devfrom avrohom/1014-optimizing-sync-commandAlexsLemonade/scpca-portal:avrohom/1014-optimizing-sync-commandCopy head branch name to clipboardDec 9, 2024

+40-20

Commits

Commits on Dec 6, 2024

• implement queue chunking in s3::download_input_files

  avrohomgottlieb

  committed
  3da9343

• debugging aws s3 sync command

  avrohomgottlieb

  committed
  fca811a

Commits on Dec 7, 2024

• sync once per projects child directory

  davidsmejia

  committed
  abfbd24

Commits on Dec 8, 2024

• replace file_path.parents with file_path.parts

  avrohomgottlieb

  committed
  a3b7951

• remove trailing slash from test input bucket

  avrohomgottlieb

  committed
  785ded5

• remove logging

  avrohomgottlieb

  committed
  69e8a79

Commits on Dec 9, 2024

• add comment explaining subdirectory appending to bucket path

  avrohomgottlieb

  committed
  6b64aff

• update wording in batch revision tag

  avrohomgottlieb

  committed
  accdbfd