Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Run items using SLURM; save batches with platform-independent paths #298

Merged
merged 20 commits into from
Jul 16, 2024
Merged

Run items using SLURM; save batches with platform-independent paths #298

merged 20 commits into from
Jul 16, 2024

Commits on Jun 7, 2024

  1. Implement _run_slurm

    @ethanbb
    ethanbb committed Jun 7, 2024
    Configuration menu
    Copy the full SHA
    4956678 View commit details
    Browse the repository at this point in the history

  2. Better save location for slurm logs

    @ethanbb
    ethanbb committed Jun 7, 2024
    Configuration menu
    Copy the full SHA
    1848bae View commit details
    Browse the repository at this point in the history

  3. Clean up arguments to _run_slurm

    @ethanbb
    ethanbb committed Jun 7, 2024
    Configuration menu
    Copy the full SHA
    e571706 View commit details
    Browse the repository at this point in the history

  4. Use file lock when writing results to prevent overwriting

    @ethanbb
    ethanbb committed Jun 7, 2024
    Configuration menu
    Copy the full SHA
    6d860b7 View commit details
    Browse the repository at this point in the history

  5. Add support for specifying partition in _run_slurm

    @ethanbb
    ethanbb committed Jun 7, 2024
    Configuration menu
    Copy the full SHA
    c69dbce View commit details
    Browse the repository at this point in the history

  6. Support waiting for SLURM

    @ethanbb
    ethanbb committed Jun 7, 2024
    Configuration menu
    Copy the full SHA
    ec5c537 View commit details
    Browse the repository at this point in the history

  7. Use SoftFileLock b/c FileLock doesn't work on some filesystems, cross… 

    …-platform, etc
    @ethanbb
    ethanbb committed Jun 7, 2024
    Configuration menu
    Copy the full SHA
    ac50cdf View commit details
    Browse the repository at this point in the history

  8. Standardize saving log files in dir with other outputs

    @ethanbb
    ethanbb committed Jun 7, 2024
    Configuration menu
    Copy the full SHA
    d943d7c View commit details
    Browse the repository at this point in the history

  9. Save output paths as strings

    @ethanbb
    ethanbb committed Jun 7, 2024
    Configuration menu
    Copy the full SHA
    4c346f7 View commit details
    Browse the repository at this point in the history

  10. Refactor data saving and lock file/remove batch path whenever saving

    @ethanbb
    ethanbb committed Jun 7, 2024
    Configuration menu
    Copy the full SHA
    462cca7 View commit details
    Browse the repository at this point in the history

  11. Change location of OverwriteError to avoid circular import

    @ethanbb
    ethanbb committed Jun 7, 2024
    Configuration menu
    Copy the full SHA
    a1f7c19 View commit details
    Browse the repository at this point in the history

  12. Fix trying to concatenate to Path

    @ethanbb
    ethanbb committed Jun 7, 2024
    Configuration menu
    Copy the full SHA
    66ad95d View commit details
    Browse the repository at this point in the history

  13. Own rather than extend SoftFileLock since it seems to cause issues

    @ethanbb
    ethanbb committed Jun 7, 2024
    Configuration menu
    Copy the full SHA
    36a73d7 View commit details
    Browse the repository at this point in the history

Commits on Jun 11, 2024

  1. Minor fixes for batch file locking

    @ethanbb
    ethanbb committed Jun 11, 2024
    Configuration menu
    Copy the full SHA
    d7b1b1b View commit details
    Browse the repository at this point in the history

Commits on Jun 13, 2024

  1. Update requirement file with new filelock version

    @ethanbb
    ethanbb committed Jun 13, 2024
    Configuration menu
    Copy the full SHA
    4cca021 View commit details
    Browse the repository at this point in the history

Commits on Jun 14, 2024

  1. Remove unnecessary imports

    @ethanbb
    ethanbb committed Jun 14, 2024
    Configuration menu
    Copy the full SHA
    a39ddbe View commit details
    Browse the repository at this point in the history

Commits on Jun 15, 2024

  1. Add more general option argument to _run_slurm

    @ethanbb
    ethanbb committed Jun 15, 2024
    Configuration menu
    Copy the full SHA
    d753113 View commit details
    Browse the repository at this point in the history

Commits on Jun 16, 2024

  1. Refactor to put lock, item updating functionality in df extension

    @ethanbb
    ethanbb committed Jun 16, 2024
    Configuration menu
    Copy the full SHA
    c6a47a4 View commit details
    Browse the repository at this point in the history

Commits on Jun 19, 2024

  1. Raise error when trying to update item with unknown keys

    @ethanbb
    ethanbb committed Jun 19, 2024
    Configuration menu
    Copy the full SHA
    b2d8e07 View commit details
    Browse the repository at this point in the history

Commits on Jul 16, 2024

  1. Address type issues

    @ethanbb
    ethanbb committed Jul 16, 2024
    Configuration menu
    Copy the full SHA
    b0740f2 View commit details
    Browse the repository at this point in the history