Code

Reduce execution time of tests#429

Code

Merged

AnesBenmerzoug merged 83 commits intodevelopaai-institute/pyDVL:developfrom fix/reduce-execution-time-of-testsaai-institute/pyDVL:fix/reduce-execution-time-of-testsCopy head branch name to clipboardOct 30, 2023

+1,893-2,093

Commits

Commits on Sep 13, 2023

• Combine tox test environments into single 'tests' environment

  AnesBenmerzoug

  committed
  2994a99

Commits on Sep 18, 2023

• Bump mypy version to 1.5.1

  AnesBenmerzoug

  committed
  7cb5b92

• Fix all type hint errors

  AnesBenmerzoug

  committed
  4233e5c

• Merge branch 'develop' into fix/reduce-execution-time-of-tests

  AnesBenmerzoug

  committed
  c2b02a6

• Fix sampler type hints

  AnesBenmerzoug

  committed
  c2b43fb

• Cache .mypy_cache directory in CI

  AnesBenmerzoug

  committed
  9e0d96c

• Put mypy version before python location in mypy CI cache key

  AnesBenmerzoug

  committed
  086c388

• Move tolerate plugin to separate module

  AnesBenmerzoug

  committed
  37be320

• Fix tox invocation in CI

  AnesBenmerzoug

  committed
  ee92c47

Commits on Sep 25, 2023

• Add ray extra to tox tests environment

  AnesBenmerzoug

  committed
  ee46cc6

• Create cloudpickle pytest cache provider

  AnesBenmerzoug

  committed
  c2c249e

• Remove import of parallel from pydvl.utils

  Show description for 3f0dac5
  AnesBenmerzoug

  committed
  3f0dac5

• Cache result of linear_shapley fixture

  AnesBenmerzoug

  committed
  e9beee5

• Reduce requirements for test_linear_montecarlo_shapley and use seed

  AnesBenmerzoug

  committed
  d81e327

• Further reduce valuation test runtime

  AnesBenmerzoug

  committed
  c55a528

• Add pytest-profiling to dev dependencies

  AnesBenmerzoug

  committed
  90e3ab9

• Run failed tests first

  AnesBenmerzoug

  committed
  9ae4a26

• Cache .pytest_cache directory in CI, store pytest-profiling graph as artifact

  AnesBenmerzoug

  committed
  cad4e3e

• Merge branch 'develop' into fix/reduce-execution-time-of-tests

  AnesBenmerzoug

  committed
  ed42757

• Add missing import

  AnesBenmerzoug

  committed
  ea14091

• Remove profile from default pytest arguments

  AnesBenmerzoug

  committed
  326d359

• Fix issue with torch.empty

  AnesBenmerzoug

  committed
  0989898

• Ignore typing error in plot_ci_array

  AnesBenmerzoug

  committed
  b8e3d1a

Commits on Oct 23, 2023

• Merge branch 'develop' into fix/reduce-execution-time-of-tests

  AnesBenmerzoug

  committed
  5068b32

• Add pytest-cases as dev dependency and bump pytest version

  AnesBenmerzoug

  committed
  153c5a6

• Rewrite tests in test_influences.py using pytest-cases

  AnesBenmerzoug

  committed
  536c841

• Fix bug in solve_batch_cg

  AnesBenmerzoug

  committed
  354774f

• Fix type hints

  AnesBenmerzoug

  committed
  691e6e9

Commits on Oct 25, 2023

• Define and use new pytest slow marker to skip slow tests by default

  AnesBenmerzoug

  committed
  a841af0

• Fix future cancellation test, simplify map reduce seeding test

  AnesBenmerzoug

  committed
  c585e79

Commits on Oct 26, 2023

• Allow passing seed to montecarlo least core

  AnesBenmerzoug

  committed
  10ec226

• Add pytest-split and pytest-sugar as requirements

  AnesBenmerzoug

  committed
  890d87f

• Fix default value of max_failues in tolerate fixture

  AnesBenmerzoug

  committed
  b742711

• Fix tests

  AnesBenmerzoug

  committed
  d383e92

• Add recorded test_durations

  AnesBenmerzoug

  committed
  362edf4

• Use pytest-split to split tests into 3 groups in CI

  AnesBenmerzoug

  committed
  2c658d1

• Update contributing guide

  AnesBenmerzoug

  committed
  e16e634

• Use least_duration test splitting algorithm

  AnesBenmerzoug

  committed
  771571c

• Fix CI file

  AnesBenmerzoug

  committed
  6d19980

• Use pytests's importorskip instead of try except

  AnesBenmerzoug

  committed
  29485a5

• Use rng object instead of setting the seed globally

  AnesBenmerzoug

  committed
  83e5b10

• Fix setting pytest marker for a module

  AnesBenmerzoug

  committed
  daebfb8

• Increase timeout for test_future_cancellation

  AnesBenmerzoug

  committed
  1d2b2de

• Remove pytest-profiling

  AnesBenmerzoug

  committed
  a8af2f7

• Simplify test CI workflow and split tests into 4 groups instead of 3

  AnesBenmerzoug

  committed
  f8aae61

• Rename notebook tests CI workflow

  AnesBenmerzoug

  committed
  c2b23e4

• Fix notebook tests CI workflow

  AnesBenmerzoug

  committed
  e20b8cf

• Customize tests CI job names, do not fail fast

  AnesBenmerzoug

  committed
  ba3d13d

• Pass seed to to map_reduce call inside test_memcached_parallel_repeated_training

  AnesBenmerzoug

  committed
  7dac359

• Except RayTaskError additionally in test_future_cancellation when cancelling future

  AnesBenmerzoug

  committed
  5d409d1

• Remove unneeded check on the duration in test_future_cancellation

  AnesBenmerzoug

  committed
  c5c6457

• Update test durations

  AnesBenmerzoug

  committed
  f3177e4

• Add kwargs to PowersetSampler's init

  AnesBenmerzoug

  committed
  b92eb46

• Pass seed to sampler in test_banzhaf

  AnesBenmerzoug

  committed
  3a2c858

• Output pytest coverage report as xml

  AnesBenmerzoug

  committed
  c473679

• Update test coverage from CI

  AnesBenmerzoug

  committed
  f4ab1a1

• Remove unused report tox environment

  AnesBenmerzoug

  committed
  bb4b8d1

• Fix cache key of pytest cache job on CI

  AnesBenmerzoug

  committed
  f6f67bc

• Fix tox cache key on CI

  AnesBenmerzoug

  committed
  d38d4a7

• Merge branch 'develop' into fix/reduce-execution-time-of-tests

  mdbenito

  authored
  03791cc

• Add more detail to contributing doc

  AnesBenmerzoug

  committed
  aa36a88

• Revert back order of n_jobs and loss in compute_data_oob

  AnesBenmerzoug

  committed
  58d17cf

• Update changelog

  AnesBenmerzoug

  committed
  1e799a8

• Fix influence notebooks

  AnesBenmerzoug

  committed
  4fc254c

• Use nbmake to test notebooks

  AnesBenmerzoug

  committed
  83bdc22

• Disable parallel backend logging by default

  AnesBenmerzoug

  committed
  ed6650c

• Rerun least core notebook

  AnesBenmerzoug

  committed
  4115278

• Fix type hint

  AnesBenmerzoug

  committed
  7f81df0

Commits on Oct 27, 2023

• Use tolerate marker on test_future_cancellation

  Show description for aea5404
  AnesBenmerzoug

  committed
  aea5404

• Fix more notebooks to make them work on CI

  AnesBenmerzoug

  committed
  1e435c8

• Use warning instead of logging for message in joblib backend

  AnesBenmerzoug

  committed
  7065173

• Make shapley utility learning notebook work in CI

  AnesBenmerzoug

  committed
  c10d98c

• Set codecov action's verbosity to true

  AnesBenmerzoug

  committed
  f275845

• Specify file to coverage file for codecov action

  AnesBenmerzoug

  committed
  c312268

• Disable verbosity for codecov action

  AnesBenmerzoug

  committed
  49fabc2

• Add codecov badge to readme

  AnesBenmerzoug

  committed
  9342411

• Reorder badges in README

  AnesBenmerzoug

  committed
  f580aa7

• Set sampler seed in test_shapley

  AnesBenmerzoug

  committed
  b57f553

• Update changelog

  AnesBenmerzoug

  committed
  eab28d4

• Fix links to documentation in readme

  AnesBenmerzoug

  committed
  9d3969c

Commits on Oct 29, 2023

• Move --splitting-algorithm parameter to pyproject.toml

  AnesBenmerzoug

  committed
  7a409a4

• Document where the cache fixture is used

  AnesBenmerzoug

  committed
  88a0319

• Add note about when to update test durations

  AnesBenmerzoug

  committed
  549c3dc