hubValidations 0.10.0

• Added check_tbl_derived_task_id_vals() check to validate_model_data() that ensures that values in derived task ID columns match expected values for the corresponding derived task IDs in the round as defined in tasks.json config (#110). Given the dependence of derived task IDs on the values of their source task ID values, the check ignores the combinations of derived task ID values with those of other task IDs and focuses only on identifying values that do not match corresponding accepted values.
• submission_tmpl() gains the force_output_types allowing users to force optional output types to be included in a submission template when required_vals_only = TRUE. In conjunction with the use of the output_types argument, this allows users to create submission templates which include optional output types they plan to submit.
• check_tbl_values_required() no longer reports false positives for v4 hubs, which fixes the bug reported in #177. Evaluation of whether all combinations of required values have been submitted through check_tbl_values_required() is now chunked by output type for v4 config and above. This reduces memory pressure and should speed up required value validation in hubs with complex task.json files.

PRs in this Release

• Increment version number to 0.9.0.9000 by @annakrystalli in #172
• Post v4 release cleanup by @annakrystalli in #173
• 🐛 Separate v4 req vals checks by output type. Resolves #177 by @annakrystalli in #178
• Surface force_output_types in submission_tmpl. Resolves #162 by @annakrystalli in #175
• Add check_tbl_derived_task_id_vals() function by @annakrystalli in #176
• Release version 0.10.0 by @zkamvar in #179

Full Changelog: v0.9.0...v0.10.0

hubValidations 0.9.0

• Re-exported functions useful for modelers (#149):
  • hubUtils::read_config() and hubUtils::read_config_file() for reading in hub configuration files.
  • hubData::create_hub_schema() and hubData::coerce_to_hub_schema() for creating and coercing data to the hub schema.
• Validation of v4 hubs now fully supported (#155, #156, #159). This includes:

• support for the v4 specification of output_type_ids.
• use of the new is_required property to determine whether output types are required or not.
• derived_task_ids are now extracted from the tasks.json config by default.

See the schemas repository NEWS.md for more details.

hubValidations 0.8.0

• Custom checks no longer fail if validation is run outside of the root of the hub (#141)
• Downgrade result of missing model metadata file check from check_error to check_failure and suppress early return in case of check failure in validate_model_file() (#138).
• Add check_file_n() function to validate that the number of files submitted per round does not exceed the allowed number of submissions per team (#139).
• Ignore NAs in relevant tbl columns in opt_check_tbl_col_timediff() and opt_check_tbl_horizon_timediff() checks to ensure rows that may not be targeting relevant to modeling task do not cause false check failure. (#140).

PRs in this Release

• Increment version number to 0.7.1.9000 by @zkamvar in #136
• Downgrade missing metadata file to <check_failure> when validation model output files. (#138) by @annakrystalli in #144
• Check that n of model output files per round per team sans ext does not exceed accepted n (#139) by @annakrystalli in #145
• Allow for NA values in optional horizon time difference checks (#140) by @annakrystalli in #146
• Update exec_cfg_check to use config source path relative to the hub root by @zkamvar in #142
• Release v0.8.0 by @zkamvar in #152

Full Changelog: v0.7.1...v0.8.0

hubValidations 0.7.1

• Updated documentation for custom validations:
  • new vignette on how to create custom validation checks for hub validations (#121)
  • new section on how to manage additional dependencies required by custom validation functions (#22).
• Bolstered parsing of file names inparse_file_name():
  • ensure filenames are composed of letters, numbers, and underscores (#132).
  • added more fine-grained check error messages to identify portion of file name that errored.

PRs contributing to this release

• Increment version number to 0.7.0.9000 by @annakrystalli in #126
• skip submit window check by @zkamvar in #129
• Writing custom check functions vignette by @annakrystalli in #127
• Fix file name parse error (#132) by @annakrystalli in #133
• Release 0.7.1 by @annakrystalli in #134

Full Changelog: v0.7.0...v0.7.1

hubValidations 0.7.0

What's Changed

• Update Workflows by @zkamvar in #120
• Add create_custom_check() function by @annakrystalli in #122
• Fix required vals check bug by @annakrystalli in #124
• Release 0.7.0 by @annakrystalli in #125

Full Changelog: v0.6.2...v0.7.0

hubValidations 0.6.2

What's Changed

• Improve hub_validations print method by @annakrystalli in #116
• Change check fail class and print method by @annakrystalli in #114
• Ak/clean up hub_validation print output. Deprecate file_modification_check argument "warn" by @annakrystalli in #117
• Fix bug where multi-class cols were causing exec error. Resolves #118 by @annakrystalli in #119

Full Changelog: 0.5.1...v0.6.2

hubValidatons 0.5.1

What's Changed

• Bump minimum arrow version to CRAN 17.0.0 by @annakrystalli in #112

Full Changelog: 0.5.0...0.5.1