fix: group 4 causes standardise-validate task to fail sometimes

linz · Dec 3, 2024 · 035b6fd · 035b6fd
1 parent 059f120
commit 035b6fd
Show file tree

Hide file tree

Showing 2 changed files with 10 additions and 12 deletions.
diff --git a/workflows/raster/README.md b/workflows/raster/README.md
@@ -296,17 +296,15 @@ Publishing to the AWS Registry of Open Data is an optional step [publish-odr](#P
 
 ## Workflow Input Parameters
 
-| Parameter          | Type | Default                                                                                     | Description                                                                                                                                                                                                                                                       |
-| ------------------ | ---- | ------------------------------------------------------------------------------------------- | ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- |
-| config-file        | str  | https://raw.githubusercontent.com/linz/basemaps-config/master/config/tileset/elevation.json | Location of the configuration file listing the source datasets to merge.                                                                                                                                                                                          |
-| odr_url            | str  |                                                                                             | (Optional) If an existing dataset add the S3 path to the dataset here to load existing metadata e.g. "s3://nz-elevation/new-zealand/new-zealand/dem_1m/2193/"                                                                                                     |
-| source_epsg        | str  | 2193                                                                                        | The EPSG code of the source imagery                                                                                                                                                                                                                               |
-| target_epsg        | str  | 2193                                                                                        | The target EPSG code - if different to source the imagery will be reprojected                                                                                                                                                                                     |
-| group              | 4    |                                                                                             | How many output tiles to process in each standardising task "pod". Change if you have resource or performance issues when standardising a dataset.                                                                                                                |
-| collection_id      | 4    |                                                                                             | Collection ID of the existing National DEM collection.                                                                                                                                                                                                            |
-| publish_to_odr     | str  | false                                                                                       | Run [publish-odr](#Publish-odr) after standardising has completed successfully                                                                                                                                                                                    |
-| target_bucket_name | enum |                                                                                             | Used only if `publish_to_odr` is true. The bucket name of the target ODR location                                                                                                                                                                                 |
-| copy_option        | enum | --no-clobber                                                                                | Used only if `publish_to_odr` is true.<dl><dt>`--no-clobber` </dt><dd> Skip overwriting existing files.</dd><dt> `--force` </dt><dd> Overwrite all files. </dd><dt> `--force-no-clobber` </dt><dd> Overwrite only changed files, skip unchanged files. </dd></dl> |
+| Parameter      | Type | Default                                                                                     | Description                                                                                                                                                                                                                                                       |
+| -------------- | ---- | ------------------------------------------------------------------------------------------- | ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- |
+| config-file    | str  | https://raw.githubusercontent.com/linz/basemaps-config/master/config/tileset/elevation.json | Location of the configuration file listing the source datasets to merge.                                                                                                                                                                                          |
+| odr_url        | str  |                                                                                             | (Optional) If an existing dataset add the S3 path to the dataset here to load existing metadata e.g. "s3://nz-elevation/new-zealand/new-zealand/dem_1m/2193/"                                                                                                     |
+| source_epsg    | str  | 2193                                                                                        | The EPSG code of the source imagery                                                                                                                                                                                                                               |
+| target_epsg    | str  | 2193                                                                                        | The target EPSG code - if different to source the imagery will be reprojected                                                                                                                                                                                     |
+| group          | 2    |                                                                                             | How many output tiles to process in each standardising task "pod". Change if you have resource or performance issues when standardising a dataset.                                                                                                                |
+| publish_to_odr | str  | false                                                                                       | Run [publish-odr](#Publish-odr) after standardising has completed successfully                                                                                                                                                                                    |
+| copy_option    | enum | --no-clobber                                                                                | Used only if `publish_to_odr` is true.<dl><dt>`--no-clobber` </dt><dd> Skip overwriting existing files.</dd><dt> `--force` </dt><dd> Overwrite all files. </dd><dt> `--force-no-clobber` </dt><dd> Overwrite only changed files, skip unchanged files. </dd></dl> |
 
 ### Example Input Parameters
 

diff --git a/workflows/raster/national-dem.yaml b/workflows/raster/national-dem.yaml
@@ -46,7 +46,7 @@ spec:
         value: '2193'
       - name: group
         description: 'How many output tiles to process in each standardising task "pod". Change if you have resource or performance issues when standardising a dataset.'
-        value: '4'
+        value: '2'
       - name: publish_to_odr
         description: 'Create a Pull Request for publishing to imagery or elevation ODR bucket'
         value: 'false'