release-829_2024-10-10T12 Add single sign-on and Visualisations, update to PostgreSQL 15, enable PURL on deleted resources

What's Changed

• QOLSVC-5478 add single sign-on plugin to DEV environments by @ThrawnCA in #596
• QOLSVC-7171 update DEV to PostgreSQL 15 by @ThrawnCA in #598
• [QOLDEV-7731] update Open Data theme to include visualisation menu link by @ThrawnCA in #597
• [QOLDEV-933] update CKAN fork to hide deleted resources as well as datasets by @ThrawnCA in #599
• QOLSVC-5478 update SSO plugin by @ThrawnCA in #600
• [QOLSVC-7171] disable database SSL requirement by @ThrawnCA in #601
• [QOLSVC-7171] update all environments to PostgreSQL 15 by @ThrawnCA in #602
• [QOLSVC-5478] enable SSO plugin for all environments by @ThrawnCA in #603
• Develop to master by @ThrawnCA in #604

Full Changelog: release-823_2024-10-01T15...release-829_2024-10-10T12

release-823 CKAN 2.10.5 and PostgreSQL 14, various fixes

What's Changed

• [QOLDEV-863] update cookbook to make Solr sync more robust by @ThrawnCA in #572
• [QOLSVC-7171] update higher environments to PostgreSQL 13 by @ThrawnCA in #574
• Develop to master - update to PostgreSQL 13 by @ThrawnCA in #575
• [QOLSVC-7171] update DEV to PostgreSQL 14 by @ThrawnCA in #576
• [QOLSVC-7171] include DB version in RDS parameter group name by @ThrawnCA in #577
• [QOLSVC-7469] increase size of Solr secondary disk by @ThrawnCA in #579
• [QOLSVC-7171] update all environments to PostgreSQL 14 by @ThrawnCA in #578
• [QOLSVC-7469] fix disk size syntax by @ThrawnCA in #580
• [QOLCHG-696][QOLCHG-697] patch release-808 to pin setuptools version by @ThrawnCA in #581
• [QOLDEV-935] update QGOV plugin to fix sysadmin management via web UI by @ThrawnCA in #583
• [QOLDEV-934] update sandbox to CKAN 2.10.5 base for testing by @ThrawnCA in #584
• [QOLDEV-934] update all DEV environments to CKAN 2.10.5 base by @ThrawnCA in #585
• [QOLSVC-7507] Update cookbook to pin setuptools to supported versions by @ThrawnCA in #582
• QOLSVC-6875 update version on ckanext-data-qld to 7.2.13 by @duttonw in #586
• [QOLDEV-933] update QGOV extension to hide errors handled by PURL by @ThrawnCA in #587
• Develop to master by @ThrawnCA in #588
• [QOLDEV-933] add SSM Parameter Store entry for PURL endpoint by @ThrawnCA in #591
• QOLDEV-933 update CKAN to allow PURL rules for deleted datasets by @ThrawnCA in #593
• [QOLSVC-7171] enable RDS autovacuum by @ThrawnCA in #590
• Sync scenario tests with plugin repos by @ThrawnCA in #589
• [QOLSVC-7731] add more paths to CloudFront CMS origin by @ThrawnCA in #592
• [QOLDEV-933] update SSM Config plugin by @ThrawnCA in #594
• [Snyk] Security upgrade zipp from 3.15.0 to 3.19.1 by @duttonw in #559
• [Snyk] Security upgrade urllib3 from 2.0.7 to 2.2.2 by @duttonw in #547
• [Snyk] Security upgrade urllib3 from 2.0.7 to 2.2.2 by @duttonw in #548
• [Snyk] Security upgrade requests from 2.31.0 to 2.32.0 by @duttonw in #543
• [Snyk] Security upgrade zipp from 3.15.0 to 3.19.1 by @duttonw in #560
• Develop to master by @ThrawnCA in #595

Full Changelog: release-808_2024-08-16T11...release-823_2024-10-01T15

release-808 Make Solr sync more robust, support instance refreshes when needed during deployment

What's Changed

• [QOLDEV-920] replace instances with obsolete launch templates during deployment by @ThrawnCA in #568
• [QOLDEV-920] drop load balancer requirement for instance refreshes by @ThrawnCA in #569
• [QOLDEV-920] speed up instance refreshes by @ThrawnCA in #570
• Develop to master - add support for instance refreshes during deployment by @ThrawnCA in #571
• [QOLDEV-863] update cookbook to make Solr sync more robust by @ThrawnCA in #573

Full Changelog: release-804_2024-08-08T12...release-808_2024-08-16T11

release-804_2024-08-08T12 Fix datastore deadlocks, custom data usability, SMTP relay, Solr HA

What's Changed

• [QOLSVC-6752] update CKAN core to reduce datastore deadlocks by @ThrawnCA in #561
• [QOLDEV-915] update Data theme plugin to fix integration with QA by @ThrawnCA in #562
• [QOLSVC-6955] update cookbook to use newer SMTP relay by @ThrawnCA in #563
• [QOLSVC-6955] update cookbook to use SMTP relay v2 by @ThrawnCA in #565
• Develop to master by @ThrawnCA in #564
• [QOLDEV-863] update cookbook to fix Solr replication by @ThrawnCA in #566
• Develop to master - fix Solr HA by @ThrawnCA in #567

Full Changelog: release-794_2024-07-09T15...release-804_2024-08-08T12

release-794 Upgrade to WAFv2 and Amazon Linux 2023

What's Changed

• [QOLDEV-908] move WAF stack to global region by @ThrawnCA in #557
• [QOLDEV-892] update all environments to Amazon Linux 2023 by @ThrawnCA in #556
• Develop to master by @ThrawnCA in #558

Full Changelog: release-792_2024-07-02T13...release-794_2024-07-09T15

release-792 Prepare cookbook for Amazon Linux 2023

What's Changed

• [QOLDEV-545] allow Solr servers to access their Parameter Store values by @ThrawnCA in #506
• QOLDEV-817 add lambda function to run instance setup commands by @ThrawnCA in #508
• QOLDEV-817 fix incorrect reference and clean up by @ThrawnCA in #509
• [QOLDEV-818] add hosted zone to Parameter Store as a shared parameter by @ThrawnCA in #510
• [QOLDEV-818] specify zone name manually by @ThrawnCA in #511
• [QOLDEV-818] update cookbook to fix reliance on Parameter Store by @ThrawnCA in #513
• [QOLDEV-817] add an SNS topic to trigger the deployment function by @ThrawnCA in #514
• [QOLSVC-5551] update XLoader to preserve datastore IDs by @ThrawnCA in #512
• [QOLDEV-817] fix Lambda reference to retrieve ARN instead of name by @ThrawnCA in #516
• [QOLDEV-817] drop obsolete SNS topic associated with Lambda by @ThrawnCA in #517
• QOLDEV-819 add autoscaling groups alongside fixed instances by @ThrawnCA in #518
• [QOLDEV-818] update cookbook by @ThrawnCA in #520
• [QOLDEV-821] update cookbook to allow Grants stored procedure by @ThrawnCA in #521
• QOLDEV-819 fix Solr instance security config by @ThrawnCA in #519
• [QOLDEV-819] tag the application load balancer as being in the web layer by @ThrawnCA in #522
• [QOLDEV-833] use custom AMI as a basis for Open Data web instances by @ThrawnCA in #523
• QOLDEV-819 adjust deployment to handle OpsWorks instances separately from autoscaling groups by @ThrawnCA in #526
• [QOLDEV-819] skip deploying to instances that are no longer running by @ThrawnCA in #527
• [QOLDEV-839] remove dependencies on OpsWorks stack by @ThrawnCA in #528
• QOLDEV-819 exit deployment if instance refresh fails to start by @ThrawnCA in #529
• [QOLSVC-3902] update XLoader to slightly increase deadlock timeouts by @ThrawnCA in #525
• [QOLDEV-833] use custom AMIs for Open Data DEV batch and Solr instances by @ThrawnCA in #524
• QOLDEV-819 refine autoscaling deployments by @ThrawnCA in #531
• QOLDEV-818 fix instance permissions by @ThrawnCA in #532
• [QOLDEV-818] pull instances out of standby even if deployment fails by @ThrawnCA in #533
• QOLDEV-819 clean up scaling config by @ThrawnCA in #534
• [QOLDEV-545] update cookbook and plugins for cleaner deployments by @ThrawnCA in #535
• Develop to master - replace OpsWorks with autoscaling groups by @ThrawnCA in #536
• [QOLCHG-590] update QA plugin to revert Snyk patch we're not ready for by @ThrawnCA in #537
• [QOLDEV-819] specify default web instance count in Jinja by @ThrawnCA in #539
• Develop to master - update QA to revert Snyk patch by @ThrawnCA in #538
• [QOLDEV-833] use bare-bones custom AMI by @ThrawnCA in #530
• [QOLDEV-819] exclude Solr instances from power management by @ThrawnCA in #541
• [QOLDEV-839] drop OpsWorks resources (stack and layers) and documentation references by @ThrawnCA in #542
• [QOLDEV-867] add autoscaling policy to target 50% CPU utilisation by @ThrawnCA in #545
• QOLDEV-892 update sandbox to Amazon Linux 2023 by @ThrawnCA in #549
• [QOLDEV-892] update all DEV environments to Amazon Linux 2023 by @ThrawnCA in #550
• [QOLDEV-892] update cookbook to support Amazon Linux 2023 by @ThrawnCA in #551
• QOLDEV-867 make deployments handle autoscaling more robustly by @ThrawnCA in #552
• [QOLDEV-902] update Archiver to ensure QA runs on uploaded files by @ThrawnCA in #553
• [QOLDEV-892] update cookbook to retain support Amazon Linux 2 by @ThrawnCA in #554
• QOLDEV-892 update Chef client and improve handling of instances already in Standby by @ThrawnCA in #555
• Develop to master - clean up OpsWorks replacement by @ThrawnCA in #546

Full Changelog: release-773_2024-04-05T12...release-792_2024-07-02T13

release-773 Fix Data Tables views, manage Solr via Supervisord

What's Changed

• [QOLDEV-545] refactor stack template by @ThrawnCA in #500
• [QOLDEV-545] update cookbook by @ThrawnCA in #501
• [QOLSVC-5373] update Resource Type Validation plugin by @ThrawnCA in #503
• [QOLSVC-5373] update cookbook to pin 'typer' on live systems by @ThrawnCA in #504
• [QOLDEV-749] update CKAN fork to enable en_AU locale in Data Tables by @ThrawnCA in #505
• Develop to master by @ThrawnCA in #502

Full Changelog: release-769_2024-04-03T15...release-773_2024-04-05T12

release-769 Restore custom JSON alongside SSM parameters

What's Changed

• [QOLDEV-545] replace OpsWorks custom JSON with SSM parameters by @ThrawnCA in #493
• Develop to master - fix site title and add SSM parameters by @ThrawnCA in #494
• [QOLDEV-545] add Chef cookbook source to Parameter Store by @ThrawnCA in #495
• QOLDEV-545 split stack template to fit both custom JSON and Parameter Store values by @ThrawnCA in #497
• [QOLDEV-545] move instance profiles back to their original stack by @ThrawnCA in #498
• [QOLDEV-749] update CKAN fork to fix data tables view by @ThrawnCA in #492
• Develop to master - fix OpsWorks setup by @ThrawnCA in #499

Full Changelog: release-766_2024-03-21T12...release-769_2024-04-03T15

Convert deployments to use Systems Manager instead of OpsWorks

What's Changed

• [QOLDEV-545] tag instances with the name of the layer they're in by @ThrawnCA in #472
• [QOLDEV-545] provide the site URL via Chef custom JSON by @ThrawnCA in #473
• [QOLDEV-545] add app sources to OpsWorks custom JSON by @ThrawnCA in #474
• [QOLDEV-545] fix app source parameter name by @ThrawnCA in #475
• QOLDEV-545 drop unnecessary cookbook parameters by @ThrawnCA in #476
• [QOLDEV-545] add Ansible playbook to generate Chef custom JSON for stack by @ThrawnCA in #477
• [QOLDEV-545] add capabilities to Chef deployment script by @ThrawnCA in #478
• [QOLDEV-545] update cookbook to remove OpsWorks dependency by @ThrawnCA in #479
• QOLDEV-545 Replace OpsWorks deployment script with Systems Manager script by @ThrawnCA in #480
• [QOLSVC-5162] increase Solr instance sizes by @ThrawnCA in #481
• [QOLDEV-545] update cookbook to fix deployment errors by @ThrawnCA in #482
• [QOLSVC-5123] update XLoader to handle imperfect files more robustly by @ThrawnCA in #484
• QOLDEV-545 build patching by @ThrawnCA in #485
• [QOLDEV-744] update CKAN fork to 2.10.4 branch in DEV environments by @ThrawnCA in #486
• [QOLDEV-545] update cookbook to fix Icinga deployment errors by @ThrawnCA in #488
• [QOLDEV-744] update CKAN fork to 2.10.4 in higher environments by @ThrawnCA in #487
• Develop to master - reduce dependence on OpsWorks by @ThrawnCA in #483
• [QOLCHG-538] update Validation Schema Generator by @ThrawnCA in #490
• [QOLSVC-4988] update S3 Filestore plugin by @ThrawnCA in #489
• Develop to master - patch plugins by @ThrawnCA in #491

Full Changelog: release-754_2024-02-21T10...release-766_2024-03-21T12

Fix custom dataset types on trash screen

What's Changed

• [QOLDEV-727] update CKAN core to fix trash page by @ThrawnCA in #470
• Develop to master - fix Trash screen by @ThrawnCA in #471

Full Changelog: release-753_2024-02-20T11...release-754_2024-02-21T10