All notable changes to this project will be documented in this file.
The format is based on Keep a Changelog and this project adheres to Semantic Versioning
1.4.1_ - 2022-09-20
- Use requirements.txt instead of pip-requirements.txt (still working via symlink) 8ed1eca
- Bump pyopenssl requirement to avoid requirements error on install 98edcd3
- Fixes unicode error in Python 2 #502
- Fixes in email notification sendngi #499, #505
- Fix pagination for Dataset list on source page #504
1.4.0_ - 2022-04-20
- Add ckan.harvest.not_overwrite_fields #472
- Support for Bootstrap 5 templates #490
- Support for CKAN 2.10 #492 #496
- Fix JSONDecode error #489
- Check if email exists before sending notification #498
1.3.4_ - 2022-01-24
- Changes function calls to render_jinja2 over to render as the former is no longer used. #459
- Set the default value for MQ_TYPE to redis #463
- Add option keep-current to clearsource_history command #484
- Fix JSON serialization for Python3 #450
- Make Rehavest and Clear buttons work again #452
- Fix error when running run-test #466
- Fix timeout calculation #482
- Fix harvest extras for packages #458
1.3.3_ - 2021-03-26
- Migrate tests from Travis CI to GitHub Actions
- Optimize last error free job detection #437
- Improve timeout detection #431
- Check if Redis key is available #432
- Include webassets.yml in MANIFEST
1.3.2 - 2020-10-08
- Calculate timeouts based on last finished object instead of job creation time #418
- Fix resubmitting harvest objects to Redis fetch queue #421
1.3.1 - 2020-09-01
- Abort failed jobs CLI command #398
- Fix Redis conflict with core workers
- Fix harvest source list reference
- Fix and improve test suite, remove nose tests
1.3.0 - 2020-06-04
- Support for Python 3 #392
- Add option for job timeout #403
- Add support for limiting number of results and filtering by organization in harvest_source_list #403
- Fix support for different Redis client libraries #403
- Fix force_import option in run_test command #402
- Fix show object #395
- Fix handling of exceptions in controller #390
1.2.1 - 2020-01-22
- Support
not modified
status for objects #385 - New
force-import
flag for therun_test
command #385
- Get message from harvest_object_error-dict #381
- Fix Admin link appearing to non authorized users #389
- Capture Redis Exceptions #385
1.2.0 - 2019-11-01
- Apply flake8 to be PEP-8 compliant #354
- Use ckantoolkit to clean up imports #358
- Add hook to extend the package dict in CKAN harvester
- Use CKAN core ckan.redis.url setting if present
- Remove database migration code targeting ancient versions #376
- (In the unlikely event that you need to upgrade from one
- of the previous DB versions just apply the changes removed on the linked PR manually)
- harvest_source_type_exists validator should not fail if Harvester has no
info()
method #338 - Fix SSL problems for old versions of Python 2.7.x #344
- Add an 'owner_org' to the v3 package migration #348
- Fix harvest request exceptions #357
- Fix wrong toolkit reference 8e862c8
- Mark early errored jobs as finished 5ad6d86
- Resubmit awaiting objects in the DB not on Redis 5ffe6d4
1.1.4 - 2018-10-26
- Fix nav link
1.1.3 - 2018-10-26
- Reduce usage of c vars (CKAN 2.9)
1.1.2 - 2018-10-25
- Send harvest-error-mails to organization-admins #329
- CKAN Harvester option to include/exclude groups #323
- Use Redis password from configuration when present #332
- Support for CKAN 2.9
- Ensures the AND operator for fq in solr #335
- Fix styling issues on Bootstrap 3
1.1.1 - 2018-06-13
- Move CKANHarvester._last_error_free_job to HarvesterBase.last_error_free_job #305
- Add the CSS classes for FontAwesome 4.x #313
- Add config option for dataset name append type #327
- Send error mail to admin when harvesting fails #244
- Readme test tip ckan parameter #318
- Fix handling of
clean_tags
options for tag lists and dicts #304 - Don't delete all solr documents/fail to index harvesters when harvest config blank #315
- Fix print statements to be Py3 friendly #328
1.1.0 - 2017-11-07
- Button on harvest admin page to abort running jobs #296
- Test improvements for harvester config #288
- Use package_search API for count of datasets #298
- Catch sqlalchemy.exc.DatabaseError instead of sqlalchemy.exc.OperationalError in
gather_callback
#301
- Fix default_extras initialization #290
- Travis build (postgres service, checkout of correct CKAN branch, libcommons-fileupload) #297
1.0.0 - 2017-03-30
- Includes i18n directory in package.
- Adds a new
clearsource_history
command/operation. - Adds new parameter
return_last_job_status
toharvest_source_list
- Documentation for logs API
gather_stage
return empty list instead of None if errors occured- Change
redirect
calls toh.redirect_to
- Fix namespace package declarations
- Only purge own data when calling
queue_purge
with redis - Fix
default_groups
behavior
0.0.5 - 2016-05-23
- Adds
HarvestLog
to log to database - Adds a new
clean_harvest_log
command to clean the log table
- This release removes support for CKAN <= 2.0
0.0.4 - 2015-12-11
- Adds
_find_existing_package
method to allow harvesters extending theHarvesterBase
to implement their own logic to find an existing package - Adds support for
ITranslation
interface - Adds special CSS class to datetimes in frontend to enable localisation to the users timezone
- Make statistics keys consistent across all actions
- Remove
harvest_source_for_a_dataset
action
0.0.3 - 2015-11-20
- Fixed queues tests
0.0.2 - 2015-11-20
- Namespace redis keys to avoid conflicts between CKAN instances
0.0.1 - 2015-11-20
- Adds clear source as a command
- Adds specific exceptions instead of having only the generic
Exception
- Catch 'no harvest job' exception
Added
for new features.Changed
for changes in existing functionality.Deprecated
for once-stable features removed in upcoming releases.Removed
for deprecated features removed in this release.Fixed
for any bug fixes.Security
to invite users to upgrade in case of vulnerabilities.