Releases: OriHoch/data4dappl
Releases · OriHoch/data4dappl
v0.1.1
Changelog
data pipelines
- added pipelines dashboard (requires authentication): https://www.odata.org.il/pipelines
- added web interface to browse and download CKAN storage files: https://pipelines.odata.org.il/ckan/data/
upload via email monitoring and alerts
- added monitoring service which checks the pipelines status every 20 seconds
- the following notifications are sent to Hasadna slack channel odata-notifications:
- failure - for the first failure only
- succeeded - for the first success after the last error
- created datasets - with links to the created datasets
- processed messages - messages were processed but no datasets were created
- the details of each event are in a json file which is attached to the message
- all json files can be browsed here - https://pipelines.odata.org.il/ckan/data/pipelines/upload_via_email/errors/ (requires authorization)
Minor changes / bug-fixes
- automatically updated resources shouldn't appear in recent datasets feeds #96
- fix #90 - problem with notification emails from upload via email, ckanext-upload_via_email v0.0.8
v0.0.9
New Features
- #71 Imported entities (רשויות) from foi.gov.il site - https://www.odata.org.il/group
- foi gov il entities have extra details here - https://www.odata.org.il/group/about/taxes
- This is the first step towards a unified entities database of entities from various external sources
- #59 foi entities have an option to send foi requests via mail or external form, this is available on the sidebar in the entitiy page - https://www.odata.org.il/group/taxes
- Updated arabic translations
Bug Fixes
Notes
- required configuration for the foi gov import:
ckanext.odata_org_il.foi_groups_matching_resource_id- value should be a private resource containing the foi groups matching data
- Resource is available on odata at https://www.odata.org.il/dataset/matching-entities-to-groups (private)
v0.0.8
New Features
- #58 Upload via email (allowed senders are configured in this private resource
- all supported tabular resources are added to datastore DB, allowing to show the data in preview page, e.g. https://www.odata.org.il/dataset/73a4232c-0978-460f-8c98-58c59aeec7ef/resource/654fa158-5617-403f-89c7-a33b2ac50664
- public resources are available on Hasadna Redash, under source odata.org.il, each table name corresponds to odata resource id, for example - https://app.redash.io/hasadna/queries/132628
- misc. performance and stability improvements
Bug Fixes
- fix missing font files - causing missing icons in file uploader ui
Detailed Changelog
- upgrade file uploader ui to support xloader for private resources
- misc. upgrades and improvements to docker files
- datastore db: added script to set permissions on datastore tables of public resources only to publicreadonly role - used hasadna redash
v0.0.7
New Features
- upgrade to ckan 2.8.1 - improved UI, performance and security patches
- #57: drag & drop / upload multiple files at once
- #45: add rss and facebook icons to footer
- #47: add RSS icon to group and organization pages
Bug Fixes
- #60: link to resource from dataset page should open in new tab
- #51: fix right to left alignments in english site
- #49: revert colors to ckan default theme
Technical Changes / Notes
- integrated db backup to the k8s cluster (see changes in hasadna-k8s repo)
- Switched to gunicorn for serving the app
v0.0.6
New Features
- #43 dataset page: link to resource should download the resource data
- #44 dataset page: add facebook comments
- #46 add credit for Israel Internet Association
- #50 homepage popular tags should show random tags which have more then 20 datasets
Bug Fixes
- #48 fix items displayed in latest updates on homepage
- #55 fix handling of comma in hebrew keyboard when entering tags for a dataset
- prevent aggressive bots from overloading the site (set crawl-delay in robots.txt)
Technical changes / notes
v0.0.5
- update to ckan 2.7.2 with fix for attachment of members to groups - OriHoch/ckan@4a75c0d
- added latest datasets display on homepage
- added documenation regarding updating the search index
v0.0.4
- Block Google from indexing the site in other languages #24
- Kubernetes deployment
- Add credit for The Public Knowledge Workshop in footer (they donated servers)
- fix a general bug with the new server, hopefully it solves #32 and the upload button which disappeared, and possibly other bugs
- upgrade to ckan 2.7.2 + remove homepage items
- Added sentence in about page regarding license
- update header colors and logo