Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update netflixoss/metaflow_metadata_service Docker tag to v2.4.13 #27

Open
wants to merge 1 commit into
base: master
Choose a base branch
from

Conversation

renovate[bot]
Copy link
Contributor

@renovate renovate bot commented Apr 13, 2023

This PR contains the following updates:

Package Update Change
netflixoss/metaflow_metadata_service minor v2.3.7 -> v2.4.13

Release Notes

Netflix/metaflow-service (netflixoss/metaflow_metadata_service)

v2.4.13

Compare Source

Improvements

Database table trigger versioning

This release changes the naming of table triggers that the ui_backend sets up to include a timestamp as a version. This allows the backend to recreate table triggers in case any changes need to be deployed, or skip in case of a version match.

⚠️ After deploying this version of the service, do note that in the case of a service rollback, the database will have duplicate table triggers due to older service versions not having any cleanup code for these. In such a case, clean up the remaining triggers manually

Reduced Postgres notify messaging

This release reduces the volume of pg_notify messages that the database sends on table events. There should not be any effect on the average deployment, but for very large deployments running on services like Amazon Aurora, this solves significant performance issues.

Fixes runs starting with a failed status in certain cases

This release fixes an issue with runs starting with a failed status if the Metaflow client version being used had an uncommon version string.

What's Changed

New Contributors

Full Changelog: Netflix/metaflow-service@v2.4.12...v2.4.13

v2.4.12

Compare Source

Upgrade metaflow-ui to v1.3.13

v2.4.11

Compare Source

Improvements

More memory efficient handling of large logs

This release alleviates some of the issues with memory consumption when processing extremely large logs ranging in gigabytes.

What's Changed

Full Changelog: Netflix/metaflow-service@v2.4.9...v2.4.11

v2.4.10

Compare Source

Full Changelog: Netflix/metaflow-service@v2.4.9...v2.4.10

v2.4.9

Compare Source

What's Changed

Full Changelog: Netflix/metaflow-service@v2.4.8...v2.4.9

v2.4.8

Compare Source

What's Changed

New Contributors

Full Changelog: Netflix/metaflow-service@v2.4.7...v2.4.8

v2.4.7

Compare Source

Features

Support realtime cards

This release pins the version of Metaflow UI to v1.3.9 which adds support for realtime cards

Full Changelog: Netflix/metaflow-service@v2.4.6...v2.4.7

v2.4.6

Compare Source

Features

API additions for Metaflow UI

This release adds Metaflow UI API endpoints required for the upcoming realtime cards feature.

Improvements

Issue with goose script for migrations

Fixes a typo that caused the run_goose.py to fail when enabling ssl for the database connection.

What's Changed

New Contributors

Full Changelog: Netflix/metaflow-service@v2.4.5...v2.4.6

v2.4.5

Compare Source

Updating UI version to 1.3.7

v2.4.4

Compare Source

Features

Add configurable separation for read and write pools for the database connection

A separate reader pool of connections can now be configured to point to a different database instance, to split the query load when necessary. This can be configured by the following environment variables

  • USE_SEPARATE_READER_POOL set to "True"
  • MF_METADATA_DB_READ_REPLICA_HOST to the host for the readonly connections.

Configurable SSL support for database connection

The connection to the database can now be configured to utilize SSL if required.
Setup is done with the following environment variables

  • MF_METADATA_DB_SSL_MODE, possible values 'allow', 'prefer', 'require', 'verify-ca', 'verify-full'
  • MF_METADATA_DB_SSL_CERT_PATH Path to cert file
  • MF_METADATA_DB_SSL_KEY_PATH Path to key file
  • MF_METADATA_DB_SSL_ROOT_CERT_PATH Path to CA

Improvements

UI v1.3.6

Updates the bundled UI version to 1.3.6

Update Python base images

Update base images versions to 3.11.6 for added security.

Relax thresholds for marking runs as failed.

In a previous release, in an effort to reduce the weight of database queries, the threshold for marking runs as failed due to an expired heartbeat was set to a very strict 1 minute. While configurable, this meant that by default any run that gets all of its tasks stuck in a scheduler would be marked as failed very quickly.

This release eases the threshold to a more reasonable 6 minutes, while still being fully configurable via the environment variable RUN_INACTIVE_CUTOFF_TIME

What's Changed

New Contributors

Full Changelog: Netflix/metaflow-service@v2.4.3...v2.4.4

v2.4.3

Compare Source

What's Changed

New Contributors

Full Changelog: Netflix/metaflow-service@v2.4.2...v2.4.3

v2.4.2

Compare Source

Improvements

Upgrade Python version to 3.11

After Python 3.7 reaching end of life, all of the services have now been moved over to Python 3.11.

The official Dockerfile has also seen some security upgrades by moving to a smaller base image.

Update bundled Metaflow-UI version to 1.3.3

Metaflow-UI has been updated to 1.3.3. See the Metaflow-UI Release Notes for details.

What's Changed

Full Changelog: Netflix/metaflow-service@v2.4.1...v2.4.2

v2.4.1

Compare Source

Improvements

Fix issue with Metaflow-UI backend and MinIO

The Metaflow client dependency in service v2.4.0 had a bug that affects accessing resources on MinIO. As a result, the Metaflow-UI in v2.4.0 is unable to display logs or artifacts that are hosted with MinIO. This release fixes the underlying issue by depending on a later Metaflow client version.

Fixing deprecations in code base

Fixing various deprecations in the code base in preparation for a Python version upgrade.
Most noteworthy changes being

  • Moving away from using LooseVersion
  • Changing the way metadata-service and migration-service aiohttp processes are initialized.

What's Changed

Full Changelog: Netflix/metaflow-service@v2.4.0...v2.4.1

v2.4.0

Compare Source

Improvements

Improve query performance for Metaflow UI with full indexes

There was an issue with the partial indexes not being used by the Metaflow UI backend queries, resulting in poor performance on platforms with a majority of the resources having string format ID's (e.g. argo-testflow-abc132, sfn-testflow-5abc4, t-123abc).

This release includes a database migration to change the existing partial indexes for resources with string format ID's with full ones.

Considerations

The creation of the indexes in the migration has been set to happen concurrently, so as not to impact regular operations.
Depending on the size of the database this can take a substantial amount of time though, during which higher than average loads can occur as the index is built.

What's Changed

New Contributors

Full Changelog: Netflix/metaflow-service@v2.3.11...v2.4.0

v2.3.11

Compare Source

What's Changed

  • UI v1.3.2 - Fixes realtime updates not working on the timeline for runs with string id's

Full Changelog: Netflix/metaflow-service@v2.3.10...v2.3.11

v2.3.10

Compare Source

  • Update to v1.3.1 of metaflow-ui

Full Changelog: Netflix/metaflow-service@v2.3.9...v2.3.10

v2.3.9

Compare Source

What's Changed

Full Changelog: Netflix/metaflow-service@v2.3.8...v2.3.9

v2.3.8

Compare Source

What's Changed

Full Changelog: Netflix/metaflow-service@v2.3.7...v2.3.8


Configuration

📅 Schedule: Branch creation - At any time (no schedule defined), Automerge - At any time (no schedule defined).

🚦 Automerge: Disabled by config. Please merge this manually once you are satisfied.

Rebasing: Whenever PR becomes conflicted, or you tick the rebase/retry checkbox.

🔕 Ignore: Close this PR and you won't be reminded about this update again.


  • If you want to rebase/retry this PR, check this box

This PR was generated by Mend Renovate. View the repository job log.

@renovate renovate bot changed the title Update netflixoss/metaflow_metadata_service Docker tag to v2.3.8 Update netflixoss/metaflow_metadata_service Docker tag to v2.3.9 Apr 26, 2023
@renovate renovate bot force-pushed the renovate/netflixoss-metaflow_metadata_service-2.x branch from 6fb9030 to 4fe51ca Compare April 26, 2023 21:38
@renovate renovate bot changed the title Update netflixoss/metaflow_metadata_service Docker tag to v2.3.9 chore(deps): update netflixoss/metaflow_metadata_service docker tag to v2.3.10 May 28, 2023
@renovate renovate bot force-pushed the renovate/netflixoss-metaflow_metadata_service-2.x branch from 4fe51ca to f7fc2c4 Compare May 28, 2023 10:20
@renovate renovate bot changed the title chore(deps): update netflixoss/metaflow_metadata_service docker tag to v2.3.10 chore(deps): update netflixoss/metaflow_metadata_service docker tag to v2.3.11 Jun 1, 2023
@renovate renovate bot force-pushed the renovate/netflixoss-metaflow_metadata_service-2.x branch from f7fc2c4 to 85c509d Compare June 1, 2023 08:40
@renovate renovate bot changed the title chore(deps): update netflixoss/metaflow_metadata_service docker tag to v2.3.11 chore(deps): update netflixoss/metaflow_metadata_service docker tag to v2.4.0 Jun 15, 2023
@renovate renovate bot force-pushed the renovate/netflixoss-metaflow_metadata_service-2.x branch from 85c509d to eb705c5 Compare June 15, 2023 21:43
@renovate renovate bot changed the title chore(deps): update netflixoss/metaflow_metadata_service docker tag to v2.4.0 chore(deps): update netflixoss/metaflow_metadata_service docker tag to v2.4.1 Jun 27, 2023
@renovate renovate bot force-pushed the renovate/netflixoss-metaflow_metadata_service-2.x branch from eb705c5 to 6d9aa41 Compare June 27, 2023 18:08
@renovate renovate bot changed the title chore(deps): update netflixoss/metaflow_metadata_service docker tag to v2.4.1 chore(deps): update netflixoss/metaflow_metadata_service docker tag to v2.4.2 Jul 4, 2023
@renovate renovate bot force-pushed the renovate/netflixoss-metaflow_metadata_service-2.x branch from 6d9aa41 to 225ac76 Compare July 4, 2023 00:51
@renovate renovate bot changed the title chore(deps): update netflixoss/metaflow_metadata_service docker tag to v2.4.2 chore(deps): update netflixoss/metaflow_metadata_service docker tag to v2.4.3 Jul 27, 2023
@renovate renovate bot force-pushed the renovate/netflixoss-metaflow_metadata_service-2.x branch from 225ac76 to a7ec719 Compare July 27, 2023 21:58
@renovate renovate bot changed the title chore(deps): update netflixoss/metaflow_metadata_service docker tag to v2.4.3 Update netflixoss/metaflow_metadata_service Docker tag to v2.4.3 Oct 3, 2023
@renovate renovate bot force-pushed the renovate/netflixoss-metaflow_metadata_service-2.x branch from a7ec719 to 04cd6ca Compare October 4, 2023 13:30
@renovate renovate bot changed the title Update netflixoss/metaflow_metadata_service Docker tag to v2.4.3 chore(deps): update netflixoss/metaflow_metadata_service docker tag to v2.4.3 Oct 12, 2023
@renovate renovate bot changed the title chore(deps): update netflixoss/metaflow_metadata_service docker tag to v2.4.3 chore(deps): update netflixoss/metaflow_metadata_service docker tag to v2.4.4 Oct 30, 2023
@renovate renovate bot force-pushed the renovate/netflixoss-metaflow_metadata_service-2.x branch 2 times, most recently from ff4ca74 to dbdeb3e Compare November 3, 2023 18:35
@renovate renovate bot changed the title chore(deps): update netflixoss/metaflow_metadata_service docker tag to v2.4.4 chore(deps): update netflixoss/metaflow_metadata_service docker tag to v2.4.5 Nov 3, 2023
@renovate renovate bot force-pushed the renovate/netflixoss-metaflow_metadata_service-2.x branch from dbdeb3e to 1a97c85 Compare January 18, 2024 21:46
@renovate renovate bot changed the title chore(deps): update netflixoss/metaflow_metadata_service docker tag to v2.4.5 chore(deps): update netflixoss/metaflow_metadata_service docker tag to v2.4.6 Jan 18, 2024
@renovate renovate bot force-pushed the renovate/netflixoss-metaflow_metadata_service-2.x branch from 1a97c85 to b2aa295 Compare January 19, 2024 01:05
@renovate renovate bot changed the title chore(deps): update netflixoss/metaflow_metadata_service docker tag to v2.4.6 chore(deps): update netflixoss/metaflow_metadata_service docker tag to v2.4.7 Jan 19, 2024
@renovate renovate bot force-pushed the renovate/netflixoss-metaflow_metadata_service-2.x branch from b2aa295 to bebd2b3 Compare February 8, 2024 15:58
@renovate renovate bot changed the title chore(deps): update netflixoss/metaflow_metadata_service docker tag to v2.4.7 chore(deps): update netflixoss/metaflow_metadata_service docker tag to v2.4.8 Feb 8, 2024
@renovate renovate bot force-pushed the renovate/netflixoss-metaflow_metadata_service-2.x branch from bebd2b3 to f1b383c Compare February 21, 2024 16:48
@renovate renovate bot force-pushed the renovate/netflixoss-metaflow_metadata_service-2.x branch from f1b383c to a56ab8f Compare March 20, 2024 21:19
@renovate renovate bot changed the title chore(deps): update netflixoss/metaflow_metadata_service docker tag to v2.4.8 chore(deps): update netflixoss/metaflow_metadata_service docker tag to v2.4.9 Mar 20, 2024
@renovate renovate bot force-pushed the renovate/netflixoss-metaflow_metadata_service-2.x branch from a56ab8f to 3f704dc Compare May 2, 2024 16:01
@renovate renovate bot changed the title chore(deps): update netflixoss/metaflow_metadata_service docker tag to v2.4.9 chore(deps): update netflixoss/metaflow_metadata_service docker tag to v2.4.10 May 2, 2024
@renovate renovate bot force-pushed the renovate/netflixoss-metaflow_metadata_service-2.x branch from 3f704dc to 9023809 Compare June 12, 2024 23:25
@renovate renovate bot changed the title chore(deps): update netflixoss/metaflow_metadata_service docker tag to v2.4.10 chore(deps): update netflixoss/metaflow_metadata_service docker tag to v2.4.11 Jun 12, 2024
@renovate renovate bot force-pushed the renovate/netflixoss-metaflow_metadata_service-2.x branch from 9023809 to 331ec7b Compare July 24, 2024 17:23
@renovate renovate bot changed the title chore(deps): update netflixoss/metaflow_metadata_service docker tag to v2.4.11 chore(deps): update netflixoss/metaflow_metadata_service docker tag to v2.4.12 Jul 24, 2024
@renovate renovate bot force-pushed the renovate/netflixoss-metaflow_metadata_service-2.x branch from 331ec7b to a8652cb Compare November 24, 2024 00:52
@renovate renovate bot changed the title chore(deps): update netflixoss/metaflow_metadata_service docker tag to v2.4.12 Update netflixoss/metaflow_metadata_service Docker tag to v2.4.13 Nov 24, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

0 participants