Release 0.3.0

[tatiana]

Breaking changes

• Removal of SubmitRayJob.terminal_states. The same values are now available at ray_provider.constants.TERMINAL_JOB_STATUSES.
• Simplify the project structure and debugging by @tatiana in Simplify the project structure and debugging #93

In order to improve the development and troubleshooting DAGs created with this provider, we introduced breaking changes
to the folder structure. It was flattened and the import paths to existing decorators, hooks, operators and trigger
changed, as documented in the table below:

Type	Previous import path	Current import path
Decorator	ray_provider.decorators.ray.ray	ray_provider.decorators.ray
Hook	ray_provider.hooks.ray.RayHook	ray_provider.hooks.RayHook
Operator	ray_provider.operators.ray.DeleteRayCluster	ray_provider.operators.DeleteRayCluster
Operator	ray_provider.operators.ray.SetupRayCluster	ray_provider.operators.SetupRayCluster
Operator	ray_provider.operators.ray.SubmitRayJob	ray_provider.operators.SubmitRayJob
Trigger	ray_provider.triggers.ray.RayJobTrigger	ray_provider.triggers.RayJobTrigger

Features

• Support using callable config in @ray.task by @tatiana in Support using callable config in @ray.task #103
• Support running Ray jobs indefinitely without timing out by @venkatajagannath and @tatiana in Support running Ray jobs indefinitely without timing out #74

Bug fixes

• Fix integration test and bug in load balancer wait logic by @pankajastro in Fix integration test and bug in load balancer wait logic #85
• Bugfix: Better exception handling and cluster clean up by @venkatajagannath in Bugfix: Better exception handling and cluster clean up #68
• Stop catching generic Exception in operators by @tatiana in Stop catching generic Exception in operators #100
• Stop catching generic Exception in trigger by @tatiana in Fix running make docker-run when there is a new version #99

Docs

• Add docs to deploy project on Astro Cloud by @pankajastro in [Docs] Add docs to deploy project on Astro Cloud #90
• Fix dead reference in docs index page by @pankajastro in [Docs] Fix dead reference in docs index page #87
• Cloud Auth documentation update by @venkatajagannath in Documentation changes -- Cloud Auth #58
• Improve main docs page by @TJaniF in Small main docs page edits #71

Others

Local development

• Fix the local development environment and update documentation by @tatiana in Fix the local development environment and update documentation #92
• Enable secret detection precommit check by @pankajastro in Enable secrect detection precommit check #91
• Add astro cli project + kind Raycluster setup instruction by @pankajastro in Add astro cli project + kind Raycluster setup instruction #83
• Remove pytest durations from tests by @tatiana in Remove pytest durations from tests #102
• Fix running make docker-run when there is a new version by @tatiana in Fix running make docker-run when there is a new version #99 and Fix Makefile #101
• Improve Astro CLI DAGs test so running hatch test-cov locally doesn't fail by @tatiana in Improve Astro CLI DAGs tests so hatch test-cov doesn't fail #97

CI

• CI improvement by @venkatajagannath in Bug fix: Minor change to earlier PR #73
• CI fix related to broken coverage upload artifact by @pankajkoti in Attempt CI fix wrt broken coverage upload artifact #60
• Allow tests to run for PRs from forked repos by @venkatajagannath in Bug fix: Allowing tests to run for PRs from forked repos #72
• Update CODEOWNERS by @tatiana in Update CODEOWNERS #84
• Add Airflow 2.10 (released in August 2024) to tests by @tatiana in Add Airflow 2.10 (released in August 2024) to tests #96

[codecov-commenter]

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 98.03%. Comparing base (56387cc) to head (18974b4).

Additional details and impacted files

@@            Coverage Diff             @@
##             main     #104      +/-   ##
==========================================
- Coverage   98.52%   98.03%   -0.50%     
==========================================
  Files           7        7              
  Lines         610      610              
==========================================
- Hits          601      598       -3     
- Misses          9       12       +3     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

[tatiana]

I validated the release by running all the DAGs using our local development setup.

They all passed and worked as expected:

I contacted an Astro customer who has been trying out the provider, sharing an alpha release two days ago, but we didn't hear back. We can fix any issues in micro releases if needed.