Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Postgres/PostGIS integration #57

Open
alxmrs opened this issue Sep 4, 2024 · 5 comments
Open

Postgres/PostGIS integration #57

alxmrs opened this issue Sep 4, 2024 · 5 comments

Comments

@alxmrs
Copy link
Owner

alxmrs commented Sep 4, 2024

https://overcast.fm/+AAU1XJb7r0Y/9:25

Can Xarrat/Zarr be hooked up to PostGIS as out DB rasters?

Some notes:

  • raster2pg
  • 8kb page size, 32x32 pixels.
  • Want a tile size to match your expected query size
@alxmrs
Copy link
Owner Author

alxmrs commented Sep 4, 2024

  • postgisRaster

@alxmrs
Copy link
Owner Author

alxmrs commented Sep 4, 2024

Storage module (tiles) is bottleneck; lack of elastic parallelism.

https://overcast.fm/+AAU1XJb7r0Y/23:07

@alxmrs
Copy link
Owner Author

alxmrs commented Sep 4, 2024

Further down this clip: row focus in query plan means a lack of efficient parallelism with raster data. To me, there is an analogy with Dask indexes, and the creation of special “pivoted raster” indexes as in #26 (comment).

@alxmrs
Copy link
Owner Author

alxmrs commented Oct 10, 2024

It looks like TimeScale DB may be a good skew if Postgres to test an Xarray integration; they seem to have adopted a Zarr-like data model within Postgres internals.

https://github.com/timescale/docs.timescale.com-content/blob/master/introduction/architecture.md

@cisaacstern
Copy link
Collaborator

Second time timescale has come across my radar this week; haven't looked into it yet but intrigued!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants