Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Feat] temporal: allow appending to existing STDS #3427

Open
17 tasks
ninsbl opened this issue Feb 16, 2024 · 0 comments
Open
17 tasks

[Feat] temporal: allow appending to existing STDS #3427

ninsbl opened this issue Feb 16, 2024 · 0 comments
Labels
enhancement New feature or request module Python Related code is in Python temporal Related to temporal data processing
Milestone

Comments

@ninsbl
Copy link
Member

ninsbl commented Feb 16, 2024

Space Time Data Sets (STDS) are type of datas that regularly needs to be updated / extended, when new data comes in.

So far, temporal modules do allow to generate new STDS, but not to append to pre-existing STDS (generated in an earlier run of the module). So, in order to extend / update an existing STDS with a repeated run of a module, users would have to create new STDS and then register the resulting raster or vector maps into the earlier generated STDS.

It would be much more convenient for users if temporal modules that create STDS whould be able to extend / update pre-existing STDS.

Describe the solution you'd like
Temporal modules would have to be adjusted to:

  1. Allow output STDS of temporal modules to exists (those that have an output option, not an expression)
  2. Possibly add a flag for appending to an existing STDS (and require "ovwerwrite")
  3. Possibly ignore meta information (title, description) if STDS exists (if the module provides those options
  4. Check that the module run is "compatible" with the STDS to append to (granularity, method, expression, ...)
  5. Update the STDS history accordingly (do not overwrite it)
  6. Maybe add a standard parser option that accepts both old and new STDS input

The following core modules would likely be relevant:

Modules like t.rast.gapfill, t.snap, or t.shift may already contain relevant code as they update / modify existing STDS...

@ninsbl ninsbl added enhancement New feature or request temporal Related to temporal data processing Python Related code is in Python module labels Feb 16, 2024
@ninsbl ninsbl added this to the 8.5.0 milestone Feb 16, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request module Python Related code is in Python temporal Related to temporal data processing
Projects
None yet
Development

No branches or pull requests

2 participants
@ninsbl and others