Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

GEOGLAM September & October 2024 #173

Open
j08lue opened this issue Oct 4, 2024 · 3 comments
Open

GEOGLAM September & October 2024 #173

j08lue opened this issue Oct 4, 2024 · 3 comments

Comments

@j08lue
Copy link
Contributor

j08lue commented Oct 4, 2024

Like #167

Link to data:

@j08lue j08lue changed the title GEOGLAM September 2024 GEOGLAM September & October 2024 Nov 7, 2024
@j08lue
Copy link
Contributor Author

j08lue commented Nov 7, 2024

To try something new, I just uploaded these files to the staging bucket:

  • s3://veda-data-store-staging/geoglam/CropMonitor_202409.tif
  • s3://veda-data-store-staging/geoglam/CropMonitor_202410.tif

@smohiudd or @anayeaye, can you please check whether these files get picked up automatically from there?

Btw, I also by uploaded a file to this key: s3://veda-data-store-staging/veda-data-store-staging/geoglam/CropMonitor_202410.tif (note the double veda-data-store-staging). I do not have permission to aws s3 rm it. Can you do that, please?

Good illustration that folks need guardrails around which buckets / key structure they would be allowed to touch, if we create a simple interface for this... 🤦

@smohiudd
Copy link
Contributor

smohiudd commented Nov 7, 2024

Thanks @j08lue!

@sandrahoang686 can you check that these are getting ingested using the automated ingest we just set up?

@j08lue
Copy link
Contributor Author

j08lue commented Nov 7, 2024

Btw, there are some files with inconsistent naming.

$ aws s3 ls s3://veda-data-store-staging/geoglam/
2023-06-14 17:04:20       6148 .DS_Store
2023-06-14 17:04:20    6012504 CropMonitor_202001.tif
2023-06-14 17:04:20    6029419 CropMonitor_202002.tif
2023-06-14 17:04:20    6017018 CropMonitor_202003.tif
2023-06-14 17:04:20    6386366 CropMonitor_202004.tif
2023-06-14 17:04:20    6346561 CropMonitor_202005.tif
2023-06-14 17:04:20    6320955 CropMonitor_202006.tif
2023-06-14 17:04:20    4658995 CropMonitor_202007.tif
2023-06-14 17:04:20    4677472 CropMonitor_202008.tif
2023-06-14 17:04:20    4705830 CropMonitor_202009.tif
2023-06-14 17:04:20    4341809 CropMonitor_202010.tif
2023-06-14 17:04:24    5288105 CropMonitor_202011.tif
2023-06-14 17:04:24    5321207 CropMonitor_202101.tif
2023-06-14 17:04:24    5277308 CropMonitor_202102.tif
2023-06-14 17:04:24    5284661 CropMonitor_202103.tif
2023-06-14 17:04:24    5259615 CropMonitor_202104.tif
2023-06-14 17:04:24    5239591 CropMonitor_202105.tif
2023-06-14 17:04:24    4492889 CropMonitor_202106.tif
2023-06-14 17:04:24    4503863 CropMonitor_202107.tif
2023-06-14 17:04:24    3494043 CropMonitor_202108.tif
2023-06-14 17:04:24    5293999 CropMonitor_202109.tif
2023-06-14 17:04:26    5343006 CropMonitor_202110.tif
2023-06-14 17:04:26    5311489 CropMonitor_202111.tif
2023-06-14 17:04:26    5336762 CropMonitor_202201.tif
2023-06-14 17:04:26    5268139 CropMonitor_202202.tif
2023-06-14 17:04:26    5309246 CropMonitor_202203.tif
2023-06-14 17:04:26    5281256 CropMonitor_202204.tif
2023-06-14 17:04:26    4886345 CropMonitor_202205.tif
2023-06-14 17:04:26    4907825 CropMonitor_202206.tif
2023-06-14 17:04:26    4946370 CropMonitor_202207.tif
2023-06-14 17:04:26    3296784 CropMonitor_202208.tif
2023-06-14 17:04:27    4996502 CropMonitor_202209.tif
2023-06-14 17:04:27    5006583 CropMonitor_202210.tif
2023-06-14 17:04:27    5036055 CropMonitor_202211.tif
2023-06-14 17:04:27    4968798 CropMonitor_202304.tif
2023-07-19 14:39:19    4693854 CropMonitor_202305.tif
2023-08-24 13:40:42    5013383 CropMonitor_202306.tif
2023-11-03 13:05:31    5411525 CropMonitor_202307.tif
2023-11-03 13:06:38    5362108 CropMonitor_202308.tif
2023-11-07 20:32:14    4678356 CropMonitor_202309.tif
2023-11-07 20:31:23    4723276 CropMonitor_202310.tif
2024-02-09 03:17:38    4800011 CropMonitor_202311.tif
2023-06-14 17:04:27    4982767 CropMonitor_2023_01_28.tif
2023-06-14 17:04:27    4973021 CropMonitor_2023_02_28.tif
2023-06-14 17:04:27    5016336 CropMonitor_2023_03_28.tif
2024-02-09 03:21:04    5003250 CropMonitor_202401.tif
2024-03-14 18:56:23    4753596 CropMonitor_202402.tif
2024-04-25 18:43:51    4795250 CropMonitor_202403.tif
2024-06-03 23:27:29    4792191 CropMonitor_202404.tif
2024-06-20 14:02:41    4819082 CropMonitor_202405.tif
2024-08-02 13:31:59    4807514 CropMonitor_202406.tif
2024-08-02 13:32:52    4822375 CropMonitor_202407.tif
2024-11-06 21:11:27    4791300 CropMonitor_202408.tif
2024-11-07 22:10:10    4812414 CropMonitor_202409.tif
2024-11-07 22:09:06    4837923 CropMonitor_202410.tif
2024-11-06 21:08:00    4791300 Global_Synthesis_2024_08_28.tif
2024-11-06 21:04:43    3678153 Global_Synthesis_2024_08_28.zip

The 2023-01 through 2023-03 ones are the only files available for those months, so maybe these have been ingested all the way into STAC?.

The GLobal_Synthesis_2024-08-28.* files can go.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants