Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

REQUEST: rastervision check command #1154

Open
nanotubing opened this issue Apr 29, 2021 · 1 comment
Open

REQUEST: rastervision check command #1154

nanotubing opened this issue Apr 29, 2021 · 1 comment

Comments

@nanotubing
Copy link

one difficulty I've run into so far is that if there is an invalid S3 URL fed to rastervision, you tend to not find out until the job has already been running for some time. It may be useful to be able to run a rastervision check command, which would verify all URLs, and report any that are not accessible.

rastervision run local -a file1 file.txt ... check

@lewfish
Copy link
Contributor

lewfish commented May 14, 2021

It should be pretty straightforward to write a function that takes in a DatasetConfig object and checks if the input files exist. Then you could call that in your get_config function. There is a file_exists function that would be useful here: https://github.com/azavea/raster-vision/blob/master/rastervision_pipeline/rastervision/pipeline/file_system/utils.py#L184 It will be difficult to write that function in a very generic way, but it should be easy to write it if you know the types of RasterSource and LabelSource you will be using.

We actually used to have support for doing this automatically in an earlier version of RV, but it seemed to add too much complexity to the code, so I got rid of it. Maybe that was a bad idea :)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

3 participants