-
Notifications
You must be signed in to change notification settings - Fork 15
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Question regarding call of stat() for parent dir #36
Comments
Hi @Bizarious . Sounds like a bug, maybe you could pinpoint specific line in the code? If you are getting a permission error, I suppose you have a traceback for that laying around as well? |
Sorry for the late reply, there were some external circumstances that prevented me from responding. At first, thank you for the answer! A bit more context would be helpful as well I think: I'm using
Now it seems the filesystem calls stat on the directory
What I discovered using the debugger, was that fsspec splits the path in the Of course we are talking about the async implementation of I am not sure if there is anything that can be done inside the ssh implementation, but as I already mentioned the default sftp implementation does not have this problem. Please let me know what you think and if I missed anything! Thanks :) |
Hello,
while using sshfs in fsspec.open_files(), I discovered that stat() is called for the parent directory of the wanted files, even if it is already clear that this must be a directory. While this is most certainly not an issue for most cases, the sftp server I have to use behaves somewhat strange regarding this, as I get a permission error when trying to call stat() on these directories.
When using the default sftp implementation from fsspec there is no issue at all, so at least for me it seems that it should be possible without a call to stat(). Is there any way to achieve this with this library as well? I really like to use it because of performance reasons compared to sftp. Thank you!
The text was updated successfully, but these errors were encountered: