How to read a parquet file from multiple directories at once

[V-yg]

Hi,I want to read a parquet file in multiple directories at once, but I don't see the interface. Do I need to do this myself? Or is there an alternative

[sadikovi]

I am not quite sure I understand what you mean. Can you do the same with just spark.read.parquet?

[V-yg]

like this: spark.index.create.indexByAll().parquet(path1,path2,path3)

[V-yg]

One of my Parquet tables has multiple paths, but not a partition type. Now to create index for a table, I need to pass in all the paths,I've already implemented this,thanks

[sadikovi]

I don't quite understand your directory structure. Usually, a parquet table is represented as a directory with files or partition sub-directories. If there is some sort of parent directory for all of those paths, you can try providing that instead. Right now, it is not possible to pass multiple paths, maybe it makes sense to add this functionality.

[V-yg]

Ok, I have understood. Thank you for your reply