-
Notifications
You must be signed in to change notification settings - Fork 447
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
fix(interactive): Implement HttpIrMetaReader
to Get Meta Data From Remote Http Service
#3908
Conversation
@@ -1,45 +0,0 @@ | |||
/* |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
The file should be completely removed?
@@ -23,6 +23,13 @@ compiler: | |||
- FilterIntoJoinRule | |||
- FilterMatchRule | |||
- NotMatchToAntiJoinRule | |||
meta: | |||
reader: | |||
mode: local |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
This still runs in local mode?
@@ -61,3 +61,15 @@ calcite.default.charset: UTF-8 | |||
|
|||
# set the max capacity of the result streaming buffer for each query | |||
# per.query.stream.buffer.max.capacity: 256 | |||
|
|||
# set the mode to read ir meta, either from a 'local' file or via remote 'http'. | |||
# ir.meta.reader.mode: local |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
The configuration of ir.meta.xx, should be uniformly defined with graph.schema and graph.statistics. In addition, we can really configure those service scheme, to automatically differentiate from local and http. For example,
graph.meta.statistics.uri: http://localhost:8080 -> this is a http file, or
graph.meta.statistics.uri: file:///path/to/local/file -> this is a local file
Also give a uri for schema
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
done
…istency results in query
What do these changes do?
HttpIrMetaReader
to get meta data from remote http service.DynamicIrMetaFetcher
to fetch schema or statistics periodically, the interval can be set by configurations.Related issue number
Fixes