Skip to content

Commit

Permalink
Add documentation for Snowflake Streaming
Browse files Browse the repository at this point in the history
  • Loading branch information
sali-a committed Apr 16, 2024
1 parent 2673360 commit bf636ad
Showing 1 changed file with 21 additions and 0 deletions.
21 changes: 21 additions & 0 deletions docs/content/_data/config/pipes/snowflake/streaming.yaml
Original file line number Diff line number Diff line change
@@ -0,0 +1,21 @@
output:
type: com.amadeus.dataio.pipes.snowflake.streaming.SnowflakeOutput
fields:
- name: Duration
mandatory: "No"
description: Sets the trigger for the stream query. Controls the trigger() Spark function.
example: Duration = "60 seconds"
- name: Timeout
mandatory: "Yes"
description: Controls the amount of time before returning from the streaming query, in hours. It can be a String or an Int.
example: Timeout = 24
- name: Mode
mandatory: "Yes"
description: The Spark Structured Streaming output mode.
example: Mode = "complete"
default: append
- name: AddTimestampOnInsert
mandatory: "No"
description: Add a column named "timestamp" containing the current timestamp at the start of query evaluation
example: AddTimestampOnInsert = "true"
default: false

0 comments on commit bf636ad

Please sign in to comment.