SnowflakeNodeData
Specifies configuration for Snowflake nodes in AWS Glue Studio.
Contents
- Action
-
Specifies what action to take when writing to a table with preexisting data. Valid values:
append
,merge
,truncate
,drop
.Type: String
Required: No
- AdditionalOptions
-
Specifies additional options passed to the Snowflake connector. If options are specified elsewhere in this node, this will take precedence.
Type: String to string map
Key Pattern:
([\u0009\u000B\u000C\u0020-\uD7FF\uE000-\uFFFD\uD800\uDC00-\uDBFF\uDFFF])*
Value Pattern:
([\u0009\u000B\u000C\u0020-\uD7FF\uE000-\uFFFD\uD800\uDC00-\uDBFF\uDFFF])*
Required: No
- AutoPushdown
-
Specifies whether automatic query pushdown is enabled. If pushdown is enabled, then when a query is run on Spark, if part of the query can be "pushed down" to the Snowflake server, it is pushed down. This improves performance of some queries.
Type: Boolean
Required: No
- Connection
-
Specifies a AWS Glue Data Catalog Connection to a Snowflake endpoint.
Type: Option object
Required: No
- Database
-
Specifies a Snowflake database for your node to use.
Type: String
Required: No
- IamRole
-
Not currently used.
Type: Option object
Required: No
- MergeAction
-
Specifies a merge action. Valid values:
simple
,custom
. If simple, merge behavior is defined byMergeWhenMatched
andMergeWhenNotMatched
. If custom, defined byMergeClause
.Type: String
Pattern:
[A-Za-z0-9_-]*
Required: No
- MergeClause
-
A SQL statement that specifies a custom merge behavior.
Type: String
Required: No
- MergeWhenMatched
-
Specifies how to resolve records that match preexisting data when merging. Valid values:
update
,delete
.Type: String
Pattern:
[A-Za-z0-9_-]*
Required: No
- MergeWhenNotMatched
-
Specifies how to process records that do not match preexisting data when merging. Valid values:
insert
,none
.Type: String
Pattern:
[A-Za-z0-9_-]*
Required: No
- PostAction
-
A SQL string run after the Snowflake connector performs its standard actions.
Type: String
Required: No
- PreAction
-
A SQL string run before the Snowflake connector performs its standard actions.
Type: String
Required: No
- SampleQuery
-
A SQL string used to retrieve data with the
query
sourcetype.Type: String
Required: No
- Schema
-
Specifies a Snowflake database schema for your node to use.
Type: String
Required: No
- SelectedColumns
-
Specifies the columns combined to identify a record when detecting matches for merges and upserts. A list of structures with
value
,label
anddescription
keys. Each structure describes a column.Type: Array of Option objects
Required: No
- SourceType
-
Specifies how retrieved data is specified. Valid values:
"table"
,"query"
.Type: String
Pattern:
[A-Za-z0-9_-]*
Required: No
- StagingTable
-
The name of a staging table used when performing
merge
or upsertappend
actions. Data is written to this table, then moved totable
by a generated postaction.Type: String
Required: No
- Table
-
Specifies a Snowflake table for your node to use.
Type: String
Required: No
- TableSchema
-
Manually defines the target schema for the node. A list of structures with
value
,label
anddescription
keys. Each structure defines a column.Type: Array of Option objects
Required: No
- TempDir
-
Not currently used.
Type: String
Pattern:
([\u0009\u000B\u000C\u0020-\uD7FF\uE000-\uFFFD\uD800\uDC00-\uDBFF\uDFFF])*
Required: No
- Upsert
-
Used when Action is
append
. Specifies the resolution behavior when a row already exists. If true, preexisting rows will be updated. If false, those rows will be inserted.Type: Boolean
Required: No
See Also
For more information about using this API in one of the language-specific AWS SDKs, see the following: