S3HudiDirectTarget
Specifies a target that writes to a Hudi data source in Amazon S3.
Contents
- AdditionalOptions
-
Specifies additional connection options for the connector.
Type: String to string map
Key Pattern:
([\u0009\u000B\u000C\u0020-\uD7FF\uE000-\uFFFD\uD800\uDC00-\uDBFF\uDFFF])*
Value Pattern:
([\u0009\u000B\u000C\u0020-\uD7FF\uE000-\uFFFD\uD800\uDC00-\uDBFF\uDFFF])*
Required: Yes
- Compression
-
Specifies how the data is compressed. This is generally not necessary if the data has a standard file extension. Possible values are
"gzip"
and"bzip"
).Type: String
Valid Values:
gzip | lzo | uncompressed | snappy
Required: Yes
- Format
-
Specifies the data output format for the target.
Type: String
Valid Values:
json | csv | avro | orc | parquet | hudi | delta
Required: Yes
- Inputs
-
The nodes that are inputs to the data target.
Type: Array of strings
Array Members: Fixed number of 1 item.
Pattern:
[A-Za-z0-9_-]*
Required: Yes
- Name
-
The name of the data target.
Type: String
Pattern:
([^\r\n])*
Required: Yes
- Path
-
The Amazon S3 path of your Hudi data source to write to.
Type: String
Pattern:
([\u0009\u000B\u000C\u0020-\uD7FF\uE000-\uFFFD\uD800\uDC00-\uDBFF\uDFFF])*
Required: Yes
- PartitionKeys
-
Specifies native partitioning using a sequence of keys.
Type: Array of arrays of strings
Pattern:
([\u0009\u000B\u000C\u0020-\uD7FF\uE000-\uFFFD\uD800\uDC00-\uDBFF\uDFFF])*
Required: No
- SchemaChangePolicy
-
A policy that specifies update behavior for the crawler.
Type: DirectSchemaChangePolicy object
Required: No
See Also
For more information about using this API in one of the language-specific AWS SDKs, see the following: