Represents options that specify how and where in Amazon S3 DataBrew writes the output generated by recipe jobs or profile jobs.
Contents
Note
In the following list, the required parameters are described first.
- Location
-
The location in Amazon S3 where the job writes its output.
Type: S3Location object
Required: Yes
- CompressionFormat
-
The compression algorithm used to compress the output text of the job.
Type: String
Valid Values:
GZIP | LZ4 | SNAPPY | BZIP2 | DEFLATE | LZO | BROTLI | ZSTD | ZLIBRequired: No
- Format
-
The data format of the output of the job.
Type: String
Valid Values:
CSV | JSON | PARQUET | GLUEPARQUET | AVRO | ORC | XML | TABLEAUHYPERRequired: No
- FormatOptions
-
Represents options that define how DataBrew formats job output files.
Type: OutputFormatOptions object
Required: No
- MaxOutputFiles
-
Maximum number of files to be generated by the job and written to the output folder. For output partitioned by column(s), the MaxOutputFiles value is the maximum number of files per partition.
Type: Integer
Valid Range: Minimum value of 1. Maximum value of 999.
Required: No
- Overwrite
-
A value that, if true, means that any data in the location specified for output is overwritten with new output.
Type: Boolean
Required: No
- PartitionColumns
-
The names of one or more partition columns for the output of the job.
Type: Array of strings
Array Members: Maximum number of 200 items.
Length Constraints: Minimum length of 1. Maximum length of 255.
Required: No
See Also
For more information about using this API in one of the language-specific AWS SDKs, see the following:
