AWS::KinesisFirehose::DeliveryStream DataFormatConversionConfiguration
Specifies that you want Kinesis Data Firehose to convert data from the JSON format to the Parquet or ORC format before writing it to Amazon S3. Kinesis Data Firehose uses the serializer and deserializer that you specify, in addition to the column information from the AWS Glue table, to deserialize your input data from JSON and then serialize it to the Parquet or ORC format. For more information, see Kinesis Data Firehose Record Format Conversion.
Syntax
To declare this entity in your AWS CloudFormation template, use the following syntax:
JSON
{ "Enabled" :Boolean, "InputFormatConfiguration" :InputFormatConfiguration, "OutputFormatConfiguration" :OutputFormatConfiguration, "SchemaConfiguration" :SchemaConfiguration}
YAML
Enabled:BooleanInputFormatConfiguration:InputFormatConfigurationOutputFormatConfiguration:OutputFormatConfigurationSchemaConfiguration:SchemaConfiguration
Properties
Enabled-
Defaults to
true. Set it tofalseif you want to disable format conversion while preserving the configuration details.Required: No
Type: Boolean
Update requires: No interruption
InputFormatConfiguration-
Specifies the deserializer that you want Firehose to use to convert the format of your data from JSON. This parameter is required if
Enabledis set to true.Required: No
Type: InputFormatConfiguration
Update requires: No interruption
OutputFormatConfiguration-
Specifies the serializer that you want Firehose to use to convert the format of your data to the Parquet or ORC format. This parameter is required if
Enabledis set to true.Required: No
Type: OutputFormatConfiguration
Update requires: No interruption
SchemaConfiguration-
Specifies the AWS Glue Data Catalog table that contains the column information. This parameter is required if
Enabledis set to true.Required: No
Type: SchemaConfiguration
Update requires: No interruption
