DataFormat

class aws_cdk.aws_glue.DataFormat(*, input_format, output_format, serialization_library, classification_string=None)

Bases: object

Defines the input/output formats and ser/de for a single DataFormat.

ExampleMetadata:

infused

Example:

# my_database: glue.Database

glue.S3Table(self, "MyTable",
    database=my_database,
    columns=[glue.Column(
        name="data",
        type=glue.Schema.STRING
    )],
    partition_keys=[glue.Column(
        name="date",
        type=glue.Schema.STRING
    )],
    data_format=glue.DataFormat.JSON,
    partition_projection={
        "date": glue.PartitionProjectionConfiguration.date(
            min="NOW-3YEARS",
            max="NOW",
            format="yyyy-MM-dd"
        )
    }
)
Parameters:
  • input_format (InputFormat) – InputFormat for this data format.

  • output_format (OutputFormat) – OutputFormat for this data format.

  • serialization_library (SerializationLibrary) – Serialization library for this data format.

  • classification_string (Optional[ClassificationString]) – Classification string given to tables with this data format. Default: - No classification is specified.

Attributes

APACHE_LOGS = <aws_cdk.aws_glue.DataFormat object>
AVRO = <aws_cdk.aws_glue.DataFormat object>
CLOUDTRAIL_LOGS = <aws_cdk.aws_glue.DataFormat object>
CSV = <aws_cdk.aws_glue.DataFormat object>
JSON = <aws_cdk.aws_glue.DataFormat object>
LOGSTASH = <aws_cdk.aws_glue.DataFormat object>
ORC = <aws_cdk.aws_glue.DataFormat object>
PARQUET = <aws_cdk.aws_glue.DataFormat object>
TSV = <aws_cdk.aws_glue.DataFormat object>
classification_string

Classification string given to tables with this data format.

input_format

InputFormat for this data format.

output_format

OutputFormat for this data format.

serialization_library

Serialization library for this data format.