CfnDatasetProps

class aws_cdk.aws_databrew.CfnDatasetProps(*, input, name, format=None, format_options=None, path_options=None, tags=None)

Bases: object

Properties for defining a CfnDataset.

Parameters:
  • input (Union[InputProperty, Dict[str, Any], IResolvable]) – Information on how DataBrew can find the dataset, in either the AWS Glue Data Catalog or Amazon S3 .

  • name (str) – The unique name of the dataset.

  • format (Optional[str]) – The file format of a dataset that is created from an Amazon S3 file or folder.

  • format_options (Union[IResolvable, FormatOptionsProperty, Dict[str, Any], None]) – A set of options that define how DataBrew interprets the data in the dataset.

  • path_options (Union[IResolvable, PathOptionsProperty, Dict[str, Any], None]) – A set of options that defines how DataBrew interprets an Amazon S3 path of the dataset.

  • tags (Optional[Sequence[Union[CfnTag, Dict[str, Any]]]]) – Metadata tags that have been applied to the dataset.

Link:

http://docs.aws.amazon.com/AWSCloudFormation/latest/UserGuide/aws-resource-databrew-dataset.html

ExampleMetadata:

fixture=_generated

Example:

# The code below shows an example of how to instantiate this type.
# The values are placeholders you should change.
import aws_cdk.aws_databrew as databrew

cfn_dataset_props = databrew.CfnDatasetProps(
    input=databrew.CfnDataset.InputProperty(
        database_input_definition=databrew.CfnDataset.DatabaseInputDefinitionProperty(
            glue_connection_name="glueConnectionName",

            # the properties below are optional
            database_table_name="databaseTableName",
            query_string="queryString",
            temp_directory=databrew.CfnDataset.S3LocationProperty(
                bucket="bucket",

                # the properties below are optional
                key="key"
            )
        ),
        data_catalog_input_definition=databrew.CfnDataset.DataCatalogInputDefinitionProperty(
            catalog_id="catalogId",
            database_name="databaseName",
            table_name="tableName",
            temp_directory=databrew.CfnDataset.S3LocationProperty(
                bucket="bucket",

                # the properties below are optional
                key="key"
            )
        ),
        metadata=databrew.CfnDataset.MetadataProperty(
            source_arn="sourceArn"
        ),
        s3_input_definition=databrew.CfnDataset.S3LocationProperty(
            bucket="bucket",

            # the properties below are optional
            key="key"
        )
    ),
    name="name",

    # the properties below are optional
    format="format",
    format_options=databrew.CfnDataset.FormatOptionsProperty(
        csv=databrew.CfnDataset.CsvOptionsProperty(
            delimiter="delimiter",
            header_row=False
        ),
        excel=databrew.CfnDataset.ExcelOptionsProperty(
            header_row=False,
            sheet_indexes=[123],
            sheet_names=["sheetNames"]
        ),
        json=databrew.CfnDataset.JsonOptionsProperty(
            multi_line=False
        )
    ),
    path_options=databrew.CfnDataset.PathOptionsProperty(
        files_limit=databrew.CfnDataset.FilesLimitProperty(
            max_files=123,

            # the properties below are optional
            order="order",
            ordered_by="orderedBy"
        ),
        last_modified_date_condition=databrew.CfnDataset.FilterExpressionProperty(
            expression="expression",
            values_map=[databrew.CfnDataset.FilterValueProperty(
                value="value",
                value_reference="valueReference"
            )]
        ),
        parameters=[databrew.CfnDataset.PathParameterProperty(
            dataset_parameter=databrew.CfnDataset.DatasetParameterProperty(
                name="name",
                type="type",

                # the properties below are optional
                create_column=False,
                datetime_options=databrew.CfnDataset.DatetimeOptionsProperty(
                    format="format",

                    # the properties below are optional
                    locale_code="localeCode",
                    timezone_offset="timezoneOffset"
                ),
                filter=databrew.CfnDataset.FilterExpressionProperty(
                    expression="expression",
                    values_map=[databrew.CfnDataset.FilterValueProperty(
                        value="value",
                        value_reference="valueReference"
                    )]
                )
            ),
            path_parameter_name="pathParameterName"
        )]
    ),
    tags=[CfnTag(
        key="key",
        value="value"
    )]
)

Attributes

format

The file format of a dataset that is created from an Amazon S3 file or folder.

Link:

http://docs.aws.amazon.com/AWSCloudFormation/latest/UserGuide/aws-resource-databrew-dataset.html#cfn-databrew-dataset-format

format_options

A set of options that define how DataBrew interprets the data in the dataset.

Link:

http://docs.aws.amazon.com/AWSCloudFormation/latest/UserGuide/aws-resource-databrew-dataset.html#cfn-databrew-dataset-formatoptions

input

Information on how DataBrew can find the dataset, in either the AWS Glue Data Catalog or Amazon S3 .

Link:

http://docs.aws.amazon.com/AWSCloudFormation/latest/UserGuide/aws-resource-databrew-dataset.html#cfn-databrew-dataset-input

name

The unique name of the dataset.

Link:

http://docs.aws.amazon.com/AWSCloudFormation/latest/UserGuide/aws-resource-databrew-dataset.html#cfn-databrew-dataset-name

path_options

A set of options that defines how DataBrew interprets an Amazon S3 path of the dataset.

Link:

http://docs.aws.amazon.com/AWSCloudFormation/latest/UserGuide/aws-resource-databrew-dataset.html#cfn-databrew-dataset-pathoptions

tags

Metadata tags that have been applied to the dataset.

Link:

http://docs.aws.amazon.com/AWSCloudFormation/latest/UserGuide/aws-resource-databrew-dataset.html#cfn-databrew-dataset-tags