Class: Aws::Glue::Types::CodeGenConfigurationNode
- Inherits:
-
Struct
- Object
- Struct
- Aws::Glue::Types::CodeGenConfigurationNode
- Defined in:
- gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb
Overview
CodeGenConfigurationNode
enumerates all valid Node types. One and
only one of its member variables can be populated.
Constant Summary collapse
- SENSITIVE =
[]
Instance Attribute Summary collapse
-
#aggregate ⇒ Types::Aggregate
Specifies a transform that groups rows by chosen fields and computes the aggregated value by specified function.
-
#amazon_redshift_source ⇒ Types::AmazonRedshiftSource
Specifies a target that writes to a data source in Amazon Redshift.
-
#amazon_redshift_target ⇒ Types::AmazonRedshiftTarget
Specifies a target that writes to a data target in Amazon Redshift.
-
#apply_mapping ⇒ Types::ApplyMapping
Specifies a transform that maps data property keys in the data source to data property keys in the data target.
-
#athena_connector_source ⇒ Types::AthenaConnectorSource
Specifies a connector to an Amazon Athena data source.
-
#catalog_delta_source ⇒ Types::CatalogDeltaSource
Specifies a Delta Lake data source that is registered in the Glue Data Catalog.
-
#catalog_hudi_source ⇒ Types::CatalogHudiSource
Specifies a Hudi data source that is registered in the Glue Data Catalog.
-
#catalog_kafka_source ⇒ Types::CatalogKafkaSource
Specifies an Apache Kafka data store in the Data Catalog.
-
#catalog_kinesis_source ⇒ Types::CatalogKinesisSource
Specifies a Kinesis data source in the Glue Data Catalog.
-
#catalog_source ⇒ Types::CatalogSource
Specifies a data store in the Glue Data Catalog.
-
#catalog_target ⇒ Types::BasicCatalogTarget
Specifies a target that uses a Glue Data Catalog table.
-
#connector_data_source ⇒ Types::ConnectorDataSource
Specifies a source generated with standard connection options.
-
#connector_data_target ⇒ Types::ConnectorDataTarget
Specifies a target generated with standard connection options.
-
#custom_code ⇒ Types::CustomCode
Specifies a transform that uses custom code you provide to perform the data transformation.
-
#direct_jdbc_source ⇒ Types::DirectJDBCSource
Specifies the direct JDBC source connection.
-
#direct_kafka_source ⇒ Types::DirectKafkaSource
Specifies an Apache Kafka data store.
-
#direct_kinesis_source ⇒ Types::DirectKinesisSource
Specifies a direct Amazon Kinesis data source.
-
#drop_duplicates ⇒ Types::DropDuplicates
Specifies a transform that removes rows of repeating data from a data set.
-
#drop_fields ⇒ Types::DropFields
Specifies a transform that chooses the data property keys that you want to drop.
-
#drop_null_fields ⇒ Types::DropNullFields
Specifies a transform that removes columns from the dataset if all values in the column are 'null'.
-
#dynamic_transform ⇒ Types::DynamicTransform
Specifies a custom visual transform created by a user.
-
#dynamo_db_catalog_source ⇒ Types::DynamoDBCatalogSource
Specifies a DynamoDBC Catalog data store in the Glue Data Catalog.
-
#evaluate_data_quality ⇒ Types::EvaluateDataQuality
Specifies your data quality evaluation criteria.
-
#evaluate_data_quality_multi_frame ⇒ Types::EvaluateDataQualityMultiFrame
Specifies your data quality evaluation criteria.
-
#fill_missing_values ⇒ Types::FillMissingValues
Specifies a transform that locates records in the dataset that have missing values and adds a new field with a value determined by imputation.
-
#filter ⇒ Types::Filter
Specifies a transform that splits a dataset into two, based on a filter condition.
-
#governed_catalog_source ⇒ Types::GovernedCatalogSource
Specifies a data source in a goverened Data Catalog.
-
#governed_catalog_target ⇒ Types::GovernedCatalogTarget
Specifies a data target that writes to a goverened catalog.
-
#jdbc_connector_source ⇒ Types::JDBCConnectorSource
Specifies a connector to a JDBC data source.
-
#jdbc_connector_target ⇒ Types::JDBCConnectorTarget
Specifies a data target that writes to Amazon S3 in Apache Parquet columnar storage.
-
#join ⇒ Types::Join
Specifies a transform that joins two datasets into one dataset using a comparison phrase on the specified data property keys.
-
#merge ⇒ Types::Merge
Specifies a transform that merges a
DynamicFrame
with a stagingDynamicFrame
based on the specified primary keys to identify records. -
#microsoft_sql_server_catalog_source ⇒ Types::MicrosoftSQLServerCatalogSource
Specifies a Microsoft SQL server data source in the Glue Data Catalog.
-
#microsoft_sql_server_catalog_target ⇒ Types::MicrosoftSQLServerCatalogTarget
Specifies a target that uses Microsoft SQL.
-
#my_sql_catalog_source ⇒ Types::MySQLCatalogSource
Specifies a MySQL data source in the Glue Data Catalog.
-
#my_sql_catalog_target ⇒ Types::MySQLCatalogTarget
Specifies a target that uses MySQL.
-
#oracle_sql_catalog_source ⇒ Types::OracleSQLCatalogSource
Specifies an Oracle data source in the Glue Data Catalog.
-
#oracle_sql_catalog_target ⇒ Types::OracleSQLCatalogTarget
Specifies a target that uses Oracle SQL.
-
#pii_detection ⇒ Types::PIIDetection
Specifies a transform that identifies, removes or masks PII data.
-
#postgre_sql_catalog_source ⇒ Types::PostgreSQLCatalogSource
Specifies a PostgresSQL data source in the Glue Data Catalog.
-
#postgre_sql_catalog_target ⇒ Types::PostgreSQLCatalogTarget
Specifies a target that uses Postgres SQL.
-
#recipe ⇒ Types::Recipe
Specifies a Glue DataBrew recipe node.
-
#redshift_source ⇒ Types::RedshiftSource
Specifies an Amazon Redshift data store.
-
#redshift_target ⇒ Types::RedshiftTarget
Specifies a target that uses Amazon Redshift.
-
#relational_catalog_source ⇒ Types::RelationalCatalogSource
Specifies a relational catalog data store in the Glue Data Catalog.
-
#rename_field ⇒ Types::RenameField
Specifies a transform that renames a single data property key.
-
#s3_catalog_delta_source ⇒ Types::S3CatalogDeltaSource
Specifies a Delta Lake data source that is registered in the Glue Data Catalog.
-
#s3_catalog_hudi_source ⇒ Types::S3CatalogHudiSource
Specifies a Hudi data source that is registered in the Glue Data Catalog.
-
#s3_catalog_source ⇒ Types::S3CatalogSource
Specifies an Amazon S3 data store in the Glue Data Catalog.
-
#s3_catalog_target ⇒ Types::S3CatalogTarget
Specifies a data target that writes to Amazon S3 using the Glue Data Catalog.
-
#s3_csv_source ⇒ Types::S3CsvSource
Specifies a command-separated value (CSV) data store stored in Amazon S3.
-
#s3_delta_catalog_target ⇒ Types::S3DeltaCatalogTarget
Specifies a target that writes to a Delta Lake data source in the Glue Data Catalog.
-
#s3_delta_direct_target ⇒ Types::S3DeltaDirectTarget
Specifies a target that writes to a Delta Lake data source in Amazon S3.
-
#s3_delta_source ⇒ Types::S3DeltaSource
Specifies a Delta Lake data source stored in Amazon S3.
-
#s3_direct_target ⇒ Types::S3DirectTarget
Specifies a data target that writes to Amazon S3.
-
#s3_glue_parquet_target ⇒ Types::S3GlueParquetTarget
Specifies a data target that writes to Amazon S3 in Apache Parquet columnar storage.
-
#s3_hudi_catalog_target ⇒ Types::S3HudiCatalogTarget
Specifies a target that writes to a Hudi data source in the Glue Data Catalog.
-
#s3_hudi_direct_target ⇒ Types::S3HudiDirectTarget
Specifies a target that writes to a Hudi data source in Amazon S3.
-
#s3_hudi_source ⇒ Types::S3HudiSource
Specifies a Hudi data source stored in Amazon S3.
-
#s3_json_source ⇒ Types::S3JsonSource
Specifies a JSON data store stored in Amazon S3.
-
#s3_parquet_source ⇒ Types::S3ParquetSource
Specifies an Apache Parquet data store stored in Amazon S3.
-
#select_fields ⇒ Types::SelectFields
Specifies a transform that chooses the data property keys that you want to keep.
-
#select_from_collection ⇒ Types::SelectFromCollection
Specifies a transform that chooses one
DynamicFrame
from a collection ofDynamicFrames
. -
#snowflake_source ⇒ Types::SnowflakeSource
Specifies a Snowflake data source.
-
#snowflake_target ⇒ Types::SnowflakeTarget
Specifies a target that writes to a Snowflake data source.
-
#spark_connector_source ⇒ Types::SparkConnectorSource
Specifies a connector to an Apache Spark data source.
-
#spark_connector_target ⇒ Types::SparkConnectorTarget
Specifies a target that uses an Apache Spark connector.
-
#spark_sql ⇒ Types::SparkSQL
Specifies a transform where you enter a SQL query using Spark SQL syntax to transform the data.
-
#spigot ⇒ Types::Spigot
Specifies a transform that writes samples of the data to an Amazon S3 bucket.
-
#split_fields ⇒ Types::SplitFields
Specifies a transform that splits data property keys into two
DynamicFrames
. -
#union ⇒ Types::Union
Specifies a transform that combines the rows from two or more datasets into a single result.
Instance Attribute Details
#aggregate ⇒ Types::Aggregate
Specifies a transform that groups rows by chosen fields and computes the aggregated value by specified function.
2813 2814 2815 2816 2817 2818 2819 2820 2821 2822 2823 2824 2825 2826 2827 2828 2829 2830 2831 2832 2833 2834 2835 2836 2837 2838 2839 2840 2841 2842 2843 2844 2845 2846 2847 2848 2849 2850 2851 2852 2853 2854 2855 2856 2857 2858 2859 2860 2861 2862 2863 2864 2865 2866 2867 2868 2869 2870 2871 2872 2873 2874 2875 2876 2877 2878 2879 2880 2881 2882 2883 2884 2885 2886 2887 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 2813 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target, :amazon_redshift_source, :amazon_redshift_target, :evaluate_data_quality_multi_frame, :recipe, :snowflake_source, :snowflake_target, :connector_data_source, :connector_data_target) SENSITIVE = [] include Aws::Structure end |
#amazon_redshift_source ⇒ Types::AmazonRedshiftSource
Specifies a target that writes to a data source in Amazon Redshift.
2813 2814 2815 2816 2817 2818 2819 2820 2821 2822 2823 2824 2825 2826 2827 2828 2829 2830 2831 2832 2833 2834 2835 2836 2837 2838 2839 2840 2841 2842 2843 2844 2845 2846 2847 2848 2849 2850 2851 2852 2853 2854 2855 2856 2857 2858 2859 2860 2861 2862 2863 2864 2865 2866 2867 2868 2869 2870 2871 2872 2873 2874 2875 2876 2877 2878 2879 2880 2881 2882 2883 2884 2885 2886 2887 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 2813 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target, :amazon_redshift_source, :amazon_redshift_target, :evaluate_data_quality_multi_frame, :recipe, :snowflake_source, :snowflake_target, :connector_data_source, :connector_data_target) SENSITIVE = [] include Aws::Structure end |
#amazon_redshift_target ⇒ Types::AmazonRedshiftTarget
Specifies a target that writes to a data target in Amazon Redshift.
2813 2814 2815 2816 2817 2818 2819 2820 2821 2822 2823 2824 2825 2826 2827 2828 2829 2830 2831 2832 2833 2834 2835 2836 2837 2838 2839 2840 2841 2842 2843 2844 2845 2846 2847 2848 2849 2850 2851 2852 2853 2854 2855 2856 2857 2858 2859 2860 2861 2862 2863 2864 2865 2866 2867 2868 2869 2870 2871 2872 2873 2874 2875 2876 2877 2878 2879 2880 2881 2882 2883 2884 2885 2886 2887 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 2813 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target, :amazon_redshift_source, :amazon_redshift_target, :evaluate_data_quality_multi_frame, :recipe, :snowflake_source, :snowflake_target, :connector_data_source, :connector_data_target) SENSITIVE = [] include Aws::Structure end |
#apply_mapping ⇒ Types::ApplyMapping
Specifies a transform that maps data property keys in the data source to data property keys in the data target. You can rename keys, modify the data types for keys, and choose which keys to drop from the dataset.
2813 2814 2815 2816 2817 2818 2819 2820 2821 2822 2823 2824 2825 2826 2827 2828 2829 2830 2831 2832 2833 2834 2835 2836 2837 2838 2839 2840 2841 2842 2843 2844 2845 2846 2847 2848 2849 2850 2851 2852 2853 2854 2855 2856 2857 2858 2859 2860 2861 2862 2863 2864 2865 2866 2867 2868 2869 2870 2871 2872 2873 2874 2875 2876 2877 2878 2879 2880 2881 2882 2883 2884 2885 2886 2887 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 2813 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target, :amazon_redshift_source, :amazon_redshift_target, :evaluate_data_quality_multi_frame, :recipe, :snowflake_source, :snowflake_target, :connector_data_source, :connector_data_target) SENSITIVE = [] include Aws::Structure end |
#athena_connector_source ⇒ Types::AthenaConnectorSource
Specifies a connector to an Amazon Athena data source.
2813 2814 2815 2816 2817 2818 2819 2820 2821 2822 2823 2824 2825 2826 2827 2828 2829 2830 2831 2832 2833 2834 2835 2836 2837 2838 2839 2840 2841 2842 2843 2844 2845 2846 2847 2848 2849 2850 2851 2852 2853 2854 2855 2856 2857 2858 2859 2860 2861 2862 2863 2864 2865 2866 2867 2868 2869 2870 2871 2872 2873 2874 2875 2876 2877 2878 2879 2880 2881 2882 2883 2884 2885 2886 2887 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 2813 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target, :amazon_redshift_source, :amazon_redshift_target, :evaluate_data_quality_multi_frame, :recipe, :snowflake_source, :snowflake_target, :connector_data_source, :connector_data_target) SENSITIVE = [] include Aws::Structure end |
#catalog_delta_source ⇒ Types::CatalogDeltaSource
Specifies a Delta Lake data source that is registered in the Glue Data Catalog.
2813 2814 2815 2816 2817 2818 2819 2820 2821 2822 2823 2824 2825 2826 2827 2828 2829 2830 2831 2832 2833 2834 2835 2836 2837 2838 2839 2840 2841 2842 2843 2844 2845 2846 2847 2848 2849 2850 2851 2852 2853 2854 2855 2856 2857 2858 2859 2860 2861 2862 2863 2864 2865 2866 2867 2868 2869 2870 2871 2872 2873 2874 2875 2876 2877 2878 2879 2880 2881 2882 2883 2884 2885 2886 2887 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 2813 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target, :amazon_redshift_source, :amazon_redshift_target, :evaluate_data_quality_multi_frame, :recipe, :snowflake_source, :snowflake_target, :connector_data_source, :connector_data_target) SENSITIVE = [] include Aws::Structure end |
#catalog_hudi_source ⇒ Types::CatalogHudiSource
Specifies a Hudi data source that is registered in the Glue Data Catalog.
2813 2814 2815 2816 2817 2818 2819 2820 2821 2822 2823 2824 2825 2826 2827 2828 2829 2830 2831 2832 2833 2834 2835 2836 2837 2838 2839 2840 2841 2842 2843 2844 2845 2846 2847 2848 2849 2850 2851 2852 2853 2854 2855 2856 2857 2858 2859 2860 2861 2862 2863 2864 2865 2866 2867 2868 2869 2870 2871 2872 2873 2874 2875 2876 2877 2878 2879 2880 2881 2882 2883 2884 2885 2886 2887 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 2813 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target, :amazon_redshift_source, :amazon_redshift_target, :evaluate_data_quality_multi_frame, :recipe, :snowflake_source, :snowflake_target, :connector_data_source, :connector_data_target) SENSITIVE = [] include Aws::Structure end |
#catalog_kafka_source ⇒ Types::CatalogKafkaSource
Specifies an Apache Kafka data store in the Data Catalog.
2813 2814 2815 2816 2817 2818 2819 2820 2821 2822 2823 2824 2825 2826 2827 2828 2829 2830 2831 2832 2833 2834 2835 2836 2837 2838 2839 2840 2841 2842 2843 2844 2845 2846 2847 2848 2849 2850 2851 2852 2853 2854 2855 2856 2857 2858 2859 2860 2861 2862 2863 2864 2865 2866 2867 2868 2869 2870 2871 2872 2873 2874 2875 2876 2877 2878 2879 2880 2881 2882 2883 2884 2885 2886 2887 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 2813 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target, :amazon_redshift_source, :amazon_redshift_target, :evaluate_data_quality_multi_frame, :recipe, :snowflake_source, :snowflake_target, :connector_data_source, :connector_data_target) SENSITIVE = [] include Aws::Structure end |
#catalog_kinesis_source ⇒ Types::CatalogKinesisSource
Specifies a Kinesis data source in the Glue Data Catalog.
2813 2814 2815 2816 2817 2818 2819 2820 2821 2822 2823 2824 2825 2826 2827 2828 2829 2830 2831 2832 2833 2834 2835 2836 2837 2838 2839 2840 2841 2842 2843 2844 2845 2846 2847 2848 2849 2850 2851 2852 2853 2854 2855 2856 2857 2858 2859 2860 2861 2862 2863 2864 2865 2866 2867 2868 2869 2870 2871 2872 2873 2874 2875 2876 2877 2878 2879 2880 2881 2882 2883 2884 2885 2886 2887 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 2813 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target, :amazon_redshift_source, :amazon_redshift_target, :evaluate_data_quality_multi_frame, :recipe, :snowflake_source, :snowflake_target, :connector_data_source, :connector_data_target) SENSITIVE = [] include Aws::Structure end |
#catalog_source ⇒ Types::CatalogSource
Specifies a data store in the Glue Data Catalog.
2813 2814 2815 2816 2817 2818 2819 2820 2821 2822 2823 2824 2825 2826 2827 2828 2829 2830 2831 2832 2833 2834 2835 2836 2837 2838 2839 2840 2841 2842 2843 2844 2845 2846 2847 2848 2849 2850 2851 2852 2853 2854 2855 2856 2857 2858 2859 2860 2861 2862 2863 2864 2865 2866 2867 2868 2869 2870 2871 2872 2873 2874 2875 2876 2877 2878 2879 2880 2881 2882 2883 2884 2885 2886 2887 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 2813 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target, :amazon_redshift_source, :amazon_redshift_target, :evaluate_data_quality_multi_frame, :recipe, :snowflake_source, :snowflake_target, :connector_data_source, :connector_data_target) SENSITIVE = [] include Aws::Structure end |
#catalog_target ⇒ Types::BasicCatalogTarget
Specifies a target that uses a Glue Data Catalog table.
2813 2814 2815 2816 2817 2818 2819 2820 2821 2822 2823 2824 2825 2826 2827 2828 2829 2830 2831 2832 2833 2834 2835 2836 2837 2838 2839 2840 2841 2842 2843 2844 2845 2846 2847 2848 2849 2850 2851 2852 2853 2854 2855 2856 2857 2858 2859 2860 2861 2862 2863 2864 2865 2866 2867 2868 2869 2870 2871 2872 2873 2874 2875 2876 2877 2878 2879 2880 2881 2882 2883 2884 2885 2886 2887 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 2813 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target, :amazon_redshift_source, :amazon_redshift_target, :evaluate_data_quality_multi_frame, :recipe, :snowflake_source, :snowflake_target, :connector_data_source, :connector_data_target) SENSITIVE = [] include Aws::Structure end |
#connector_data_source ⇒ Types::ConnectorDataSource
Specifies a source generated with standard connection options.
2813 2814 2815 2816 2817 2818 2819 2820 2821 2822 2823 2824 2825 2826 2827 2828 2829 2830 2831 2832 2833 2834 2835 2836 2837 2838 2839 2840 2841 2842 2843 2844 2845 2846 2847 2848 2849 2850 2851 2852 2853 2854 2855 2856 2857 2858 2859 2860 2861 2862 2863 2864 2865 2866 2867 2868 2869 2870 2871 2872 2873 2874 2875 2876 2877 2878 2879 2880 2881 2882 2883 2884 2885 2886 2887 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 2813 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target, :amazon_redshift_source, :amazon_redshift_target, :evaluate_data_quality_multi_frame, :recipe, :snowflake_source, :snowflake_target, :connector_data_source, :connector_data_target) SENSITIVE = [] include Aws::Structure end |
#connector_data_target ⇒ Types::ConnectorDataTarget
Specifies a target generated with standard connection options.
2813 2814 2815 2816 2817 2818 2819 2820 2821 2822 2823 2824 2825 2826 2827 2828 2829 2830 2831 2832 2833 2834 2835 2836 2837 2838 2839 2840 2841 2842 2843 2844 2845 2846 2847 2848 2849 2850 2851 2852 2853 2854 2855 2856 2857 2858 2859 2860 2861 2862 2863 2864 2865 2866 2867 2868 2869 2870 2871 2872 2873 2874 2875 2876 2877 2878 2879 2880 2881 2882 2883 2884 2885 2886 2887 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 2813 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target, :amazon_redshift_source, :amazon_redshift_target, :evaluate_data_quality_multi_frame, :recipe, :snowflake_source, :snowflake_target, :connector_data_source, :connector_data_target) SENSITIVE = [] include Aws::Structure end |
#custom_code ⇒ Types::CustomCode
Specifies a transform that uses custom code you provide to perform the data transformation. The output is a collection of DynamicFrames.
2813 2814 2815 2816 2817 2818 2819 2820 2821 2822 2823 2824 2825 2826 2827 2828 2829 2830 2831 2832 2833 2834 2835 2836 2837 2838 2839 2840 2841 2842 2843 2844 2845 2846 2847 2848 2849 2850 2851 2852 2853 2854 2855 2856 2857 2858 2859 2860 2861 2862 2863 2864 2865 2866 2867 2868 2869 2870 2871 2872 2873 2874 2875 2876 2877 2878 2879 2880 2881 2882 2883 2884 2885 2886 2887 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 2813 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target, :amazon_redshift_source, :amazon_redshift_target, :evaluate_data_quality_multi_frame, :recipe, :snowflake_source, :snowflake_target, :connector_data_source, :connector_data_target) SENSITIVE = [] include Aws::Structure end |
#direct_jdbc_source ⇒ Types::DirectJDBCSource
Specifies the direct JDBC source connection.
2813 2814 2815 2816 2817 2818 2819 2820 2821 2822 2823 2824 2825 2826 2827 2828 2829 2830 2831 2832 2833 2834 2835 2836 2837 2838 2839 2840 2841 2842 2843 2844 2845 2846 2847 2848 2849 2850 2851 2852 2853 2854 2855 2856 2857 2858 2859 2860 2861 2862 2863 2864 2865 2866 2867 2868 2869 2870 2871 2872 2873 2874 2875 2876 2877 2878 2879 2880 2881 2882 2883 2884 2885 2886 2887 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 2813 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target, :amazon_redshift_source, :amazon_redshift_target, :evaluate_data_quality_multi_frame, :recipe, :snowflake_source, :snowflake_target, :connector_data_source, :connector_data_target) SENSITIVE = [] include Aws::Structure end |
#direct_kafka_source ⇒ Types::DirectKafkaSource
Specifies an Apache Kafka data store.
2813 2814 2815 2816 2817 2818 2819 2820 2821 2822 2823 2824 2825 2826 2827 2828 2829 2830 2831 2832 2833 2834 2835 2836 2837 2838 2839 2840 2841 2842 2843 2844 2845 2846 2847 2848 2849 2850 2851 2852 2853 2854 2855 2856 2857 2858 2859 2860 2861 2862 2863 2864 2865 2866 2867 2868 2869 2870 2871 2872 2873 2874 2875 2876 2877 2878 2879 2880 2881 2882 2883 2884 2885 2886 2887 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 2813 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target, :amazon_redshift_source, :amazon_redshift_target, :evaluate_data_quality_multi_frame, :recipe, :snowflake_source, :snowflake_target, :connector_data_source, :connector_data_target) SENSITIVE = [] include Aws::Structure end |
#direct_kinesis_source ⇒ Types::DirectKinesisSource
Specifies a direct Amazon Kinesis data source.
2813 2814 2815 2816 2817 2818 2819 2820 2821 2822 2823 2824 2825 2826 2827 2828 2829 2830 2831 2832 2833 2834 2835 2836 2837 2838 2839 2840 2841 2842 2843 2844 2845 2846 2847 2848 2849 2850 2851 2852 2853 2854 2855 2856 2857 2858 2859 2860 2861 2862 2863 2864 2865 2866 2867 2868 2869 2870 2871 2872 2873 2874 2875 2876 2877 2878 2879 2880 2881 2882 2883 2884 2885 2886 2887 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 2813 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target, :amazon_redshift_source, :amazon_redshift_target, :evaluate_data_quality_multi_frame, :recipe, :snowflake_source, :snowflake_target, :connector_data_source, :connector_data_target) SENSITIVE = [] include Aws::Structure end |
#drop_duplicates ⇒ Types::DropDuplicates
Specifies a transform that removes rows of repeating data from a data set.
2813 2814 2815 2816 2817 2818 2819 2820 2821 2822 2823 2824 2825 2826 2827 2828 2829 2830 2831 2832 2833 2834 2835 2836 2837 2838 2839 2840 2841 2842 2843 2844 2845 2846 2847 2848 2849 2850 2851 2852 2853 2854 2855 2856 2857 2858 2859 2860 2861 2862 2863 2864 2865 2866 2867 2868 2869 2870 2871 2872 2873 2874 2875 2876 2877 2878 2879 2880 2881 2882 2883 2884 2885 2886 2887 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 2813 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target, :amazon_redshift_source, :amazon_redshift_target, :evaluate_data_quality_multi_frame, :recipe, :snowflake_source, :snowflake_target, :connector_data_source, :connector_data_target) SENSITIVE = [] include Aws::Structure end |
#drop_fields ⇒ Types::DropFields
Specifies a transform that chooses the data property keys that you want to drop.
2813 2814 2815 2816 2817 2818 2819 2820 2821 2822 2823 2824 2825 2826 2827 2828 2829 2830 2831 2832 2833 2834 2835 2836 2837 2838 2839 2840 2841 2842 2843 2844 2845 2846 2847 2848 2849 2850 2851 2852 2853 2854 2855 2856 2857 2858 2859 2860 2861 2862 2863 2864 2865 2866 2867 2868 2869 2870 2871 2872 2873 2874 2875 2876 2877 2878 2879 2880 2881 2882 2883 2884 2885 2886 2887 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 2813 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target, :amazon_redshift_source, :amazon_redshift_target, :evaluate_data_quality_multi_frame, :recipe, :snowflake_source, :snowflake_target, :connector_data_source, :connector_data_target) SENSITIVE = [] include Aws::Structure end |
#drop_null_fields ⇒ Types::DropNullFields
Specifies a transform that removes columns from the dataset if all values in the column are 'null'. By default, Glue Studio will recognize null objects, but some values such as empty strings, strings that are "null", -1 integers or other placeholders such as zeros, are not automatically recognized as nulls.
2813 2814 2815 2816 2817 2818 2819 2820 2821 2822 2823 2824 2825 2826 2827 2828 2829 2830 2831 2832 2833 2834 2835 2836 2837 2838 2839 2840 2841 2842 2843 2844 2845 2846 2847 2848 2849 2850 2851 2852 2853 2854 2855 2856 2857 2858 2859 2860 2861 2862 2863 2864 2865 2866 2867 2868 2869 2870 2871 2872 2873 2874 2875 2876 2877 2878 2879 2880 2881 2882 2883 2884 2885 2886 2887 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 2813 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target, :amazon_redshift_source, :amazon_redshift_target, :evaluate_data_quality_multi_frame, :recipe, :snowflake_source, :snowflake_target, :connector_data_source, :connector_data_target) SENSITIVE = [] include Aws::Structure end |
#dynamic_transform ⇒ Types::DynamicTransform
Specifies a custom visual transform created by a user.
2813 2814 2815 2816 2817 2818 2819 2820 2821 2822 2823 2824 2825 2826 2827 2828 2829 2830 2831 2832 2833 2834 2835 2836 2837 2838 2839 2840 2841 2842 2843 2844 2845 2846 2847 2848 2849 2850 2851 2852 2853 2854 2855 2856 2857 2858 2859 2860 2861 2862 2863 2864 2865 2866 2867 2868 2869 2870 2871 2872 2873 2874 2875 2876 2877 2878 2879 2880 2881 2882 2883 2884 2885 2886 2887 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 2813 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target, :amazon_redshift_source, :amazon_redshift_target, :evaluate_data_quality_multi_frame, :recipe, :snowflake_source, :snowflake_target, :connector_data_source, :connector_data_target) SENSITIVE = [] include Aws::Structure end |
#dynamo_db_catalog_source ⇒ Types::DynamoDBCatalogSource
Specifies a DynamoDBC Catalog data store in the Glue Data Catalog.
2813 2814 2815 2816 2817 2818 2819 2820 2821 2822 2823 2824 2825 2826 2827 2828 2829 2830 2831 2832 2833 2834 2835 2836 2837 2838 2839 2840 2841 2842 2843 2844 2845 2846 2847 2848 2849 2850 2851 2852 2853 2854 2855 2856 2857 2858 2859 2860 2861 2862 2863 2864 2865 2866 2867 2868 2869 2870 2871 2872 2873 2874 2875 2876 2877 2878 2879 2880 2881 2882 2883 2884 2885 2886 2887 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 2813 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target, :amazon_redshift_source, :amazon_redshift_target, :evaluate_data_quality_multi_frame, :recipe, :snowflake_source, :snowflake_target, :connector_data_source, :connector_data_target) SENSITIVE = [] include Aws::Structure end |
#evaluate_data_quality ⇒ Types::EvaluateDataQuality
Specifies your data quality evaluation criteria.
2813 2814 2815 2816 2817 2818 2819 2820 2821 2822 2823 2824 2825 2826 2827 2828 2829 2830 2831 2832 2833 2834 2835 2836 2837 2838 2839 2840 2841 2842 2843 2844 2845 2846 2847 2848 2849 2850 2851 2852 2853 2854 2855 2856 2857 2858 2859 2860 2861 2862 2863 2864 2865 2866 2867 2868 2869 2870 2871 2872 2873 2874 2875 2876 2877 2878 2879 2880 2881 2882 2883 2884 2885 2886 2887 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 2813 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target, :amazon_redshift_source, :amazon_redshift_target, :evaluate_data_quality_multi_frame, :recipe, :snowflake_source, :snowflake_target, :connector_data_source, :connector_data_target) SENSITIVE = [] include Aws::Structure end |
#evaluate_data_quality_multi_frame ⇒ Types::EvaluateDataQualityMultiFrame
Specifies your data quality evaluation criteria. Allows multiple input data and returns a collection of Dynamic Frames.
2813 2814 2815 2816 2817 2818 2819 2820 2821 2822 2823 2824 2825 2826 2827 2828 2829 2830 2831 2832 2833 2834 2835 2836 2837 2838 2839 2840 2841 2842 2843 2844 2845 2846 2847 2848 2849 2850 2851 2852 2853 2854 2855 2856 2857 2858 2859 2860 2861 2862 2863 2864 2865 2866 2867 2868 2869 2870 2871 2872 2873 2874 2875 2876 2877 2878 2879 2880 2881 2882 2883 2884 2885 2886 2887 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 2813 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target, :amazon_redshift_source, :amazon_redshift_target, :evaluate_data_quality_multi_frame, :recipe, :snowflake_source, :snowflake_target, :connector_data_source, :connector_data_target) SENSITIVE = [] include Aws::Structure end |
#fill_missing_values ⇒ Types::FillMissingValues
Specifies a transform that locates records in the dataset that have missing values and adds a new field with a value determined by imputation. The input data set is used to train the machine learning model that determines what the missing value should be.
2813 2814 2815 2816 2817 2818 2819 2820 2821 2822 2823 2824 2825 2826 2827 2828 2829 2830 2831 2832 2833 2834 2835 2836 2837 2838 2839 2840 2841 2842 2843 2844 2845 2846 2847 2848 2849 2850 2851 2852 2853 2854 2855 2856 2857 2858 2859 2860 2861 2862 2863 2864 2865 2866 2867 2868 2869 2870 2871 2872 2873 2874 2875 2876 2877 2878 2879 2880 2881 2882 2883 2884 2885 2886 2887 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 2813 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target, :amazon_redshift_source, :amazon_redshift_target, :evaluate_data_quality_multi_frame, :recipe, :snowflake_source, :snowflake_target, :connector_data_source, :connector_data_target) SENSITIVE = [] include Aws::Structure end |
#filter ⇒ Types::Filter
Specifies a transform that splits a dataset into two, based on a filter condition.
2813 2814 2815 2816 2817 2818 2819 2820 2821 2822 2823 2824 2825 2826 2827 2828 2829 2830 2831 2832 2833 2834 2835 2836 2837 2838 2839 2840 2841 2842 2843 2844 2845 2846 2847 2848 2849 2850 2851 2852 2853 2854 2855 2856 2857 2858 2859 2860 2861 2862 2863 2864 2865 2866 2867 2868 2869 2870 2871 2872 2873 2874 2875 2876 2877 2878 2879 2880 2881 2882 2883 2884 2885 2886 2887 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 2813 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target, :amazon_redshift_source, :amazon_redshift_target, :evaluate_data_quality_multi_frame, :recipe, :snowflake_source, :snowflake_target, :connector_data_source, :connector_data_target) SENSITIVE = [] include Aws::Structure end |
#governed_catalog_source ⇒ Types::GovernedCatalogSource
Specifies a data source in a goverened Data Catalog.
2813 2814 2815 2816 2817 2818 2819 2820 2821 2822 2823 2824 2825 2826 2827 2828 2829 2830 2831 2832 2833 2834 2835 2836 2837 2838 2839 2840 2841 2842 2843 2844 2845 2846 2847 2848 2849 2850 2851 2852 2853 2854 2855 2856 2857 2858 2859 2860 2861 2862 2863 2864 2865 2866 2867 2868 2869 2870 2871 2872 2873 2874 2875 2876 2877 2878 2879 2880 2881 2882 2883 2884 2885 2886 2887 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 2813 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target, :amazon_redshift_source, :amazon_redshift_target, :evaluate_data_quality_multi_frame, :recipe, :snowflake_source, :snowflake_target, :connector_data_source, :connector_data_target) SENSITIVE = [] include Aws::Structure end |
#governed_catalog_target ⇒ Types::GovernedCatalogTarget
Specifies a data target that writes to a goverened catalog.
2813 2814 2815 2816 2817 2818 2819 2820 2821 2822 2823 2824 2825 2826 2827 2828 2829 2830 2831 2832 2833 2834 2835 2836 2837 2838 2839 2840 2841 2842 2843 2844 2845 2846 2847 2848 2849 2850 2851 2852 2853 2854 2855 2856 2857 2858 2859 2860 2861 2862 2863 2864 2865 2866 2867 2868 2869 2870 2871 2872 2873 2874 2875 2876 2877 2878 2879 2880 2881 2882 2883 2884 2885 2886 2887 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 2813 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target, :amazon_redshift_source, :amazon_redshift_target, :evaluate_data_quality_multi_frame, :recipe, :snowflake_source, :snowflake_target, :connector_data_source, :connector_data_target) SENSITIVE = [] include Aws::Structure end |
#jdbc_connector_source ⇒ Types::JDBCConnectorSource
Specifies a connector to a JDBC data source.
2813 2814 2815 2816 2817 2818 2819 2820 2821 2822 2823 2824 2825 2826 2827 2828 2829 2830 2831 2832 2833 2834 2835 2836 2837 2838 2839 2840 2841 2842 2843 2844 2845 2846 2847 2848 2849 2850 2851 2852 2853 2854 2855 2856 2857 2858 2859 2860 2861 2862 2863 2864 2865 2866 2867 2868 2869 2870 2871 2872 2873 2874 2875 2876 2877 2878 2879 2880 2881 2882 2883 2884 2885 2886 2887 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 2813 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target, :amazon_redshift_source, :amazon_redshift_target, :evaluate_data_quality_multi_frame, :recipe, :snowflake_source, :snowflake_target, :connector_data_source, :connector_data_target) SENSITIVE = [] include Aws::Structure end |
#jdbc_connector_target ⇒ Types::JDBCConnectorTarget
Specifies a data target that writes to Amazon S3 in Apache Parquet columnar storage.
2813 2814 2815 2816 2817 2818 2819 2820 2821 2822 2823 2824 2825 2826 2827 2828 2829 2830 2831 2832 2833 2834 2835 2836 2837 2838 2839 2840 2841 2842 2843 2844 2845 2846 2847 2848 2849 2850 2851 2852 2853 2854 2855 2856 2857 2858 2859 2860 2861 2862 2863 2864 2865 2866 2867 2868 2869 2870 2871 2872 2873 2874 2875 2876 2877 2878 2879 2880 2881 2882 2883 2884 2885 2886 2887 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 2813 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target, :amazon_redshift_source, :amazon_redshift_target, :evaluate_data_quality_multi_frame, :recipe, :snowflake_source, :snowflake_target, :connector_data_source, :connector_data_target) SENSITIVE = [] include Aws::Structure end |
#join ⇒ Types::Join
Specifies a transform that joins two datasets into one dataset using a comparison phrase on the specified data property keys. You can use inner, outer, left, right, left semi, and left anti joins.
2813 2814 2815 2816 2817 2818 2819 2820 2821 2822 2823 2824 2825 2826 2827 2828 2829 2830 2831 2832 2833 2834 2835 2836 2837 2838 2839 2840 2841 2842 2843 2844 2845 2846 2847 2848 2849 2850 2851 2852 2853 2854 2855 2856 2857 2858 2859 2860 2861 2862 2863 2864 2865 2866 2867 2868 2869 2870 2871 2872 2873 2874 2875 2876 2877 2878 2879 2880 2881 2882 2883 2884 2885 2886 2887 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 2813 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target, :amazon_redshift_source, :amazon_redshift_target, :evaluate_data_quality_multi_frame, :recipe, :snowflake_source, :snowflake_target, :connector_data_source, :connector_data_target) SENSITIVE = [] include Aws::Structure end |
#merge ⇒ Types::Merge
Specifies a transform that merges a DynamicFrame
with a staging
DynamicFrame
based on the specified primary keys to identify
records. Duplicate records (records with the same primary keys) are
not de-duplicated.
2813 2814 2815 2816 2817 2818 2819 2820 2821 2822 2823 2824 2825 2826 2827 2828 2829 2830 2831 2832 2833 2834 2835 2836 2837 2838 2839 2840 2841 2842 2843 2844 2845 2846 2847 2848 2849 2850 2851 2852 2853 2854 2855 2856 2857 2858 2859 2860 2861 2862 2863 2864 2865 2866 2867 2868 2869 2870 2871 2872 2873 2874 2875 2876 2877 2878 2879 2880 2881 2882 2883 2884 2885 2886 2887 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 2813 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target, :amazon_redshift_source, :amazon_redshift_target, :evaluate_data_quality_multi_frame, :recipe, :snowflake_source, :snowflake_target, :connector_data_source, :connector_data_target) SENSITIVE = [] include Aws::Structure end |
#microsoft_sql_server_catalog_source ⇒ Types::MicrosoftSQLServerCatalogSource
Specifies a Microsoft SQL server data source in the Glue Data Catalog.
2813 2814 2815 2816 2817 2818 2819 2820 2821 2822 2823 2824 2825 2826 2827 2828 2829 2830 2831 2832 2833 2834 2835 2836 2837 2838 2839 2840 2841 2842 2843 2844 2845 2846 2847 2848 2849 2850 2851 2852 2853 2854 2855 2856 2857 2858 2859 2860 2861 2862 2863 2864 2865 2866 2867 2868 2869 2870 2871 2872 2873 2874 2875 2876 2877 2878 2879 2880 2881 2882 2883 2884 2885 2886 2887 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 2813 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target, :amazon_redshift_source, :amazon_redshift_target, :evaluate_data_quality_multi_frame, :recipe, :snowflake_source, :snowflake_target, :connector_data_source, :connector_data_target) SENSITIVE = [] include Aws::Structure end |
#microsoft_sql_server_catalog_target ⇒ Types::MicrosoftSQLServerCatalogTarget
Specifies a target that uses Microsoft SQL.
2813 2814 2815 2816 2817 2818 2819 2820 2821 2822 2823 2824 2825 2826 2827 2828 2829 2830 2831 2832 2833 2834 2835 2836 2837 2838 2839 2840 2841 2842 2843 2844 2845 2846 2847 2848 2849 2850 2851 2852 2853 2854 2855 2856 2857 2858 2859 2860 2861 2862 2863 2864 2865 2866 2867 2868 2869 2870 2871 2872 2873 2874 2875 2876 2877 2878 2879 2880 2881 2882 2883 2884 2885 2886 2887 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 2813 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target, :amazon_redshift_source, :amazon_redshift_target, :evaluate_data_quality_multi_frame, :recipe, :snowflake_source, :snowflake_target, :connector_data_source, :connector_data_target) SENSITIVE = [] include Aws::Structure end |
#my_sql_catalog_source ⇒ Types::MySQLCatalogSource
Specifies a MySQL data source in the Glue Data Catalog.
2813 2814 2815 2816 2817 2818 2819 2820 2821 2822 2823 2824 2825 2826 2827 2828 2829 2830 2831 2832 2833 2834 2835 2836 2837 2838 2839 2840 2841 2842 2843 2844 2845 2846 2847 2848 2849 2850 2851 2852 2853 2854 2855 2856 2857 2858 2859 2860 2861 2862 2863 2864 2865 2866 2867 2868 2869 2870 2871 2872 2873 2874 2875 2876 2877 2878 2879 2880 2881 2882 2883 2884 2885 2886 2887 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 2813 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target, :amazon_redshift_source, :amazon_redshift_target, :evaluate_data_quality_multi_frame, :recipe, :snowflake_source, :snowflake_target, :connector_data_source, :connector_data_target) SENSITIVE = [] include Aws::Structure end |
#my_sql_catalog_target ⇒ Types::MySQLCatalogTarget
Specifies a target that uses MySQL.
2813 2814 2815 2816 2817 2818 2819 2820 2821 2822 2823 2824 2825 2826 2827 2828 2829 2830 2831 2832 2833 2834 2835 2836 2837 2838 2839 2840 2841 2842 2843 2844 2845 2846 2847 2848 2849 2850 2851 2852 2853 2854 2855 2856 2857 2858 2859 2860 2861 2862 2863 2864 2865 2866 2867 2868 2869 2870 2871 2872 2873 2874 2875 2876 2877 2878 2879 2880 2881 2882 2883 2884 2885 2886 2887 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 2813 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target, :amazon_redshift_source, :amazon_redshift_target, :evaluate_data_quality_multi_frame, :recipe, :snowflake_source, :snowflake_target, :connector_data_source, :connector_data_target) SENSITIVE = [] include Aws::Structure end |
#oracle_sql_catalog_source ⇒ Types::OracleSQLCatalogSource
Specifies an Oracle data source in the Glue Data Catalog.
2813 2814 2815 2816 2817 2818 2819 2820 2821 2822 2823 2824 2825 2826 2827 2828 2829 2830 2831 2832 2833 2834 2835 2836 2837 2838 2839 2840 2841 2842 2843 2844 2845 2846 2847 2848 2849 2850 2851 2852 2853 2854 2855 2856 2857 2858 2859 2860 2861 2862 2863 2864 2865 2866 2867 2868 2869 2870 2871 2872 2873 2874 2875 2876 2877 2878 2879 2880 2881 2882 2883 2884 2885 2886 2887 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 2813 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target, :amazon_redshift_source, :amazon_redshift_target, :evaluate_data_quality_multi_frame, :recipe, :snowflake_source, :snowflake_target, :connector_data_source, :connector_data_target) SENSITIVE = [] include Aws::Structure end |
#oracle_sql_catalog_target ⇒ Types::OracleSQLCatalogTarget
Specifies a target that uses Oracle SQL.
2813 2814 2815 2816 2817 2818 2819 2820 2821 2822 2823 2824 2825 2826 2827 2828 2829 2830 2831 2832 2833 2834 2835 2836 2837 2838 2839 2840 2841 2842 2843 2844 2845 2846 2847 2848 2849 2850 2851 2852 2853 2854 2855 2856 2857 2858 2859 2860 2861 2862 2863 2864 2865 2866 2867 2868 2869 2870 2871 2872 2873 2874 2875 2876 2877 2878 2879 2880 2881 2882 2883 2884 2885 2886 2887 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 2813 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target, :amazon_redshift_source, :amazon_redshift_target, :evaluate_data_quality_multi_frame, :recipe, :snowflake_source, :snowflake_target, :connector_data_source, :connector_data_target) SENSITIVE = [] include Aws::Structure end |
#pii_detection ⇒ Types::PIIDetection
Specifies a transform that identifies, removes or masks PII data.
2813 2814 2815 2816 2817 2818 2819 2820 2821 2822 2823 2824 2825 2826 2827 2828 2829 2830 2831 2832 2833 2834 2835 2836 2837 2838 2839 2840 2841 2842 2843 2844 2845 2846 2847 2848 2849 2850 2851 2852 2853 2854 2855 2856 2857 2858 2859 2860 2861 2862 2863 2864 2865 2866 2867 2868 2869 2870 2871 2872 2873 2874 2875 2876 2877 2878 2879 2880 2881 2882 2883 2884 2885 2886 2887 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 2813 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target, :amazon_redshift_source, :amazon_redshift_target, :evaluate_data_quality_multi_frame, :recipe, :snowflake_source, :snowflake_target, :connector_data_source, :connector_data_target) SENSITIVE = [] include Aws::Structure end |
#postgre_sql_catalog_source ⇒ Types::PostgreSQLCatalogSource
Specifies a PostgresSQL data source in the Glue Data Catalog.
2813 2814 2815 2816 2817 2818 2819 2820 2821 2822 2823 2824 2825 2826 2827 2828 2829 2830 2831 2832 2833 2834 2835 2836 2837 2838 2839 2840 2841 2842 2843 2844 2845 2846 2847 2848 2849 2850 2851 2852 2853 2854 2855 2856 2857 2858 2859 2860 2861 2862 2863 2864 2865 2866 2867 2868 2869 2870 2871 2872 2873 2874 2875 2876 2877 2878 2879 2880 2881 2882 2883 2884 2885 2886 2887 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 2813 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target, :amazon_redshift_source, :amazon_redshift_target, :evaluate_data_quality_multi_frame, :recipe, :snowflake_source, :snowflake_target, :connector_data_source, :connector_data_target) SENSITIVE = [] include Aws::Structure end |
#postgre_sql_catalog_target ⇒ Types::PostgreSQLCatalogTarget
Specifies a target that uses Postgres SQL.
2813 2814 2815 2816 2817 2818 2819 2820 2821 2822 2823 2824 2825 2826 2827 2828 2829 2830 2831 2832 2833 2834 2835 2836 2837 2838 2839 2840 2841 2842 2843 2844 2845 2846 2847 2848 2849 2850 2851 2852 2853 2854 2855 2856 2857 2858 2859 2860 2861 2862 2863 2864 2865 2866 2867 2868 2869 2870 2871 2872 2873 2874 2875 2876 2877 2878 2879 2880 2881 2882 2883 2884 2885 2886 2887 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 2813 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target, :amazon_redshift_source, :amazon_redshift_target, :evaluate_data_quality_multi_frame, :recipe, :snowflake_source, :snowflake_target, :connector_data_source, :connector_data_target) SENSITIVE = [] include Aws::Structure end |
#recipe ⇒ Types::Recipe
Specifies a Glue DataBrew recipe node.
2813 2814 2815 2816 2817 2818 2819 2820 2821 2822 2823 2824 2825 2826 2827 2828 2829 2830 2831 2832 2833 2834 2835 2836 2837 2838 2839 2840 2841 2842 2843 2844 2845 2846 2847 2848 2849 2850 2851 2852 2853 2854 2855 2856 2857 2858 2859 2860 2861 2862 2863 2864 2865 2866 2867 2868 2869 2870 2871 2872 2873 2874 2875 2876 2877 2878 2879 2880 2881 2882 2883 2884 2885 2886 2887 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 2813 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target, :amazon_redshift_source, :amazon_redshift_target, :evaluate_data_quality_multi_frame, :recipe, :snowflake_source, :snowflake_target, :connector_data_source, :connector_data_target) SENSITIVE = [] include Aws::Structure end |
#redshift_source ⇒ Types::RedshiftSource
Specifies an Amazon Redshift data store.
2813 2814 2815 2816 2817 2818 2819 2820 2821 2822 2823 2824 2825 2826 2827 2828 2829 2830 2831 2832 2833 2834 2835 2836 2837 2838 2839 2840 2841 2842 2843 2844 2845 2846 2847 2848 2849 2850 2851 2852 2853 2854 2855 2856 2857 2858 2859 2860 2861 2862 2863 2864 2865 2866 2867 2868 2869 2870 2871 2872 2873 2874 2875 2876 2877 2878 2879 2880 2881 2882 2883 2884 2885 2886 2887 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 2813 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target, :amazon_redshift_source, :amazon_redshift_target, :evaluate_data_quality_multi_frame, :recipe, :snowflake_source, :snowflake_target, :connector_data_source, :connector_data_target) SENSITIVE = [] include Aws::Structure end |
#redshift_target ⇒ Types::RedshiftTarget
Specifies a target that uses Amazon Redshift.
2813 2814 2815 2816 2817 2818 2819 2820 2821 2822 2823 2824 2825 2826 2827 2828 2829 2830 2831 2832 2833 2834 2835 2836 2837 2838 2839 2840 2841 2842 2843 2844 2845 2846 2847 2848 2849 2850 2851 2852 2853 2854 2855 2856 2857 2858 2859 2860 2861 2862 2863 2864 2865 2866 2867 2868 2869 2870 2871 2872 2873 2874 2875 2876 2877 2878 2879 2880 2881 2882 2883 2884 2885 2886 2887 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 2813 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target, :amazon_redshift_source, :amazon_redshift_target, :evaluate_data_quality_multi_frame, :recipe, :snowflake_source, :snowflake_target, :connector_data_source, :connector_data_target) SENSITIVE = [] include Aws::Structure end |
#relational_catalog_source ⇒ Types::RelationalCatalogSource
Specifies a relational catalog data store in the Glue Data Catalog.
2813 2814 2815 2816 2817 2818 2819 2820 2821 2822 2823 2824 2825 2826 2827 2828 2829 2830 2831 2832 2833 2834 2835 2836 2837 2838 2839 2840 2841 2842 2843 2844 2845 2846 2847 2848 2849 2850 2851 2852 2853 2854 2855 2856 2857 2858 2859 2860 2861 2862 2863 2864 2865 2866 2867 2868 2869 2870 2871 2872 2873 2874 2875 2876 2877 2878 2879 2880 2881 2882 2883 2884 2885 2886 2887 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 2813 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target, :amazon_redshift_source, :amazon_redshift_target, :evaluate_data_quality_multi_frame, :recipe, :snowflake_source, :snowflake_target, :connector_data_source, :connector_data_target) SENSITIVE = [] include Aws::Structure end |
#rename_field ⇒ Types::RenameField
Specifies a transform that renames a single data property key.
2813 2814 2815 2816 2817 2818 2819 2820 2821 2822 2823 2824 2825 2826 2827 2828 2829 2830 2831 2832 2833 2834 2835 2836 2837 2838 2839 2840 2841 2842 2843 2844 2845 2846 2847 2848 2849 2850 2851 2852 2853 2854 2855 2856 2857 2858 2859 2860 2861 2862 2863 2864 2865 2866 2867 2868 2869 2870 2871 2872 2873 2874 2875 2876 2877 2878 2879 2880 2881 2882 2883 2884 2885 2886 2887 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 2813 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target, :amazon_redshift_source, :amazon_redshift_target, :evaluate_data_quality_multi_frame, :recipe, :snowflake_source, :snowflake_target, :connector_data_source, :connector_data_target) SENSITIVE = [] include Aws::Structure end |
#s3_catalog_delta_source ⇒ Types::S3CatalogDeltaSource
Specifies a Delta Lake data source that is registered in the Glue Data Catalog. The data source must be stored in Amazon S3.
2813 2814 2815 2816 2817 2818 2819 2820 2821 2822 2823 2824 2825 2826 2827 2828 2829 2830 2831 2832 2833 2834 2835 2836 2837 2838 2839 2840 2841 2842 2843 2844 2845 2846 2847 2848 2849 2850 2851 2852 2853 2854 2855 2856 2857 2858 2859 2860 2861 2862 2863 2864 2865 2866 2867 2868 2869 2870 2871 2872 2873 2874 2875 2876 2877 2878 2879 2880 2881 2882 2883 2884 2885 2886 2887 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 2813 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target, :amazon_redshift_source, :amazon_redshift_target, :evaluate_data_quality_multi_frame, :recipe, :snowflake_source, :snowflake_target, :connector_data_source, :connector_data_target) SENSITIVE = [] include Aws::Structure end |
#s3_catalog_hudi_source ⇒ Types::S3CatalogHudiSource
Specifies a Hudi data source that is registered in the Glue Data Catalog. The data source must be stored in Amazon S3.
2813 2814 2815 2816 2817 2818 2819 2820 2821 2822 2823 2824 2825 2826 2827 2828 2829 2830 2831 2832 2833 2834 2835 2836 2837 2838 2839 2840 2841 2842 2843 2844 2845 2846 2847 2848 2849 2850 2851 2852 2853 2854 2855 2856 2857 2858 2859 2860 2861 2862 2863 2864 2865 2866 2867 2868 2869 2870 2871 2872 2873 2874 2875 2876 2877 2878 2879 2880 2881 2882 2883 2884 2885 2886 2887 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 2813 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target, :amazon_redshift_source, :amazon_redshift_target, :evaluate_data_quality_multi_frame, :recipe, :snowflake_source, :snowflake_target, :connector_data_source, :connector_data_target) SENSITIVE = [] include Aws::Structure end |
#s3_catalog_source ⇒ Types::S3CatalogSource
Specifies an Amazon S3 data store in the Glue Data Catalog.
2813 2814 2815 2816 2817 2818 2819 2820 2821 2822 2823 2824 2825 2826 2827 2828 2829 2830 2831 2832 2833 2834 2835 2836 2837 2838 2839 2840 2841 2842 2843 2844 2845 2846 2847 2848 2849 2850 2851 2852 2853 2854 2855 2856 2857 2858 2859 2860 2861 2862 2863 2864 2865 2866 2867 2868 2869 2870 2871 2872 2873 2874 2875 2876 2877 2878 2879 2880 2881 2882 2883 2884 2885 2886 2887 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 2813 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target, :amazon_redshift_source, :amazon_redshift_target, :evaluate_data_quality_multi_frame, :recipe, :snowflake_source, :snowflake_target, :connector_data_source, :connector_data_target) SENSITIVE = [] include Aws::Structure end |
#s3_catalog_target ⇒ Types::S3CatalogTarget
Specifies a data target that writes to Amazon S3 using the Glue Data Catalog.
2813 2814 2815 2816 2817 2818 2819 2820 2821 2822 2823 2824 2825 2826 2827 2828 2829 2830 2831 2832 2833 2834 2835 2836 2837 2838 2839 2840 2841 2842 2843 2844 2845 2846 2847 2848 2849 2850 2851 2852 2853 2854 2855 2856 2857 2858 2859 2860 2861 2862 2863 2864 2865 2866 2867 2868 2869 2870 2871 2872 2873 2874 2875 2876 2877 2878 2879 2880 2881 2882 2883 2884 2885 2886 2887 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 2813 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target, :amazon_redshift_source, :amazon_redshift_target, :evaluate_data_quality_multi_frame, :recipe, :snowflake_source, :snowflake_target, :connector_data_source, :connector_data_target) SENSITIVE = [] include Aws::Structure end |
#s3_csv_source ⇒ Types::S3CsvSource
Specifies a command-separated value (CSV) data store stored in Amazon S3.
2813 2814 2815 2816 2817 2818 2819 2820 2821 2822 2823 2824 2825 2826 2827 2828 2829 2830 2831 2832 2833 2834 2835 2836 2837 2838 2839 2840 2841 2842 2843 2844 2845 2846 2847 2848 2849 2850 2851 2852 2853 2854 2855 2856 2857 2858 2859 2860 2861 2862 2863 2864 2865 2866 2867 2868 2869 2870 2871 2872 2873 2874 2875 2876 2877 2878 2879 2880 2881 2882 2883 2884 2885 2886 2887 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 2813 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target, :amazon_redshift_source, :amazon_redshift_target, :evaluate_data_quality_multi_frame, :recipe, :snowflake_source, :snowflake_target, :connector_data_source, :connector_data_target) SENSITIVE = [] include Aws::Structure end |
#s3_delta_catalog_target ⇒ Types::S3DeltaCatalogTarget
Specifies a target that writes to a Delta Lake data source in the Glue Data Catalog.
2813 2814 2815 2816 2817 2818 2819 2820 2821 2822 2823 2824 2825 2826 2827 2828 2829 2830 2831 2832 2833 2834 2835 2836 2837 2838 2839 2840 2841 2842 2843 2844 2845 2846 2847 2848 2849 2850 2851 2852 2853 2854 2855 2856 2857 2858 2859 2860 2861 2862 2863 2864 2865 2866 2867 2868 2869 2870 2871 2872 2873 2874 2875 2876 2877 2878 2879 2880 2881 2882 2883 2884 2885 2886 2887 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 2813 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target, :amazon_redshift_source, :amazon_redshift_target, :evaluate_data_quality_multi_frame, :recipe, :snowflake_source, :snowflake_target, :connector_data_source, :connector_data_target) SENSITIVE = [] include Aws::Structure end |
#s3_delta_direct_target ⇒ Types::S3DeltaDirectTarget
Specifies a target that writes to a Delta Lake data source in Amazon S3.
2813 2814 2815 2816 2817 2818 2819 2820 2821 2822 2823 2824 2825 2826 2827 2828 2829 2830 2831 2832 2833 2834 2835 2836 2837 2838 2839 2840 2841 2842 2843 2844 2845 2846 2847 2848 2849 2850 2851 2852 2853 2854 2855 2856 2857 2858 2859 2860 2861 2862 2863 2864 2865 2866 2867 2868 2869 2870 2871 2872 2873 2874 2875 2876 2877 2878 2879 2880 2881 2882 2883 2884 2885 2886 2887 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 2813 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target, :amazon_redshift_source, :amazon_redshift_target, :evaluate_data_quality_multi_frame, :recipe, :snowflake_source, :snowflake_target, :connector_data_source, :connector_data_target) SENSITIVE = [] include Aws::Structure end |
#s3_delta_source ⇒ Types::S3DeltaSource
Specifies a Delta Lake data source stored in Amazon S3.
2813 2814 2815 2816 2817 2818 2819 2820 2821 2822 2823 2824 2825 2826 2827 2828 2829 2830 2831 2832 2833 2834 2835 2836 2837 2838 2839 2840 2841 2842 2843 2844 2845 2846 2847 2848 2849 2850 2851 2852 2853 2854 2855 2856 2857 2858 2859 2860 2861 2862 2863 2864 2865 2866 2867 2868 2869 2870 2871 2872 2873 2874 2875 2876 2877 2878 2879 2880 2881 2882 2883 2884 2885 2886 2887 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 2813 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target, :amazon_redshift_source, :amazon_redshift_target, :evaluate_data_quality_multi_frame, :recipe, :snowflake_source, :snowflake_target, :connector_data_source, :connector_data_target) SENSITIVE = [] include Aws::Structure end |
#s3_direct_target ⇒ Types::S3DirectTarget
Specifies a data target that writes to Amazon S3.
2813 2814 2815 2816 2817 2818 2819 2820 2821 2822 2823 2824 2825 2826 2827 2828 2829 2830 2831 2832 2833 2834 2835 2836 2837 2838 2839 2840 2841 2842 2843 2844 2845 2846 2847 2848 2849 2850 2851 2852 2853 2854 2855 2856 2857 2858 2859 2860 2861 2862 2863 2864 2865 2866 2867 2868 2869 2870 2871 2872 2873 2874 2875 2876 2877 2878 2879 2880 2881 2882 2883 2884 2885 2886 2887 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 2813 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target, :amazon_redshift_source, :amazon_redshift_target, :evaluate_data_quality_multi_frame, :recipe, :snowflake_source, :snowflake_target, :connector_data_source, :connector_data_target) SENSITIVE = [] include Aws::Structure end |
#s3_glue_parquet_target ⇒ Types::S3GlueParquetTarget
Specifies a data target that writes to Amazon S3 in Apache Parquet columnar storage.
2813 2814 2815 2816 2817 2818 2819 2820 2821 2822 2823 2824 2825 2826 2827 2828 2829 2830 2831 2832 2833 2834 2835 2836 2837 2838 2839 2840 2841 2842 2843 2844 2845 2846 2847 2848 2849 2850 2851 2852 2853 2854 2855 2856 2857 2858 2859 2860 2861 2862 2863 2864 2865 2866 2867 2868 2869 2870 2871 2872 2873 2874 2875 2876 2877 2878 2879 2880 2881 2882 2883 2884 2885 2886 2887 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 2813 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target, :amazon_redshift_source, :amazon_redshift_target, :evaluate_data_quality_multi_frame, :recipe, :snowflake_source, :snowflake_target, :connector_data_source, :connector_data_target) SENSITIVE = [] include Aws::Structure end |
#s3_hudi_catalog_target ⇒ Types::S3HudiCatalogTarget
Specifies a target that writes to a Hudi data source in the Glue Data Catalog.
2813 2814 2815 2816 2817 2818 2819 2820 2821 2822 2823 2824 2825 2826 2827 2828 2829 2830 2831 2832 2833 2834 2835 2836 2837 2838 2839 2840 2841 2842 2843 2844 2845 2846 2847 2848 2849 2850 2851 2852 2853 2854 2855 2856 2857 2858 2859 2860 2861 2862 2863 2864 2865 2866 2867 2868 2869 2870 2871 2872 2873 2874 2875 2876 2877 2878 2879 2880 2881 2882 2883 2884 2885 2886 2887 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 2813 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target, :amazon_redshift_source, :amazon_redshift_target, :evaluate_data_quality_multi_frame, :recipe, :snowflake_source, :snowflake_target, :connector_data_source, :connector_data_target) SENSITIVE = [] include Aws::Structure end |
#s3_hudi_direct_target ⇒ Types::S3HudiDirectTarget
Specifies a target that writes to a Hudi data source in Amazon S3.
2813 2814 2815 2816 2817 2818 2819 2820 2821 2822 2823 2824 2825 2826 2827 2828 2829 2830 2831 2832 2833 2834 2835 2836 2837 2838 2839 2840 2841 2842 2843 2844 2845 2846 2847 2848 2849 2850 2851 2852 2853 2854 2855 2856 2857 2858 2859 2860 2861 2862 2863 2864 2865 2866 2867 2868 2869 2870 2871 2872 2873 2874 2875 2876 2877 2878 2879 2880 2881 2882 2883 2884 2885 2886 2887 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 2813 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target, :amazon_redshift_source, :amazon_redshift_target, :evaluate_data_quality_multi_frame, :recipe, :snowflake_source, :snowflake_target, :connector_data_source, :connector_data_target) SENSITIVE = [] include Aws::Structure end |
#s3_hudi_source ⇒ Types::S3HudiSource
Specifies a Hudi data source stored in Amazon S3.
2813 2814 2815 2816 2817 2818 2819 2820 2821 2822 2823 2824 2825 2826 2827 2828 2829 2830 2831 2832 2833 2834 2835 2836 2837 2838 2839 2840 2841 2842 2843 2844 2845 2846 2847 2848 2849 2850 2851 2852 2853 2854 2855 2856 2857 2858 2859 2860 2861 2862 2863 2864 2865 2866 2867 2868 2869 2870 2871 2872 2873 2874 2875 2876 2877 2878 2879 2880 2881 2882 2883 2884 2885 2886 2887 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 2813 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target, :amazon_redshift_source, :amazon_redshift_target, :evaluate_data_quality_multi_frame, :recipe, :snowflake_source, :snowflake_target, :connector_data_source, :connector_data_target) SENSITIVE = [] include Aws::Structure end |
#s3_json_source ⇒ Types::S3JsonSource
Specifies a JSON data store stored in Amazon S3.
2813 2814 2815 2816 2817 2818 2819 2820 2821 2822 2823 2824 2825 2826 2827 2828 2829 2830 2831 2832 2833 2834 2835 2836 2837 2838 2839 2840 2841 2842 2843 2844 2845 2846 2847 2848 2849 2850 2851 2852 2853 2854 2855 2856 2857 2858 2859 2860 2861 2862 2863 2864 2865 2866 2867 2868 2869 2870 2871 2872 2873 2874 2875 2876 2877 2878 2879 2880 2881 2882 2883 2884 2885 2886 2887 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 2813 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target, :amazon_redshift_source, :amazon_redshift_target, :evaluate_data_quality_multi_frame, :recipe, :snowflake_source, :snowflake_target, :connector_data_source, :connector_data_target) SENSITIVE = [] include Aws::Structure end |
#s3_parquet_source ⇒ Types::S3ParquetSource
Specifies an Apache Parquet data store stored in Amazon S3.
2813 2814 2815 2816 2817 2818 2819 2820 2821 2822 2823 2824 2825 2826 2827 2828 2829 2830 2831 2832 2833 2834 2835 2836 2837 2838 2839 2840 2841 2842 2843 2844 2845 2846 2847 2848 2849 2850 2851 2852 2853 2854 2855 2856 2857 2858 2859 2860 2861 2862 2863 2864 2865 2866 2867 2868 2869 2870 2871 2872 2873 2874 2875 2876 2877 2878 2879 2880 2881 2882 2883 2884 2885 2886 2887 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 2813 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target, :amazon_redshift_source, :amazon_redshift_target, :evaluate_data_quality_multi_frame, :recipe, :snowflake_source, :snowflake_target, :connector_data_source, :connector_data_target) SENSITIVE = [] include Aws::Structure end |
#select_fields ⇒ Types::SelectFields
Specifies a transform that chooses the data property keys that you want to keep.
2813 2814 2815 2816 2817 2818 2819 2820 2821 2822 2823 2824 2825 2826 2827 2828 2829 2830 2831 2832 2833 2834 2835 2836 2837 2838 2839 2840 2841 2842 2843 2844 2845 2846 2847 2848 2849 2850 2851 2852 2853 2854 2855 2856 2857 2858 2859 2860 2861 2862 2863 2864 2865 2866 2867 2868 2869 2870 2871 2872 2873 2874 2875 2876 2877 2878 2879 2880 2881 2882 2883 2884 2885 2886 2887 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 2813 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target, :amazon_redshift_source, :amazon_redshift_target, :evaluate_data_quality_multi_frame, :recipe, :snowflake_source, :snowflake_target, :connector_data_source, :connector_data_target) SENSITIVE = [] include Aws::Structure end |
#select_from_collection ⇒ Types::SelectFromCollection
Specifies a transform that chooses one DynamicFrame
from a
collection of DynamicFrames
. The output is the selected
DynamicFrame
2813 2814 2815 2816 2817 2818 2819 2820 2821 2822 2823 2824 2825 2826 2827 2828 2829 2830 2831 2832 2833 2834 2835 2836 2837 2838 2839 2840 2841 2842 2843 2844 2845 2846 2847 2848 2849 2850 2851 2852 2853 2854 2855 2856 2857 2858 2859 2860 2861 2862 2863 2864 2865 2866 2867 2868 2869 2870 2871 2872 2873 2874 2875 2876 2877 2878 2879 2880 2881 2882 2883 2884 2885 2886 2887 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 2813 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target, :amazon_redshift_source, :amazon_redshift_target, :evaluate_data_quality_multi_frame, :recipe, :snowflake_source, :snowflake_target, :connector_data_source, :connector_data_target) SENSITIVE = [] include Aws::Structure end |
#snowflake_source ⇒ Types::SnowflakeSource
Specifies a Snowflake data source.
2813 2814 2815 2816 2817 2818 2819 2820 2821 2822 2823 2824 2825 2826 2827 2828 2829 2830 2831 2832 2833 2834 2835 2836 2837 2838 2839 2840 2841 2842 2843 2844 2845 2846 2847 2848 2849 2850 2851 2852 2853 2854 2855 2856 2857 2858 2859 2860 2861 2862 2863 2864 2865 2866 2867 2868 2869 2870 2871 2872 2873 2874 2875 2876 2877 2878 2879 2880 2881 2882 2883 2884 2885 2886 2887 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 2813 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target, :amazon_redshift_source, :amazon_redshift_target, :evaluate_data_quality_multi_frame, :recipe, :snowflake_source, :snowflake_target, :connector_data_source, :connector_data_target) SENSITIVE = [] include Aws::Structure end |
#snowflake_target ⇒ Types::SnowflakeTarget
Specifies a target that writes to a Snowflake data source.
2813 2814 2815 2816 2817 2818 2819 2820 2821 2822 2823 2824 2825 2826 2827 2828 2829 2830 2831 2832 2833 2834 2835 2836 2837 2838 2839 2840 2841 2842 2843 2844 2845 2846 2847 2848 2849 2850 2851 2852 2853 2854 2855 2856 2857 2858 2859 2860 2861 2862 2863 2864 2865 2866 2867 2868 2869 2870 2871 2872 2873 2874 2875 2876 2877 2878 2879 2880 2881 2882 2883 2884 2885 2886 2887 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 2813 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target, :amazon_redshift_source, :amazon_redshift_target, :evaluate_data_quality_multi_frame, :recipe, :snowflake_source, :snowflake_target, :connector_data_source, :connector_data_target) SENSITIVE = [] include Aws::Structure end |
#spark_connector_source ⇒ Types::SparkConnectorSource
Specifies a connector to an Apache Spark data source.
2813 2814 2815 2816 2817 2818 2819 2820 2821 2822 2823 2824 2825 2826 2827 2828 2829 2830 2831 2832 2833 2834 2835 2836 2837 2838 2839 2840 2841 2842 2843 2844 2845 2846 2847 2848 2849 2850 2851 2852 2853 2854 2855 2856 2857 2858 2859 2860 2861 2862 2863 2864 2865 2866 2867 2868 2869 2870 2871 2872 2873 2874 2875 2876 2877 2878 2879 2880 2881 2882 2883 2884 2885 2886 2887 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 2813 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target, :amazon_redshift_source, :amazon_redshift_target, :evaluate_data_quality_multi_frame, :recipe, :snowflake_source, :snowflake_target, :connector_data_source, :connector_data_target) SENSITIVE = [] include Aws::Structure end |
#spark_connector_target ⇒ Types::SparkConnectorTarget
Specifies a target that uses an Apache Spark connector.
2813 2814 2815 2816 2817 2818 2819 2820 2821 2822 2823 2824 2825 2826 2827 2828 2829 2830 2831 2832 2833 2834 2835 2836 2837 2838 2839 2840 2841 2842 2843 2844 2845 2846 2847 2848 2849 2850 2851 2852 2853 2854 2855 2856 2857 2858 2859 2860 2861 2862 2863 2864 2865 2866 2867 2868 2869 2870 2871 2872 2873 2874 2875 2876 2877 2878 2879 2880 2881 2882 2883 2884 2885 2886 2887 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 2813 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target, :amazon_redshift_source, :amazon_redshift_target, :evaluate_data_quality_multi_frame, :recipe, :snowflake_source, :snowflake_target, :connector_data_source, :connector_data_target) SENSITIVE = [] include Aws::Structure end |
#spark_sql ⇒ Types::SparkSQL
Specifies a transform where you enter a SQL query using Spark SQL
syntax to transform the data. The output is a single DynamicFrame
.
2813 2814 2815 2816 2817 2818 2819 2820 2821 2822 2823 2824 2825 2826 2827 2828 2829 2830 2831 2832 2833 2834 2835 2836 2837 2838 2839 2840 2841 2842 2843 2844 2845 2846 2847 2848 2849 2850 2851 2852 2853 2854 2855 2856 2857 2858 2859 2860 2861 2862 2863 2864 2865 2866 2867 2868 2869 2870 2871 2872 2873 2874 2875 2876 2877 2878 2879 2880 2881 2882 2883 2884 2885 2886 2887 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 2813 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target, :amazon_redshift_source, :amazon_redshift_target, :evaluate_data_quality_multi_frame, :recipe, :snowflake_source, :snowflake_target, :connector_data_source, :connector_data_target) SENSITIVE = [] include Aws::Structure end |
#spigot ⇒ Types::Spigot
Specifies a transform that writes samples of the data to an Amazon S3 bucket.
2813 2814 2815 2816 2817 2818 2819 2820 2821 2822 2823 2824 2825 2826 2827 2828 2829 2830 2831 2832 2833 2834 2835 2836 2837 2838 2839 2840 2841 2842 2843 2844 2845 2846 2847 2848 2849 2850 2851 2852 2853 2854 2855 2856 2857 2858 2859 2860 2861 2862 2863 2864 2865 2866 2867 2868 2869 2870 2871 2872 2873 2874 2875 2876 2877 2878 2879 2880 2881 2882 2883 2884 2885 2886 2887 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 2813 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target, :amazon_redshift_source, :amazon_redshift_target, :evaluate_data_quality_multi_frame, :recipe, :snowflake_source, :snowflake_target, :connector_data_source, :connector_data_target) SENSITIVE = [] include Aws::Structure end |
#split_fields ⇒ Types::SplitFields
Specifies a transform that splits data property keys into two
DynamicFrames
. The output is a collection of DynamicFrames
: one
with selected data property keys, and one with the remaining data
property keys.
2813 2814 2815 2816 2817 2818 2819 2820 2821 2822 2823 2824 2825 2826 2827 2828 2829 2830 2831 2832 2833 2834 2835 2836 2837 2838 2839 2840 2841 2842 2843 2844 2845 2846 2847 2848 2849 2850 2851 2852 2853 2854 2855 2856 2857 2858 2859 2860 2861 2862 2863 2864 2865 2866 2867 2868 2869 2870 2871 2872 2873 2874 2875 2876 2877 2878 2879 2880 2881 2882 2883 2884 2885 2886 2887 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 2813 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target, :amazon_redshift_source, :amazon_redshift_target, :evaluate_data_quality_multi_frame, :recipe, :snowflake_source, :snowflake_target, :connector_data_source, :connector_data_target) SENSITIVE = [] include Aws::Structure end |
#union ⇒ Types::Union
Specifies a transform that combines the rows from two or more datasets into a single result.
2813 2814 2815 2816 2817 2818 2819 2820 2821 2822 2823 2824 2825 2826 2827 2828 2829 2830 2831 2832 2833 2834 2835 2836 2837 2838 2839 2840 2841 2842 2843 2844 2845 2846 2847 2848 2849 2850 2851 2852 2853 2854 2855 2856 2857 2858 2859 2860 2861 2862 2863 2864 2865 2866 2867 2868 2869 2870 2871 2872 2873 2874 2875 2876 2877 2878 2879 2880 2881 2882 2883 2884 2885 2886 2887 |
# File 'gems/aws-sdk-glue/lib/aws-sdk-glue/types.rb', line 2813 class CodeGenConfigurationNode < Struct.new( :athena_connector_source, :jdbc_connector_source, :spark_connector_source, :catalog_source, :redshift_source, :s3_catalog_source, :s3_csv_source, :s3_json_source, :s3_parquet_source, :relational_catalog_source, :dynamo_db_catalog_source, :jdbc_connector_target, :spark_connector_target, :catalog_target, :redshift_target, :s3_catalog_target, :s3_glue_parquet_target, :s3_direct_target, :apply_mapping, :select_fields, :drop_fields, :rename_field, :spigot, :join, :split_fields, :select_from_collection, :fill_missing_values, :filter, :custom_code, :spark_sql, :direct_kinesis_source, :direct_kafka_source, :catalog_kinesis_source, :catalog_kafka_source, :drop_null_fields, :merge, :union, :pii_detection, :aggregate, :drop_duplicates, :governed_catalog_target, :governed_catalog_source, :microsoft_sql_server_catalog_source, :my_sql_catalog_source, :oracle_sql_catalog_source, :postgre_sql_catalog_source, :microsoft_sql_server_catalog_target, :my_sql_catalog_target, :oracle_sql_catalog_target, :postgre_sql_catalog_target, :dynamic_transform, :evaluate_data_quality, :s3_catalog_hudi_source, :catalog_hudi_source, :s3_hudi_source, :s3_hudi_catalog_target, :s3_hudi_direct_target, :direct_jdbc_source, :s3_catalog_delta_source, :catalog_delta_source, :s3_delta_source, :s3_delta_catalog_target, :s3_delta_direct_target, :amazon_redshift_source, :amazon_redshift_target, :evaluate_data_quality_multi_frame, :recipe, :snowflake_source, :snowflake_target, :connector_data_source, :connector_data_target) SENSITIVE = [] include Aws::Structure end |