Class CfnJob
- All Implemented Interfaces:
IConstruct
,IDependable
,IInspectable
,software.amazon.jsii.JsiiSerializable
,software.constructs.IConstruct
AWS::DataBrew::Job
.
Specifies a new DataBrew job.
Example:
// The code below shows an example of how to instantiate this type. // The values are placeholders you should change. import software.amazon.awscdk.services.databrew.*; CfnJob cfnJob = CfnJob.Builder.create(this, "MyCfnJob") .name("name") .roleArn("roleArn") .type("type") // the properties below are optional .databaseOutputs(List.of(DatabaseOutputProperty.builder() .databaseOptions(DatabaseTableOutputOptionsProperty.builder() .tableName("tableName") // the properties below are optional .tempDirectory(S3LocationProperty.builder() .bucket("bucket") // the properties below are optional .bucketOwner("bucketOwner") .key("key") .build()) .build()) .glueConnectionName("glueConnectionName") // the properties below are optional .databaseOutputMode("databaseOutputMode") .build())) .dataCatalogOutputs(List.of(DataCatalogOutputProperty.builder() .databaseName("databaseName") .tableName("tableName") // the properties below are optional .catalogId("catalogId") .databaseOptions(DatabaseTableOutputOptionsProperty.builder() .tableName("tableName") // the properties below are optional .tempDirectory(S3LocationProperty.builder() .bucket("bucket") // the properties below are optional .bucketOwner("bucketOwner") .key("key") .build()) .build()) .overwrite(false) .s3Options(S3TableOutputOptionsProperty.builder() .location(S3LocationProperty.builder() .bucket("bucket") // the properties below are optional .bucketOwner("bucketOwner") .key("key") .build()) .build()) .build())) .datasetName("datasetName") .encryptionKeyArn("encryptionKeyArn") .encryptionMode("encryptionMode") .jobSample(JobSampleProperty.builder() .mode("mode") .size(123) .build()) .logSubscription("logSubscription") .maxCapacity(123) .maxRetries(123) .outputLocation(OutputLocationProperty.builder() .bucket("bucket") // the properties below are optional .bucketOwner("bucketOwner") .key("key") .build()) .outputs(List.of(OutputProperty.builder() .location(S3LocationProperty.builder() .bucket("bucket") // the properties below are optional .bucketOwner("bucketOwner") .key("key") .build()) // the properties below are optional .compressionFormat("compressionFormat") .format("format") .formatOptions(OutputFormatOptionsProperty.builder() .csv(CsvOutputOptionsProperty.builder() .delimiter("delimiter") .build()) .build()) .maxOutputFiles(123) .overwrite(false) .partitionColumns(List.of("partitionColumns")) .build())) .profileConfiguration(ProfileConfigurationProperty.builder() .columnStatisticsConfigurations(List.of(ColumnStatisticsConfigurationProperty.builder() .statistics(StatisticsConfigurationProperty.builder() .includedStatistics(List.of("includedStatistics")) .overrides(List.of(StatisticOverrideProperty.builder() .parameters(Map.of( "parametersKey", "parameters")) .statistic("statistic") .build())) .build()) // the properties below are optional .selectors(List.of(ColumnSelectorProperty.builder() .name("name") .regex("regex") .build())) .build())) .datasetStatisticsConfiguration(StatisticsConfigurationProperty.builder() .includedStatistics(List.of("includedStatistics")) .overrides(List.of(StatisticOverrideProperty.builder() .parameters(Map.of( "parametersKey", "parameters")) .statistic("statistic") .build())) .build()) .entityDetectorConfiguration(EntityDetectorConfigurationProperty.builder() .entityTypes(List.of("entityTypes")) // the properties below are optional .allowedStatistics(AllowedStatisticsProperty.builder() .statistics(List.of("statistics")) .build()) .build()) .profileColumns(List.of(ColumnSelectorProperty.builder() .name("name") .regex("regex") .build())) .build()) .projectName("projectName") .recipe(RecipeProperty.builder() .name("name") // the properties below are optional .version("version") .build()) .tags(List.of(CfnTag.builder() .key("key") .value("value") .build())) .timeout(123) .validationConfigurations(List.of(ValidationConfigurationProperty.builder() .rulesetArn("rulesetArn") // the properties below are optional .validationMode("validationMode") .build())) .build();
-
Nested Class Summary
Nested ClassesModifier and TypeClassDescriptionstatic interface
Configuration of statistics that are allowed to be run on columns that contain detected entities.static final class
A fluent builder forCfnJob
.static interface
Selector of a column from a dataset for profile job configuration.static interface
Configuration for column evaluations for a profile job.static interface
Represents a set of options that define how DataBrew will write a comma-separated value (CSV) file.static interface
Represents a JDBC database output object which defines the output destination for a DataBrew recipe job to write into.static interface
Represents options that specify how and where DataBrew writes the database output generated by recipe jobs.static interface
Represents options that specify how and where in the AWS Glue Data Catalog DataBrew writes the output generated by recipe jobs.static interface
Configuration of entity detection for a profile job.static interface
A sample configuration for profile jobs only, which determines the number of rows on which the profile job is run.static interface
Represents a set of options that define the structure of comma-separated (CSV) job output.static interface
The location in Amazon S3 or AWS Glue Data Catalog where the job writes its output.static interface
Represents options that specify how and where in Amazon S3 DataBrew writes the output generated by recipe jobs or profile jobs.static interface
Configuration for profile jobs.static interface
Represents one or more actions to be performed on a DataBrew dataset.static interface
Represents an Amazon S3 location (bucket name, bucket owner, and object key) where DataBrew can read input data, or write output from a job.static interface
Represents options that specify how and where DataBrew writes the Amazon S3 output generated by recipe jobs.static interface
Override of a particular evaluation for a profile job.static interface
Configuration of evaluations for a profile job.static interface
Configuration for data quality validation.Nested classes/interfaces inherited from class software.amazon.jsii.JsiiObject
software.amazon.jsii.JsiiObject.InitializationMode
Nested classes/interfaces inherited from interface software.amazon.awscdk.core.IConstruct
IConstruct.Jsii$Default
Nested classes/interfaces inherited from interface software.constructs.IConstruct
software.constructs.IConstruct.Jsii$Default
Nested classes/interfaces inherited from interface software.amazon.awscdk.core.IInspectable
IInspectable.Jsii$Default, IInspectable.Jsii$Proxy
-
Field Summary
FieldsModifier and TypeFieldDescriptionstatic final String
The CloudFormation resource type name for this resource class. -
Constructor Summary
Constructors -
Method Summary
Modifier and TypeMethodDescriptionRepresents a list of JDBC database output objects which defines the output destination for a DataBrew recipe job to write into.One or more artifacts that represent the AWS Glue Data Catalog output from running the job.A dataset that the job is to process.The Amazon Resource Name (ARN) of an encryption key that is used to protect the job output.The encryption mode for the job, which can be one of the following:.A sample configuration for profile jobs only, which determines the number of rows on which the profile job is run.The current status of Amazon CloudWatch logging for the job.The maximum number of nodes that can be consumed when the job processes data.The maximum number of times to retry the job after a job run fails.getName()
The unique name of the job.AWS::DataBrew::Job.OutputLocation
.One or more artifacts that represent output from running the job.Configuration for profile jobs.The name of the project that the job is associated with.A series of data transformation steps that the job runs.The Amazon Resource Name (ARN) of the role to be assumed for this job.getTags()
Metadata tags that have been applied to the job.The job's timeout in minutes.getType()
The job type of the job, which must be one of the following:.List of validation configurations that are applied to the profile job.void
inspect
(TreeInspector inspector) Examines the CloudFormation resource and discloses attributes.renderProperties
(Map<String, Object> props) void
setDatabaseOutputs
(List<Object> value) Represents a list of JDBC database output objects which defines the output destination for a DataBrew recipe job to write into.void
setDatabaseOutputs
(IResolvable value) Represents a list of JDBC database output objects which defines the output destination for a DataBrew recipe job to write into.void
setDataCatalogOutputs
(List<Object> value) One or more artifacts that represent the AWS Glue Data Catalog output from running the job.void
setDataCatalogOutputs
(IResolvable value) One or more artifacts that represent the AWS Glue Data Catalog output from running the job.void
setDatasetName
(String value) A dataset that the job is to process.void
setEncryptionKeyArn
(String value) The Amazon Resource Name (ARN) of an encryption key that is used to protect the job output.void
setEncryptionMode
(String value) The encryption mode for the job, which can be one of the following:.void
setJobSample
(IResolvable value) A sample configuration for profile jobs only, which determines the number of rows on which the profile job is run.void
A sample configuration for profile jobs only, which determines the number of rows on which the profile job is run.void
setLogSubscription
(String value) The current status of Amazon CloudWatch logging for the job.void
setMaxCapacity
(Number value) The maximum number of nodes that can be consumed when the job processes data.void
setMaxRetries
(Number value) The maximum number of times to retry the job after a job run fails.void
The unique name of the job.void
setOutputLocation
(IResolvable value) AWS::DataBrew::Job.OutputLocation
.void
AWS::DataBrew::Job.OutputLocation
.void
setOutputs
(List<Object> value) One or more artifacts that represent output from running the job.void
setOutputs
(IResolvable value) One or more artifacts that represent output from running the job.void
Configuration for profile jobs.void
Configuration for profile jobs.void
setProjectName
(String value) The name of the project that the job is associated with.void
setRecipe
(IResolvable value) A series of data transformation steps that the job runs.void
setRecipe
(CfnJob.RecipeProperty value) A series of data transformation steps that the job runs.void
setRoleArn
(String value) The Amazon Resource Name (ARN) of the role to be assumed for this job.void
setTimeout
(Number value) The job's timeout in minutes.void
The job type of the job, which must be one of the following:.void
setValidationConfigurations
(List<Object> value) List of validation configurations that are applied to the profile job.void
List of validation configurations that are applied to the profile job.Methods inherited from class software.amazon.awscdk.core.CfnResource
addDeletionOverride, addDependsOn, addMetadata, addOverride, addPropertyDeletionOverride, addPropertyOverride, applyRemovalPolicy, applyRemovalPolicy, applyRemovalPolicy, getAtt, getCfnOptions, getCfnResourceType, getMetadata, getUpdatedProperites, isCfnResource, shouldSynthesize, toString, validateProperties
Methods inherited from class software.amazon.awscdk.core.CfnRefElement
getRef
Methods inherited from class software.amazon.awscdk.core.CfnElement
getCreationStack, getLogicalId, getStack, isCfnElement, overrideLogicalId
Methods inherited from class software.amazon.awscdk.core.Construct
getNode, isConstruct, onPrepare, onSynthesize, onValidate, prepare, synthesize, validate
Methods inherited from class software.amazon.jsii.JsiiObject
jsiiAsyncCall, jsiiAsyncCall, jsiiCall, jsiiCall, jsiiGet, jsiiGet, jsiiSet, jsiiStaticCall, jsiiStaticCall, jsiiStaticGet, jsiiStaticGet, jsiiStaticSet, jsiiStaticSet
Methods inherited from class java.lang.Object
clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait
Methods inherited from interface software.amazon.jsii.JsiiSerializable
$jsii$toJson
-
Field Details
-
CFN_RESOURCE_TYPE_NAME
The CloudFormation resource type name for this resource class.
-
-
Constructor Details
-
CfnJob
protected CfnJob(software.amazon.jsii.JsiiObjectRef objRef) -
CfnJob
protected CfnJob(software.amazon.jsii.JsiiObject.InitializationMode initializationMode) -
CfnJob
@Stability(Stable) public CfnJob(@NotNull Construct scope, @NotNull String id, @NotNull CfnJobProps props) Create a newAWS::DataBrew::Job
.- Parameters:
scope
-- scope in which this resource is defined.
id
-- scoped id of the resource.
props
-- resource properties.
-
-
Method Details
-
inspect
Examines the CloudFormation resource and discloses attributes.- Specified by:
inspect
in interfaceIInspectable
- Parameters:
inspector
-- tree inspector to collect and process attributes.
-
renderProperties
@Stability(Stable) @NotNull protected Map<String,Object> renderProperties(@NotNull Map<String, Object> props) - Overrides:
renderProperties
in classCfnResource
- Parameters:
props
- This parameter is required.
-
getCfnProperties
- Overrides:
getCfnProperties
in classCfnResource
-
getTags
Metadata tags that have been applied to the job. -
getName
The unique name of the job. -
setName
The unique name of the job. -
getRoleArn
The Amazon Resource Name (ARN) of the role to be assumed for this job. -
setRoleArn
The Amazon Resource Name (ARN) of the role to be assumed for this job. -
getType
The job type of the job, which must be one of the following:.PROFILE
- A job to analyze a dataset, to determine its size, data types, data distribution, and more.RECIPE
- A job to apply one or more transformations to a dataset.
-
setType
The job type of the job, which must be one of the following:.PROFILE
- A job to analyze a dataset, to determine its size, data types, data distribution, and more.RECIPE
- A job to apply one or more transformations to a dataset.
-
getDatabaseOutputs
Represents a list of JDBC database output objects which defines the output destination for a DataBrew recipe job to write into. -
setDatabaseOutputs
Represents a list of JDBC database output objects which defines the output destination for a DataBrew recipe job to write into. -
setDatabaseOutputs
Represents a list of JDBC database output objects which defines the output destination for a DataBrew recipe job to write into. -
getDataCatalogOutputs
One or more artifacts that represent the AWS Glue Data Catalog output from running the job. -
setDataCatalogOutputs
One or more artifacts that represent the AWS Glue Data Catalog output from running the job. -
setDataCatalogOutputs
One or more artifacts that represent the AWS Glue Data Catalog output from running the job. -
getDatasetName
A dataset that the job is to process. -
setDatasetName
A dataset that the job is to process. -
getEncryptionKeyArn
The Amazon Resource Name (ARN) of an encryption key that is used to protect the job output.For more information, see Encrypting data written by DataBrew jobs
-
setEncryptionKeyArn
The Amazon Resource Name (ARN) of an encryption key that is used to protect the job output.For more information, see Encrypting data written by DataBrew jobs
-
getEncryptionMode
The encryption mode for the job, which can be one of the following:.SSE-KMS
- Server-side encryption with keys managed by AWS KMS .SSE-S3
- Server-side encryption with keys managed by Amazon S3.
-
setEncryptionMode
The encryption mode for the job, which can be one of the following:.SSE-KMS
- Server-side encryption with keys managed by AWS KMS .SSE-S3
- Server-side encryption with keys managed by Amazon S3.
-
getJobSample
A sample configuration for profile jobs only, which determines the number of rows on which the profile job is run.If a
JobSample
value isn't provided, the default value is used. The default value is CUSTOM_ROWS for the mode parameter and 20,000 for the size parameter. -
setJobSample
A sample configuration for profile jobs only, which determines the number of rows on which the profile job is run.If a
JobSample
value isn't provided, the default value is used. The default value is CUSTOM_ROWS for the mode parameter and 20,000 for the size parameter. -
setJobSample
A sample configuration for profile jobs only, which determines the number of rows on which the profile job is run.If a
JobSample
value isn't provided, the default value is used. The default value is CUSTOM_ROWS for the mode parameter and 20,000 for the size parameter. -
getLogSubscription
The current status of Amazon CloudWatch logging for the job. -
setLogSubscription
The current status of Amazon CloudWatch logging for the job. -
getMaxCapacity
The maximum number of nodes that can be consumed when the job processes data. -
setMaxCapacity
The maximum number of nodes that can be consumed when the job processes data. -
getMaxRetries
The maximum number of times to retry the job after a job run fails. -
setMaxRetries
The maximum number of times to retry the job after a job run fails. -
getOutputLocation
AWS::DataBrew::Job.OutputLocation
. -
setOutputLocation
AWS::DataBrew::Job.OutputLocation
. -
setOutputLocation
AWS::DataBrew::Job.OutputLocation
. -
getOutputs
One or more artifacts that represent output from running the job. -
setOutputs
One or more artifacts that represent output from running the job. -
setOutputs
One or more artifacts that represent output from running the job. -
getProfileConfiguration
Configuration for profile jobs.Configuration can be used to select columns, do evaluations, and override default parameters of evaluations. When configuration is undefined, the profile job will apply default settings to all supported columns.
-
setProfileConfiguration
Configuration for profile jobs.Configuration can be used to select columns, do evaluations, and override default parameters of evaluations. When configuration is undefined, the profile job will apply default settings to all supported columns.
-
setProfileConfiguration
@Stability(Stable) public void setProfileConfiguration(@Nullable CfnJob.ProfileConfigurationProperty value) Configuration for profile jobs.Configuration can be used to select columns, do evaluations, and override default parameters of evaluations. When configuration is undefined, the profile job will apply default settings to all supported columns.
-
getProjectName
The name of the project that the job is associated with. -
setProjectName
The name of the project that the job is associated with. -
getRecipe
A series of data transformation steps that the job runs. -
setRecipe
A series of data transformation steps that the job runs. -
setRecipe
A series of data transformation steps that the job runs. -
getTimeout
The job's timeout in minutes.A job that attempts to run longer than this timeout period ends with a status of
TIMEOUT
. -
setTimeout
The job's timeout in minutes.A job that attempts to run longer than this timeout period ends with a status of
TIMEOUT
. -
getValidationConfigurations
List of validation configurations that are applied to the profile job. -
setValidationConfigurations
List of validation configurations that are applied to the profile job. -
setValidationConfigurations
List of validation configurations that are applied to the profile job.
-