Workflow - AWS Glue

Workflow

A workflow is a collection of multiple dependent AWS Glue jobs and crawlers that are run to complete a complex ETL task. A workflow manages the execution and monitoring of all its jobs and crawlers.

Contents

BlueprintDetails

This structure indicates the details of the blueprint that this particular workflow is created from.

Type: BlueprintDetails object

Required: No

CreatedOn

The date and time when the workflow was created.

Type: Timestamp

Required: No

DefaultRunProperties

A collection of properties to be used as part of each execution of the workflow. The run properties are made available to each job in the workflow. A job can modify the properties for the next jobs in the flow.

Type: String to string map

Key Length Constraints: Minimum length of 1. Maximum length of 255.

Key Pattern: [\u0020-\uD7FF\uE000-\uFFFD\uD800\uDC00-\uDBFF\uDFFF\t]*

Required: No

Description

A description of the workflow.

Type: String

Required: No

Graph

The graph representing all the AWS Glue components that belong to the workflow as nodes and directed connections between them as edges.

Type: WorkflowGraph object

Required: No

LastModifiedOn

The date and time when the workflow was last modified.

Type: Timestamp

Required: No

LastRun

The information about the last execution of the workflow.

Type: WorkflowRun object

Required: No

MaxConcurrentRuns

You can use this parameter to prevent unwanted multiple updates to data, to control costs, or in some cases, to prevent exceeding the maximum number of concurrent runs of any of the component jobs. If you leave this parameter blank, there is no limit to the number of concurrent workflow runs.

Type: Integer

Required: No

Name

The name of the workflow.

Type: String

Length Constraints: Minimum length of 1. Maximum length of 255.

Pattern: [\u0020-\uD7FF\uE000-\uFFFD\uD800\uDC00-\uDBFF\uDFFF\t]*

Required: No

See Also

For more information about using this API in one of the language-specific AWS SDKs, see the following: