Class PySparkFlexEtlJob

java.lang.Object
software.amazon.jsii.JsiiObject
All Implemented Interfaces:
IJobRef, IEnvironmentAware, IResource, IJob, IGrantable, software.amazon.jsii.JsiiSerializable, software.constructs.IConstruct, software.constructs.IDependable

@Generated(value="jsii-pacmak/1.139.0 (build 26a6b54)", date="2026-09-17T14:54:05.061Z") @Stability(Stable) public class PySparkFlexEtlJob extends SparkJob
Flex Jobs class.

Flex jobs supports Python and Scala language. The flexible execution class is appropriate for non-urgent jobs such as pre-production jobs, testing, and one-time data loads. Flexible job runs are supported for jobs using AWS Glue version 3.0 or later and G.1X or G.2X worker types but will default to the latest version of Glue (currently Glue 5.0.)

Similar to ETL, we’ll enable these features: --enable-metrics, --enable-continuous-cloudwatch-log. The Spark UI (--enable-spark-ui) is off by default; enable it by setting the sparkUI prop.

Example:

 import software.amazon.awscdk.*;
 import software.amazon.awscdk.services.iam.*;
 Stack stack;
 IRole role;
 Code script;
 PySparkFlexEtlJob.Builder.create(stack, "ImportedJob").role(role).script(script).build();
 
  • Field Details

    • PROPERTY_INJECTION_ID

      @Stability(Stable) public static final String PROPERTY_INJECTION_ID
      Uniquely identifies this class.
  • Constructor Details

    • PySparkFlexEtlJob

      protected PySparkFlexEtlJob(software.amazon.jsii.JsiiObjectRef objRef)
    • PySparkFlexEtlJob

      protected PySparkFlexEtlJob(software.amazon.jsii.JsiiObject.InitializationMode initializationMode)
    • PySparkFlexEtlJob

      @Stability(Stable) public PySparkFlexEtlJob(@NotNull software.constructs.Construct scope, @NotNull String id, @NotNull PySparkFlexEtlJobProps props)
      PySparkFlexEtlJob constructor.

      Parameters:
      scope - This parameter is required.
      id - This parameter is required.
      props - This parameter is required.
  • Method Details