Package software.amazon.awscdk.services.glue.alpha

Interface ScalaJobExecutableProps

All Superinterfaces:

software.amazon.jsii.JsiiSerializable

All Known Implementing Classes:

ScalaJobExecutableProps.Jsii$Proxy

@Generated(value="jsii-pacmak/1.104.0 (build e79254c)",
           date="2024-10-31T19:13:07.921Z")
@Stability(Experimental)
public interface ScalaJobExecutableProps
extends software.amazon.jsii.JsiiSerializable

(experimental) Props for creating a Scala Spark (ETL or Streaming) job executable.

Example:

 Bucket bucket;
 Job.Builder.create(this, "ScalaSparkEtlJob")
         .executable(JobExecutable.scalaEtl(ScalaJobExecutableProps.builder()
                 .glueVersion(GlueVersion.V4_0)
                 .script(Code.fromBucket(bucket, "src/com/example/HelloWorld.scala"))
                 .className("com.example.HelloWorld")
                 .extraJars(List.of(Code.fromBucket(bucket, "jars/HelloWorld.jar")))
                 .build()))
         .workerType(WorkerType.G_8X)
         .description("an example Scala ETL job")
         .build();
 

Nested Class Summary

Nested Classes

Modifier and Type	Interface	Description
static final class	ScalaJobExecutableProps.Builder	A builder for ScalaJobExecutableProps
static final class	ScalaJobExecutableProps.Jsii$Proxy	An implementation for ScalaJobExecutableProps

Method Summary

Modifier and Type	Method	Description
static ScalaJobExecutableProps.Builder	builder()
String	getClassName()	(experimental) The fully qualified Scala class name that serves as the entry point for the job.
default List<Code>	getExtraFiles()	(experimental) Additional files, such as configuration files that AWS Glue copies to the working directory of your script before executing it.
default List<Code>	getExtraJars()	(experimental) Additional Java .jar files that AWS Glue adds to the Java classpath before executing your script.
default Boolean	getExtraJarsFirst()	(experimental) Setting this value to true prioritizes the customer's extra JAR files in the classpath.
GlueVersion	getGlueVersion()	(experimental) Glue version.
default Runtime	getRuntime()	(experimental) Runtime.
Code	getScript()	(experimental) The script that executes a job.

Methods inherited from interface software.amazon.jsii.JsiiSerializable

$jsii$toJson

Method Details

getClassName

@Stability(Experimental)
@NotNull
String getClassName()

(experimental) The fully qualified Scala class name that serves as the entry point for the job.

Equivalent to a job parameter --class.

See Also:

• https://docs.aws.amazon.com/glue/latest/dg/aws-glue-programming-etl-glue-arguments.html

getGlueVersion

@Stability(Experimental)
@NotNull
GlueVersion getGlueVersion()

(experimental) Glue version.

See Also:

• https://docs.aws.amazon.com/glue/latest/dg/release-notes.html

getScript

@Stability(Experimental)
@NotNull
Code getScript()

(experimental) The script that executes a job.

getExtraFiles

@Stability(Experimental)
@Nullable
default List<Code> getExtraFiles()

(experimental) Additional files, such as configuration files that AWS Glue copies to the working directory of your script before executing it.

Only individual files are supported, directories are not supported. Equivalent to a job parameter --extra-files.

Default: [] - no extra files are copied to the working directory

See Also:

• https://docs.aws.amazon.com/glue/latest/dg/aws-glue-programming-etl-glue-arguments.html

getExtraJars

@Stability(Experimental)
@Nullable
default List<Code> getExtraJars()

(experimental) Additional Java .jar files that AWS Glue adds to the Java classpath before executing your script. Only individual files are supported, directories are not supported. Equivalent to a job parameter --extra-jars.

Default: [] - no extra jars are added to the classpath

See Also:

• https://docs.aws.amazon.com/glue/latest/dg/aws-glue-programming-etl-glue-arguments.html

getExtraJarsFirst

@Stability(Experimental)
@Nullable
default Boolean getExtraJarsFirst()

(experimental) Setting this value to true prioritizes the customer's extra JAR files in the classpath.

Equivalent to a job parameter --user-jars-first.

Default: false - priority is not given to user-provided jars

See Also:

• https://docs.aws.amazon.com/glue/latest/dg/aws-glue-programming-etl-glue-arguments.html

getRuntime

@Stability(Experimental)
@Nullable
default Runtime getRuntime()

(experimental) Runtime.

It is required for Ray jobs.

builder

@Stability(Experimental)
static ScalaJobExecutableProps.Builder builder()

Returns:

a ScalaJobExecutableProps.Builder of ScalaJobExecutableProps