interface ScalaJobExecutableProps
Language | Type name |
---|---|
.NET | Amazon.CDK.AWS.Glue.Alpha.ScalaJobExecutableProps |
Go | github.com/aws/aws-cdk-go/awscdkgluealpha/v2#ScalaJobExecutableProps |
Java | software.amazon.awscdk.services.glue.alpha.ScalaJobExecutableProps |
Python | aws_cdk.aws_glue_alpha.ScalaJobExecutableProps |
TypeScript (source) | @aws-cdk/aws-glue-alpha ยป ScalaJobExecutableProps |
Props for creating a Scala Spark (ETL or Streaming) job executable.
Example
declare const bucket: s3.Bucket;
new glue.Job(this, 'ScalaSparkEtlJob', {
executable: glue.JobExecutable.scalaEtl({
glueVersion: glue.GlueVersion.V4_0,
script: glue.Code.fromBucket(bucket, 'src/com/example/HelloWorld.scala'),
className: 'com.example.HelloWorld',
extraJars: [glue.Code.fromBucket(bucket, 'jars/HelloWorld.jar')],
}),
workerType: glue.WorkerType.G_8X,
description: 'an example Scala ETL job',
});
Properties
Name | Type | Description |
---|---|---|
class | string | The fully qualified Scala class name that serves as the entry point for the job. |
glue | Glue | Glue version. |
script | Code | The script that executes a job. |
extra | Code [] | Additional files, such as configuration files that AWS Glue copies to the working directory of your script before executing it. |
extra | Code [] | Additional Java .jar files that AWS Glue adds to the Java classpath before executing your script. Only individual files are supported, directories are not supported. Equivalent to a job parameter --extra-jars . |
extra | boolean | Setting this value to true prioritizes the customer's extra JAR files in the classpath. |
runtime? | Runtime | Runtime. |
className
Type:
string
The fully qualified Scala class name that serves as the entry point for the job.
Equivalent to a job parameter --class
.
glueVersion
Type:
Glue
Glue version.
See also: https://docs.aws.amazon.com/glue/latest/dg/release-notes.html
script
Type:
Code
The script that executes a job.
extraFiles?
Type:
Code
[]
(optional, default: [] - no extra files are copied to the working directory)
Additional files, such as configuration files that AWS Glue copies to the working directory of your script before executing it.
Only individual files are supported, directories are not supported.
Equivalent to a job parameter --extra-files
.
extraJars?
Type:
Code
[]
(optional, default: [] - no extra jars are added to the classpath)
Additional Java .jar files that AWS Glue adds to the Java classpath before executing your script. Only individual files are supported, directories are not supported. Equivalent to a job parameter --extra-jars
.
extraJarsFirst?
Type:
boolean
(optional, default: false - priority is not given to user-provided jars)
Setting this value to true prioritizes the customer's extra JAR files in the classpath.
Equivalent to a job parameter --user-jars-first
.
runtime?
Type:
Runtime
(optional)
Runtime.
It is required for Ray jobs.