interface JobDriver
Language | Type name |
---|---|
.NET | Amazon.CDK.AWS.StepFunctions.Tasks.JobDriver |
Go | github.com/aws/aws-cdk-go/awscdk/v2/awsstepfunctionstasks#JobDriver |
Java | software.amazon.awscdk.services.stepfunctions.tasks.JobDriver |
Python | aws_cdk.aws_stepfunctions_tasks.JobDriver |
TypeScript (source) | aws-cdk-lib » aws_stepfunctions_tasks » JobDriver |
Specify the driver that the EMR Containers job runs on.
The job driver is used to provide an input for the job that will be run.
Example
new tasks.EmrContainersStartJobRun(this, 'EMR Containers Start Job Run', {
virtualCluster: tasks.VirtualClusterInput.fromVirtualClusterId('de92jdei2910fwedz'),
releaseLabel: tasks.ReleaseLabel.EMR_6_2_0,
jobName: 'EMR-Containers-Job',
jobDriver: {
sparkSubmitJobDriver: {
entryPoint: sfn.TaskInput.fromText('local:///usr/lib/spark/examples/src/main/python/pi.py'),
},
},
applicationConfig: [{
classification: tasks.Classification.SPARK_DEFAULTS,
properties: {
'spark.executor.instances': '1',
'spark.executor.memory': '512M',
},
}],
});
Properties
Name | Type | Description |
---|---|---|
spark | Spark | The job driver parameters specified for spark submit. |
sparkSubmitJobDriver
Type:
Spark
The job driver parameters specified for spark submit.