interface ContinuousLoggingProps
Language | Type name |
---|---|
![]() | Amazon.CDK.AWS.Glue.Alpha.ContinuousLoggingProps |
![]() | github.com/aws/aws-cdk-go/awscdkgluealpha/v2#ContinuousLoggingProps |
![]() | software.amazon.awscdk.services.glue.alpha.ContinuousLoggingProps |
![]() | aws_cdk.aws_glue_alpha.ContinuousLoggingProps |
![]() | @aws-cdk/aws-glue-alpha ยป ContinuousLoggingProps |
Properties for enabling Continuous Logging for Glue Jobs.
Example
import * as cdk from 'aws-cdk-lib';
import * as iam from 'aws-cdk-lib/aws-iam';
declare const stack: cdk.Stack;
declare const role: iam.IRole;
declare const script: glue.Code;
new glue.PySparkEtlJob(stack, 'PySparkETLJob', {
jobName: 'PySparkETLJobCustomName',
description: 'This is a description',
role,
script,
glueVersion: glue.GlueVersion.V3_0,
continuousLogging: { enabled: false },
workerType: glue.WorkerType.G_2X,
maxConcurrentRuns: 100,
timeout: cdk.Duration.hours(2),
connections: [glue.Connection.fromConnectionName(stack, 'Connection', 'connectionName')],
securityConfiguration: glue.SecurityConfiguration.fromSecurityConfigurationName(stack, 'SecurityConfig', 'securityConfigName'),
tags: {
FirstTagName: 'FirstTagValue',
SecondTagName: 'SecondTagValue',
XTagName: 'XTagValue',
},
numberOfWorkers: 2,
maxRetries: 2,
});
Properties
Name | Type | Description |
---|---|---|
enabled | boolean | Enable continouous logging. |
conversion | string | Apply the provided conversion pattern. |
log | ILog | Specify a custom CloudWatch log group name. |
log | string | Specify a custom CloudWatch log stream prefix. |
quiet? | boolean | Filter out non-useful Apache Spark driver/executor and Apache Hadoop YARN heartbeat log messages. |
enabled
Type:
boolean
Enable continouous logging.
conversionPattern?
Type:
string
(optional, default: %d{yy/MM/dd HH:mm:ss} %p %c{1}: %m%n
)
Apply the provided conversion pattern.
This is a Log4j Conversion Pattern to customize driver and executor logs.
logGroup?
Type:
ILog
(optional, default: a log group is created with name /aws-glue/jobs/logs-v2/
.)
Specify a custom CloudWatch log group name.
logStreamPrefix?
Type:
string
(optional, default: the job run ID.)
Specify a custom CloudWatch log stream prefix.
quiet?
Type:
boolean
(optional, default: true)
Filter out non-useful Apache Spark driver/executor and Apache Hadoop YARN heartbeat log messages.