ContinuousLoggingProps

class aws_cdk.aws_glue_alpha.ContinuousLoggingProps(*, enabled, conversion_pattern=None, log_group=None, log_stream_prefix=None, quiet=None)

Bases: object

(experimental) Properties for enabling Continuous Logging for Glue Jobs.

Parameters:

enabled (bool) – (experimental) Enable continouous logging.
conversion_pattern (Optional[str]) – (experimental) Apply the provided conversion pattern. This is a Log4j Conversion Pattern to customize driver and executor logs. Default: %d{yy/MM/dd HH:mm:ss} %p %c{1}: %m%n
log_group (Optional[ILogGroup]) – (experimental) Specify a custom CloudWatch log group name. Default: - a log group is created with name /aws-glue/jobs/logs-v2/.
log_stream_prefix (Optional[str]) – (experimental) Specify a custom CloudWatch log stream prefix. Default: - the job run ID.
quiet (Optional[bool]) – (experimental) Filter out non-useful Apache Spark driver/executor and Apache Hadoop YARN heartbeat log messages. Default: true

See:

https://docs.aws.amazon.com/glue/latest/dg/aws-glue-programming-etl-glue-arguments.html

Stability:

experimental

ExampleMetadata:

fixture=_generated

Example:

# The code below shows an example of how to instantiate this type.
# The values are placeholders you should change.
import aws_cdk.aws_glue_alpha as glue_alpha
from aws_cdk import aws_logs as logs

# log_group: logs.LogGroup

continuous_logging_props = glue_alpha.ContinuousLoggingProps(
    enabled=False,

    # the properties below are optional
    conversion_pattern="conversionPattern",
    log_group=log_group,
    log_stream_prefix="logStreamPrefix",
    quiet=False
)

Attributes

conversion_pattern

(experimental) Apply the provided conversion pattern.

This is a Log4j Conversion Pattern to customize driver and executor logs.

Default:: %d{yy/MM/dd HH:mm:ss} %p %c{1}: %m%n
Stability:: experimental

enabled

(experimental) Enable continouous logging.

Stability:: experimental

log_group

(experimental) Specify a custom CloudWatch log group name.

Default:

a log group is created with name /aws-glue/jobs/logs-v2/.

Stability:

experimental

log_stream_prefix

(experimental) Specify a custom CloudWatch log stream prefix.

Default:

the job run ID.

Stability:

experimental

quiet

(experimental) Filter out non-useful Apache Spark driver/executor and Apache Hadoop YARN heartbeat log messages.

Default:: true
Stability:: experimental