可修改的 Flink 配置属性 - Managed Service for Apache Flink

Amazon Managed Service for Apache Flink 之前称为 Amazon Kinesis Data Analytics for Apache Flink。

本文属于机器翻译版本。若本译文内容与英语原文存在差异,则一律以英文原文为准。

可修改的 Flink 配置属性

以下是您可以使用支持案例修改的 Flink 配置设置。通过指定应用程序前缀,您可以一次修改多个属性,也可以同时修改多个应用程序的属性。如果您要修改此列表之外的其他 Flink 配置属性,请根据您的具体情况指定确切的属性。

重启策略

从 Flink 1.19 及更高版本开始,我们默认使用exponential-delay重启策略。默认情况下,所有以前的版本都使用fixed-delay重启策略。

restart-strategy:

restart-strategy.fixed-delay.delay:

restart-strategy.exponential-delay.backoff-muliplier:

restart-strategy.exponential-delay.initial-backoff:

restart-strategy.exponential-delay.jitter-factor:

restart-strategy.exponential-delay.reset-backoff-threshold:

检查点和状态后端

state.backend:

state.backend.fs.memory-threshold:

state.backend.incremental:

检查点

execution.checkpointing.unaligned:

execution.checkpointing.interval-during-backlog:

RocksDB 原生指标

RocksDB 原生指标不提供给。 CloudWatch启用后,可以从 Flink 控制面板或 Flink REST API 使用自定义工具访问这些指标。

Apache Flink 托管服务允许客户使用以只读模式访问最新的 Flink RESTAPI(或您正在使用的支持版本)。CreateApplicationPresignedUrlAPI它API由 Flink 自己的控制面板使用,但也可以由自定义监控工具使用。

state.backend.rocksdb.compaction.style:

state.backend.rocksdb.memory.partitioned-index-filters:

state.backend.rocksdb.metrics.actual-delayed-write-rate:

state.backend.rocksdb.metrics.background-errors:

state.backend.rocksdb.metrics.block-cache-capacity:

state.backend.rocksdb.metrics.block-cache-pinned-usage:

state.backend.rocksdb.metrics.block-cache-usage:

state.backend.rocksdb.metrics.column-family-as-variable:

state.backend.rocksdb.metrics.compaction-pending:

state.backend.rocksdb.metrics.cur-size-active-mem-table:

state.backend.rocksdb.metrics.cur-size-all-mem-tables:

state.backend.rocksdb.metrics.estimate-live-data-size:

state.backend.rocksdb.metrics.estimate-num-keys:

state.backend.rocksdb.metrics.estimate-pending-compaction-bytes:

state.backend.rocksdb.metrics.estimate-table-readers-mem:

state.backend.rocksdb.metrics.is-write-stopped:

state.backend.rocksdb.metrics.mem-table-flush-pending:

state.backend.rocksdb.metrics.num-deletes-active-mem-table:

state.backend.rocksdb.metrics.num-deletes-imm-mem-tables:

state.backend.rocksdb.metrics.num-entries-active-mem-table:

state.backend.rocksdb.metrics.num-entries-imm-mem-tables:

state.backend.rocksdb.metrics.num-immutable-mem-table:

state.backend.rocksdb.metrics.num-live-versions:

state.backend.rocksdb.metrics.num-running-compactions:

state.backend.rocksdb.metrics.num-running-flushes:

state.backend.rocksdb.metrics.num-snapshots:

state.backend.rocksdb.metrics.size-all-mem-tables:

state.backend.rocksdb.thread.num:

高级状态后端选项

state.storage.fs.memory-threshold:

完整 TaskManager 选项

task.cancellation.timeout:

taskmanager.jvm-exit-on-oom:

taskmanager.numberOfTaskSlots:

taskmanager.slot.timeout:

taskmanager.network.memory.fraction:

taskmanager.network.memory.max:

taskmanager.network.request-backoff.initial:

taskmanager.network.request-backoff.max:

taskmanager.network.memory.buffer-debloat.enabled:

taskmanager.network.memory.buffer-debloat.period:

taskmanager.network.memory.buffer-debloat.samples:

taskmanager.network.memory.buffer-debloat.threshold-percentages:

内存配置

taskmanager.memory.jvm-metaspace.size:

taskmanager.memory.jvm-overhead.fraction:

taskmanager.memory.jvm-overhead.max:

taskmanager.memory.managed.consumer-weights:

taskmanager.memory.managed.fraction:

taskmanager.memory.network.fraction:

taskmanager.memory.network.max:

taskmanager.memory.segment-size:

taskmanager.memory.task.off-heap.size:

RPC/Akka

akka.ask.timeout:

akka.client.timeout:

akka.framesize:

akka.lookup.timeout:

akka.tcp.timeout:

客户端

client.timeout:

高级集群选项

cluster.intercept-user-system-exit:

cluster.processes.halt-on-fatal-error:

文件系统配置

fs.s3.connection.maximum:

fs.s3a.connection.maximum:

fs.s3a.threads.max:

s3.upload.max.concurrent.uploads:

高级容错选项

heartbeat.timeout:

jobmanager.execution.failover-strategy:

内存配置

jobmanager.memory.heap.size:

指标

metrics.latency.interval:

REST终端节点和客户端的高级选项

rest.flamegraph.enabled:

rest.server.numThreads:

高级SSL安全选项

security.ssl.internal.handshake-timeout:

高级日程安排选项

slot.request.timeout:

Flink 网页用户界面的高级选项

web.timeout: