可修改的 Flink 組態屬性 - Managed Service for Apache Flink

Amazon Managed Service for Apache Flink 之前稱為 Amazon Kinesis Data Analytics for Apache Flink。

本文為英文版的機器翻譯版本,如內容有任何歧義或不一致之處,概以英文版為準。

可修改的 Flink 組態屬性

以下是您可以使用支援案例修改的 Flink 組態設定。您可以一次修改多個屬性,也可以透過指定應用程式前綴來同時修改多個應用程式。如果您要修改此清單以外還有其他 Flink 組態屬性,請在您的情況下指定確切的屬性。

重啟策略

從 Flink 1.19 及更高版本開始,我們默認使用exponential-delay重新啟動策略。依預設,所有先前版本都使用fixed-delay重新啟動策略。

restart-strategy:

restart-strategy.fixed-delay.delay:

restart-strategy.exponential-delay.backoff-muliplier:

restart-strategy.exponential-delay.initial-backoff:

restart-strategy.exponential-delay.jitter-factor:

restart-strategy.exponential-delay.reset-backoff-threshold:

檢查點和狀態後端

state.backend:

state.backend.fs.memory-threshold:

state.backend.incremental:

檢查點

execution.checkpointing.unaligned:

execution.checkpointing.interval-during-backlog:

RockSDB 原生度量

RockSDB 原生測量結果不會運送至。 CloudWatch啟用後,您可以從 Flink 儀表板或RESTAPI使用自訂工具的 Flink 存取這些指標。

適用於 Apache Flink 的受管理服務可讓客戶使用以唯讀模式存取最新的 Flink RESTAPI(或您使用的支援版本)。CreateApplicationPresignedUrlAPIFlink 自己的儀表板會使用此API功能,但也可以由自訂監控工具使用。

state.backend.rocksdb.compaction.style:

state.backend.rocksdb.memory.partitioned-index-filters:

state.backend.rocksdb.metrics.actual-delayed-write-rate:

state.backend.rocksdb.metrics.background-errors:

state.backend.rocksdb.metrics.block-cache-capacity:

state.backend.rocksdb.metrics.block-cache-pinned-usage:

state.backend.rocksdb.metrics.block-cache-usage:

state.backend.rocksdb.metrics.column-family-as-variable:

state.backend.rocksdb.metrics.compaction-pending:

state.backend.rocksdb.metrics.cur-size-active-mem-table:

state.backend.rocksdb.metrics.cur-size-all-mem-tables:

state.backend.rocksdb.metrics.estimate-live-data-size:

state.backend.rocksdb.metrics.estimate-num-keys:

state.backend.rocksdb.metrics.estimate-pending-compaction-bytes:

state.backend.rocksdb.metrics.estimate-table-readers-mem:

state.backend.rocksdb.metrics.is-write-stopped:

state.backend.rocksdb.metrics.mem-table-flush-pending:

state.backend.rocksdb.metrics.num-deletes-active-mem-table:

state.backend.rocksdb.metrics.num-deletes-imm-mem-tables:

state.backend.rocksdb.metrics.num-entries-active-mem-table:

state.backend.rocksdb.metrics.num-entries-imm-mem-tables:

state.backend.rocksdb.metrics.num-immutable-mem-table:

state.backend.rocksdb.metrics.num-live-versions:

state.backend.rocksdb.metrics.num-running-compactions:

state.backend.rocksdb.metrics.num-running-flushes:

state.backend.rocksdb.metrics.num-snapshots:

state.backend.rocksdb.metrics.size-all-mem-tables:

state.backend.rocksdb.thread.num:

進階狀態後端選項

state.storage.fs.memory-threshold:

完整 TaskManager 選項

task.cancellation.timeout:

taskmanager.jvm-exit-on-oom:

taskmanager.numberOfTaskSlots:

taskmanager.slot.timeout:

taskmanager.network.memory.fraction:

taskmanager.network.memory.max:

taskmanager.network.request-backoff.initial:

taskmanager.network.request-backoff.max:

taskmanager.network.memory.buffer-debloat.enabled:

taskmanager.network.memory.buffer-debloat.period:

taskmanager.network.memory.buffer-debloat.samples:

taskmanager.network.memory.buffer-debloat.threshold-percentages:

記憶體組態

taskmanager.memory.jvm-metaspace.size:

taskmanager.memory.jvm-overhead.fraction:

taskmanager.memory.jvm-overhead.max:

taskmanager.memory.managed.consumer-weights:

taskmanager.memory.managed.fraction:

taskmanager.memory.network.fraction:

taskmanager.memory.network.max:

taskmanager.memory.segment-size:

taskmanager.memory.task.off-heap.size:

RPC/阿卡

akka.ask.timeout:

akka.client.timeout:

akka.framesize:

akka.lookup.timeout:

akka.tcp.timeout:

用戶端

client.timeout:

進階叢集選項

cluster.intercept-user-system-exit:

cluster.processes.halt-on-fatal-error:

檔案系統組

fs.s3.connection.maximum:

fs.s3a.connection.maximum:

fs.s3a.threads.max:

s3.upload.max.concurrent.uploads:

進階容錯選項

heartbeat.timeout:

jobmanager.execution.failover-strategy:

記憶體組態

jobmanager.memory.heap.size:

指標

metrics.latency.interval:

端點和用戶REST端的進階選項

rest.flamegraph.enabled:

rest.server.numThreads:

進階SSL安全性選項

security.ssl.internal.handshake-timeout:

進階排程選項

slot.request.timeout:

Flink 網頁使用者介面的進階選項

web.timeout: