1.执行环境
flink1.13
jdk8
2.日志内容
2022-08-29 17:28:35.789 [main] INFO org.apache.flink.configuration.GlobalConfiguration [] – Loading configuration property: web.submit.enable, false
2022-08-29 17:28:35.789 [main] INFO org.apache.flink.configuration.GlobalConfiguration [] – Loading configuration property: oceanus.job.info, {“jobSerialId”:“cql-4i3wk3w8”}
2022-08-29 17:28:35.789 [main] INFO org.apache.flink.configuration.GlobalConfiguration [] – Loading configuration property: kubernetes.jobmanager.service-account, flink
2022-08-29 17:28:35.789 [main] INFO org.apache.flink.configuration.GlobalConfiguration [] – Loading configuration property: blob.server.port, 6124
2022-08-29 17:28:35.789 [main] INFO org.apache.flink.configuration.GlobalConfiguration [] – Loading configuration property: job.version-id, 28
2022-08-29 17:28:35.789 [main] INFO org.apache.flink.configuration.GlobalConfiguration [] – Loading configuration property: metrics.reporter.promgateway.user, 1304768263
2022-08-29 17:28:35.789 [main] INFO org.apache.flink.configuration.GlobalConfiguration [] – Loading configuration property: state.savepoints.dir, cosn://zlfz-oceanus-1304768263/1304768263/100025221053/cql-4i3wk3w8/32/flink-savepoints
2022-08-29 17:28:35.789 [main] INFO org.apache.flink.configuration.GlobalConfiguration [] – Loading configuration property: kubernetes.taskmanager.cpu, 2.000000
2022-08-29 17:28:35.789 [main] INFO org.apache.flink.configuration.GlobalConfiguration [] – Loading configuration property: kubernetes.user-dependency-file-config, []
2022-08-29 17:28:35.789 [main] INFO org.apache.flink.configuration.GlobalConfiguration [] – Loading configuration property: yarn.maximum-failed-containers, 65535
2022-08-29 17:28:35.789 [main] INFO org.apache.flink.configuration.GlobalConfiguration [] – Loading configuration property: taskmanager.numberOfTaskSlots, 1
2022-08-29 17:28:35.789 [main] INFO org.apache.flink.configuration.GlobalConfiguration [] – Loading configuration property: high-availability.jobmanager.port, 6123
2022-08-29 17:28:35.789 [main] INFO org.apache.flink.configuration.GlobalConfiguration [] – Loading configuration property: jobmanager.job-status-listeners.com.tencent.cloud.tstream.flink.OceanusEventListener.info, {“jobSerialId”:“cql-4i3wk3w8”,“jobRuntimeId”:“495920”}
2022-08-29 17:28:35.789 [main] INFO org.apache.flink.configuration.GlobalConfiguration [] – Loading configuration property: $internal.application.main, com.kungeek.rtdw.ads.AdsTaxIndicators
2022-08-29 17:28:35.789 [main] INFO org.apache.flink.configuration.GlobalConfiguration [] – Loading configuration property: flink.partition-discovery.interval-millis, 30000
2022-08-29 17:28:35.790 [main] INFO org.apache.flink.configuration.GlobalConfiguration [] – Loading configuration property: client.timeout, 1800s
2022-08-29 17:28:35.790 [main] INFO org.apache.flink.configuration.GlobalConfiguration [] – Loading configuration property: kubernetes.internal.remote.jar.dependencies, /user/user_00/.flink/cql-4i3wk3w8-495920/1661765295460/flink-task-rtdw-tax-1.0-SNAPSHOT-jar-with-dependencies.jar
2022-08-29 17:28:35.790 [main] INFO org.apache.flink.configuration.GlobalConfiguration [] – Loading configuration property: execution.target, kubernetes-application
2022-08-29 17:28:35.790 [main] INFO org.apache.flink.configuration.GlobalConfiguration [] – Loading configuration property: kubernetes.internal.remote.jar.ship-to-system, /user/user_00/.flink/cql-4i3wk3w8-495920/1661765295460/systemShipFiles/pool-1-thread-6-1661765290835-flink-connector-clickhouse-1.13.2-SNAPSHOT.jar;/user/user_00/.flink/cql-4i3wk3w8-495920/1661765295460/systemShipFiles/pool-1-thread-9-1661765290993-flink-task-rtdw-udf-1.0-SNAPSHOT-jar-with-dependencies.jar
2022-08-29 17:28:35.790 [main] INFO org.apache.flink.configuration.GlobalConfiguration [] – Loading configuration property: execution.attached, true
2022-08-29 17:28:35.790 [main] INFO org.apache.flink.configuration.GlobalConfiguration [] – Loading configuration property: high-availability, zookeeper
2022-08-29 17:28:35.790 [main] INFO org.apache.flink.configuration.GlobalConfiguration [] – Loading configuration property: metrics.reporter.oceanus.interval, 60 SECONDS
2022-08-29 17:28:35.790 [main] INFO org.apache.flink.configuration.GlobalConfiguration [] – Loading configuration property: execution.shutdown-on-attached-exit, false
2022-08-29 17:28:35.790 [main] INFO org.apache.flink.configuration.GlobalConfiguration [] – Loading configuration property: pipeline.jars, local:///var/flink-data/flink-jars/flink-task-rtdw-tax-1.0-SNAPSHOT-jar-with-dependencies.jar
2022-08-29 17:28:35.790 [main] INFO org.apache.flink.configuration.GlobalConfiguration [] – Loading configuration property: restart-strategy, fixed-delay
2022-08-29 17:28:35.790 [main] INFO org.apache.flink.configuration.GlobalConfiguration [] – Loading configuration property: env.java.opts.taskmanager, -XX:ErrorFile=/tmp/taskmanager.err
2022-08-29 17:28:35.790 [main] INFO org.apache.flink.configuration.GlobalConfiguration [] – Loading configuration property: state.checkpoints.dir, cosn://zlfz-oceanus-1304768263/1304768263/100025221053/cql-4i3wk3w8/32/flink-checkpoints
2022-08-29 17:28:35.793 [main] INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService [] – Starting RPC endpoint for org.apache.flink.runtime.resourcemanager.active.ActiveResourceManager at akka://flink/user/rpc/resourcemanager_0 .
2022-08-29 17:28:35.807 [main] INFO org.apache.flink.runtime.leaderelection.DefaultLeaderElectionService [] – Starting DefaultLeaderElectionService with ZooKeeperLeaderElectionDriver{leaderPath=‘/leader/dispatcher_lock’}.
2022-08-29 17:28:35.807 [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.resourcemanager.active.ActiveResourceManager [] – Starting the resource manager.
2022-08-29 17:28:35.809 [main] INFO org.apache.flink.runtime.leaderretrieval.DefaultLeaderRetrievalService [] – Starting DefaultLeaderRetrievalService with ZookeeperLeaderRetrievalDriver{retrievalPath=‘/leader/resource_manager_lock’}.
2022-08-29 17:28:35.809 [main] INFO org.apache.flink.runtime.leaderretrieval.DefaultLeaderRetrievalService [] – Starting DefaultLeaderRetrievalService with ZookeeperLeaderRetrievalDriver{retrievalPath=‘/leader/dispatcher_lock’}.
2022-08-29 17:28:35.859 [main-EventThread] INFO org.apache.flink.runtime.dispatcher.runner.DefaultDispatcherRunner [] – DefaultDispatcherRunner was granted leadership with leader id de4b7fe5-8906-4117-9766-79fd9ad96663. Creating new DispatcherLeaderProcess.
2022-08-29 17:28:35.883 [main-EventThread] INFO org.apache.flink.runtime.dispatcher.runner.SessionDispatcherLeaderProcess [] – Start SessionDispatcherLeaderProcess.
2022-08-29 17:28:35.887 [cluster-io-thread-1] INFO org.apache.flink.runtime.dispatcher.runner.SessionDispatcherLeaderProcess [] – Recover all persisted job graphs.
2022-08-29 17:28:35.890 [cluster-io-thread-1] INFO org.apache.flink.runtime.jobmanager.DefaultJobGraphStore [] – Retrieved job ids [] from ZooKeeperStateHandleStore{namespace=‘flink/cql-4i3wk3w8-495920/jobgraphs’}
2022-08-29 17:28:35.890 [cluster-io-thread-1] INFO org.apache.flink.runtime.dispatcher.runner.SessionDispatcherLeaderProcess [] – Successfully recovered 0 persisted job graphs.
2022-08-29 17:28:35.896 [cluster-io-thread-1] INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService [] – Starting RPC endpoint for org.apache.flink.runtime.dispatcher.StandaloneDispatcher at akka://flink/user/rpc/dispatcher_1 .
2022-08-29 17:28:35.909 [flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.client.ClientUtils [] – Starting program (detached: false)
2022-08-29 17:28:35.990 [flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.contrib.streaming.state.EmbeddedRocksDBStateBackend [] – Using predefined options: DEFAULT.
2022-08-29 17:28:35.991 [flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.contrib.streaming.state.EmbeddedRocksDBStateBackend [] – Using default options factory: DefaultConfigurableOptionsFactory{configuredOptions={}}.
2022-08-29 17:28:36.274 [flink-akka.actor.default-dispatcher-4] WARN org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducer [] – Property [transaction.timeout.ms] not specified. Setting it to 3600000 ms
2022-08-29 17:28:36.394 [flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.streaming.api.graph.StreamingJobGraphGenerator [] – User did not set CheckpointRetentionPolicy, CheckpointRetentionPolicy is set to RETAIN_ON_FAILURE by Oceanus
2022-08-29 17:28:36.398 [flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.client.deployment.application.executors.EmbeddedExecutor [] – Job 00000000000000000000000000000000 is submitted.
2022-08-29 17:28:36.398 [flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.client.deployment.application.executors.EmbeddedExecutor [] – Submitting Job with JobId=00000000000000000000000000000000.
2022-08-29 17:28:37.090 [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.kubernetes.KubernetesResourceManagerDriver [] – Recovered 0 pods from previous attempts, current attempt id is 1.
2022-08-29 17:28:37.091 [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.resourcemanager.active.ActiveResourceManager [] – Recovered 0 workers from previous attempt.
2022-08-29 17:28:37.091 [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.leaderelection.DefaultLeaderElectionService [] – Starting DefaultLeaderElectionService with ZooKeeperLeaderElectionDriver{leaderPath=‘/leader/resource_manager_lock’}.
2022-08-29 17:28:37.165 [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.resourcemanager.active.ActiveResourceManager [] – ResourceManager akka.tcp://flink@9.166.1.158:6123/user/rpc/resourcemanager_0 was granted leadership with fencing token 9b027605d8adb4c14c678f28e6e4429a
2022-08-29 17:28:37.896 [BLOB connection for /127.0.0.1:57750] INFO org.apache.hadoop.fs.CosNFSDataOutputStream [] – The consistency checker is enabled.
2022-08-29 17:28:39.514 [BLOB connection for /127.0.0.1:57750] INFO org.apache.hadoop.fs.CosNFSDataOutputStream [] – Upload the last part. key: /state/ha/cql-4i3wk3w8-495920/blob/job_00000000000000000000000000000000/blob_p-04eb58213107de8176f1d0b822d4c6de53f6b34d-55263fe9ac5688ed640724a5109f1972, blockId: [19], blockWritten: [1986219]
2022-08-29 17:28:39.668 [BLOB connection for /127.0.0.1:57750] INFO org.apache.hadoop.fs.CosNFSDataOutputStream [] – Waiting for finish part uploads…
2022-08-29 17:28:39.839 [BLOB connection for /127.0.0.1:57750] INFO org.apache.hadoop.fs.CosNFSDataOutputStream [] – Upload the key [/state/ha/cql-4i3wk3w8-495920/blob/job_00000000000000000000000000000000/blob_p-04eb58213107de8176f1d0b822d4c6de53f6b34d-55263fe9ac5688ed640724a5109f1972] successfully. check message: File verification succeeded. expected length: 152981163, real length: 152981163.
2022-08-29 17:28:39.841 [flink-akka.actor.default-dispatcher-15] INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher [] – Received JobGraph submission 00000000000000000000000000000000 (Flink Streaming Job).
2022-08-29 17:28:39.842 [flink-akka.actor.default-dispatcher-15] INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher [] – Submitting job 00000000000000000000000000000000 (Flink Streaming Job).
2022-08-29 17:28:39.937 [flink-akka.actor.default-dispatcher-15] INFO org.apache.hadoop.fs.CosNFSDataOutputStream [] – The consistency checker is enabled.
2022-08-29 17:28:39.949 [flink-akka.actor.default-dispatcher-15] INFO org.apache.hadoop.fs.CosNFSDataOutputStream [] – Single file upload… key: /state/ha/cql-4i3wk3w8-495920/submittedJobGraph1d6cc4f11f50, blockId: 0, blockWritten: 40920.
2022-08-29 17:28:40.061 [flink-akka.actor.default-dispatcher-15] INFO org.apache.hadoop.fs.CosNFSDataOutputStream [] – Upload the key [/state/ha/cql-4i3wk3w8-495920/submittedJobGraph1d6cc4f11f50] successfully. check message: File verification succeeded. expected length: 40920, real length: 40920.
2022-08-29 17:28:40.070 [flink-akka.actor.default-dispatcher-15] INFO org.apache.flink.runtime.jobmanager.DefaultJobGraphStore [] – Added JobGraph(jobId: 00000000000000000000000000000000) to ZooKeeperStateHandleStore{namespace=‘flink/cql-4i3wk3w8-495920/jobgraphs’}.
2022-08-29 17:28:40.080 [flink-akka.actor.default-dispatcher-15] INFO org.apache.flink.runtime.leaderelection.DefaultLeaderElectionService [] – Starting DefaultLeaderElectionService with ZooKeeperLeaderElectionDriver{leaderPath=‘/leader/00000000000000000000000000000000/job_manager_lock’}.
2022-08-29 17:28:40.112 [jobmanager-future-thread-1] INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService [] – Starting RPC endpoint for org.apache.flink.runtime.jobmaster.JobMaster at akka://flink/user/rpc/jobmanager_2 .
2022-08-29 17:28:40.118 [jobmanager-future-thread-1] INFO org.apache.flink.runtime.jobmaster.JobMaster [] – Initializing job Flink Streaming Job (00000000000000000000000000000000).
2022-08-29 17:28:40.128 [jobmanager-future-thread-1] INFO com.tencent.cloud.tstream.flink.OceanusEventListener [] – conf: {metrics.reporter.promgateway.interval=60 SECONDS, env.java.opts=-verbose:gc -server -XX:+PrintGCDetails -XX:+PrintGCTimeStamps -XX:ActiveProcessorCount=4 -Dlog4j2.formatMsgNoLookups=true, job.running-order-id=32, jobmanager.rpc.address=9.166.1.158, taskmanager.memory.task.off-heap.size=1024m, taskmanager.memory.jvm-metaspace.size=1024m, metrics.reporter.promgateway.groupingKey=cluster_id=cluster-7whrcxmp;instance_id=cql-4i3wk3w8;version_id=28;runtime_id=495920, oceanus.watchdog.url=http://watchdog-service.oceanus:8600/, kubernetes.container-start-command-template=%java% -Duser.timezone=GMT+08 %classpath% %jvmmem% %jvmopts% %logging% %class% %args%, pipeline.max-parallelism=2048, metrics.latency.granularity=single, metrics.reporter.barad.extraKeys={“tjob_id_num”:“16076”,“tjob_id”:“cql-4i3wk3w8”,“tjob_app_id”:“1304768263”,“tjob_runtime_id”:“495920”,“tjob_config_id”:“57258”}, metrics.reporters=barad,oceanus, cluster.group.serial-id=cluster-7whrcxmp, metrics.reporter.oceanus.randomJobNameSuffix=false, execution.checkpointing.tolerable-failed-checkpoints=5, state.backend.rocksdb.localdir=/data/rocksdb, job.runtime-id=495920, web.tmpdir=/tmp/flink-web-0192e281-7efb-4e3a-9d02-8889858c3a7a, $internal.pipeline.job-id=00000000000000000000000000000000, kubernetes.jobmanager.cpu=2.000000, fs.hdfs.hadoopconf=/opt/cluster-admin/hadoop, taskmanager.memory.managed.fraction=0.1, state.backend=rocksdb, metrics.reporter.barad.class=com.tencent.cloud.tstream.flink.BaradReporter, metrics.reporter.oceanus.class=org.apache.flink.metrics.prometheus.PrometheusPushGatewayReporter, kubernetes.jobmanager.annotations=‘tke.cloud.tencent.com/networks:tke-bridge,tke-direct-eni,tke-route’,‘tke.cloud.tencent.com/cross-tenant-eni-enable:true’, state.checkpoints.num-retained=2, jobmanager.memory.jvm-overhead.min=858993472b, kubernetes.jobmanager.labels=appId:1304768263,ownerUin:100017415366,creatorUin:100025221053,jConfId:57258,requestId:47b1f5fd-9abb-4b6d-9f69-babc1483a51d,jobSerialId:cql-4i3wk3w8,jobRunningOrderId:32,logCollect:6e7e31aa-f6df-469d-80ad-51adb1719071,logCollect-cql-4i3wk3w8:cql-4i3wk3w8, metrics.reporter.oceanus.jobName=cql-4i3wk3w8, execution.savepoint.ignore-unclaimed-state=false, metrics.reporter.oceanus.host=metric-provider-service.oceanus, kubernetes.container.image=ccr.ccs.tencentyun.com/oceanus-release/flink-k8s:flink-1.13-6.4.1-20220706, yarn.application-attempts=20, containerized.taskmanager.env.JVM_ARGS=-Duser.timezone=GMT+08, metrics.reporter.promgateway.randomJobNameSuffix=true, kubernetes.rest-service.exposed.type=ClusterIP, akka.ask.timeout=60s, jobmanager.checkpoint-listeners.com.tencent.cloud.tstream.flink.OceanusCheckpointListener.url=http://watchdog-service.oceanus:8600/report/checkpoint/, state.backend.fs.checkpointdir=cosn://zlfz-oceanus-1304768263/1304768263/100025221053/cql-4i3wk3w8/32/flink-checkpoints, classloader.resolve-order=parent-first, web.timeout=1000000, restart-strategy.fixed-delay.attempts=50, metrics.latency.interval=30000, jobmanager.memory.process.size=8192m, taskmanager.rpc.port=6122, kubernetes.internal.enable.init.container=true, kubernetes.ship-directories=/data/workspace/1304768263/100025221053/runtime/cql-4i3wk3w8/495920/shipFiles, internal.cluster.execution-mode=NORMAL, jobmanager.job-status-listeners.com.tencent.cloud.tstream.flink.OceanusEventListener.url=http://watchdog-service.oceanus:8600/report/job/, jobmanager.checkpoint-listeners.com.tencent.cloud.tstream.flink.OceanusCheckpointListener.info={“jobSerialId”:“cql-4i3wk3w8”,“jobRuntimeId”:“495920”,“jobId”:“16076”}, metrics.reporter.oceanus.port=8421, jobmanager.memory.jvm-metaspace.size=268435456b, metrics.reporter.oceanus.deleteOnShutdown=false, metrics.reporter.oceanus.enableMetricWhiteList=true, jobmanager.checkpoint-listeners=com.tencent.cloud.tstream.flink.OceanusCheckpointListener, metrics.reporter.promgateway.jobName=AdsTaxIndicators, high-availability.cluster-id=cql-4i3wk3w8-495920, jobmanager.job-status-listeners=com.tencent.cloud.tstream.flink.OceanusEventListener, kubernetes.cluster-id=cql-4i3wk3w8-495920, high-availability.zookeeper.path.root=/flink, metrics.reporter.promgateway.class=org.apache.flink.metrics.prometheus.PrometheusPushGatewayReporter, metrics.reporter.barad.region=cls-104iwrq5, high-availability.storageDir=cosn://zlfz-oceanus-1304768263/state/ha, rest.bind-port=8081, jobmanager.retrieve-taskmanager-hostname=false, parallelism.default=1, kubernetes.namespace=default, pipeline.classpaths=[file:/data/workspace/1304768263/100025221053/runtime/cql-4i3wk3w8/495920/shipFiles/pool-1-thread-6-1661765290835-flink-connector-clickhouse-1.13.2-SNAPSHOT.jar, file:/data/workspace/1304768263/100025221053/runtime/cql-4i3wk3w8/495920/shipFiles/pool-1-thread-9-1661765290993-flink-task-rtdw-udf-1.0-SNAPSHOT-jar-with-dependencies.jar, file:opt/flink-1.13.6/usrlib/pool-1-thread-6-1661765290835-flink-connector-clickhouse-1.13.2-SNAPSHOT.jar, file:opt/flink-1.13.6/usrlib/pool-1-thread-9-1661765290993-flink-task-rtdw-udf-1.0-SNAPSHOT-jar-with-dependencies.jar], taskmanager.memory.process.size=8192m, flink.hadoop.hadoop.security.authentication=simple, kubernetes.internal.jobmanager.entrypoint.class=org.apache.flink.kubernetes.entrypoint.KubernetesApplicationClusterEntrypoint, kubernetes.rest-service.annotations=service.kubernetes.io/qcloud-loadbalancer-internal-subnetid:subnet-b9pzagfz, jobmanager.memory.off-heap.size=134217728b, state.backend.incremental=true, metrics.latency.history-size=30, jobmanager.rpc.port=6123, kubernetes.container.image.pull-policy=IfNotPresent, containerized.master.env.JVM_ARGS=-Duser.timezone=GMT+08, high-availability.zookeeper.quorum=zookeeper-0.zookeeper-headless.oceanus.svc.cluster.local:2181,zookeeper-1.zookeeper-headless.oceanus.svc.cluster.local:2181,zookeeper-2.zookeeper-headless.oceanus.svc.cluster.local:2181, restart-strategy.fixed-delay.delay=10s, kubernetes.taskmanager.annotations=‘tke.cloud.tencent.com/networks:tke-bridge,tke-direct-eni,tke-route’,‘tke.cloud.tencent.com/cross-tenant-eni-enable:true’, kubernetes.taskmanager.labels=appId:1304768263,ownerUin:100017415366,creatorUin:100025221053,jConfId:57258,requestId:47b1f5fd-9abb-4b6d-9f69-babc1483a51d,jobSerialId:cql-4i3wk3w8,jobRunningOrderId:32,logCollect:6e7e31aa-f6df-469d-80ad-51adb1719071,logCollect-cql-4i3wk3w8:cql-4i3wk3w8, web.submit.enable=false, oceanus.job.info={“jobSerialId”:“cql-4i3wk3w8”}, rest.address=9.166.1.158, kubernetes.jobmanager.service-account=flink, jobmanager.memory.jvm-overhead.max=858993472b, blob.server.port=6124, job.version-id=28, metrics.reporter.promgateway.user=1304768263, state.savepoints.dir=cosn://zlfz-oceanus-1304768263/1304768263/100025221053/cql-4i3wk3w8/32/flink-savepoints, kubernetes.taskmanager.cpu=2.000000, kubernetes.user-dependency-file-config=[], yarn.maximum-failed-containers=65535, taskmanager.numberOfTaskSlots=1, high-availability.jobmanager.port=6123, jobmanager.job-status-listeners.com.tencent.cloud.tstream.flink.OceanusEventListener.info={“jobSerialId”:“cql-4i3wk3w8”,“jobRuntimeId”:“495920”},
KaTeX parse error: Expected ‘EOF’, got ‘}’ at position 1172: …ink-checkpoints}̲ 2022-08-29 17:…
requestFileUploadByFilePath
24
(
T
a
s
k
E
x
e
c
u
t
o
r
.
j
a
v
a
:
2064
)
[
f
l
i
n
k
−
d
i
s
t
2
.
11
−
1.13.6.
j
a
r
:
1.13.6
]
a
t
j
a
v
a
.
u
t
i
l
.
c
o
n
c
u
r
r
e
n
t
.
C
o
m
p
l
e
t
a
b
l
e
F
u
t
u
r
e
24(TaskExecutor.java:2064) ~[flink-dist_2.11-1.13.6.jar:1.13.6] at java.util.concurrent.CompletableFuture
24
(
T
a
s
k
E
x
ec
u
t
or
.
ja
v
a
:
2064
)
[
f
l
ink
−
d
i
s
t
2
.11
−
1.13.6.
ja
r
:
1.13.6
]
a
t
ja
v
a
.
u
t
i
l
.
co
n
c
u
rre
n
t
.
C
o
m
pl
e
t
ab
l
e
F
u
t
u
re
AsyncSupply.run(CompletableFuture.java:1590) ~[?:1.8.0_232]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) ~[?:1.8.0_232]
at java.util.concurrent.ThreadPoolExecutor
W
o
r
k
e
r
.
r
u
n
(
T
h
r
e
a
d
P
o
o
l
E
x
e
c
u
t
o
r
.
j
a
v
a
:
624
)
[
?
:
1.8.
0
2
32
]
a
t
j
a
v
a
.
l
a
n
g
.
T
h
r
e
a
d
.
r
u
n
(
T
h
r
e
a
d
.
j
a
v
a
:
748
)
[
?
:
1.8.
0
2
32
]
C
a
u
s
e
d
b
y
:
o
r
g
.
a
p
a
c
h
e
.
f
l
i
n
k
.
u
t
i
l
.
F
l
i
n
k
E
x
c
e
p
t
i
o
n
:
T
h
e
f
i
l
e
S
T
D
O
U
T
d
o
e
s
n
o
t
e
x
i
s
t
o
n
t
h
e
T
a
s
k
E
x
e
c
u
t
o
r
.
.
.
.
5
m
o
r
e
2022
−
08
−
3011
:
17
:
08.425
[
f
l
i
n
k
−
a
k
k
a
.
a
c
t
o
r
.
d
e
f
a
u
l
t
−
d
i
s
p
a
t
c
h
e
r
−
3
]
E
R
R
O
R
o
r
g
.
a
p
a
c
h
e
.
f
l
i
n
k
.
r
u
n
t
i
m
e
.
r
e
s
t
.
h
a
n
d
l
e
r
.
t
a
s
k
m
a
n
a
g
e
r
.
T
a
s
k
M
a
n
a
g
e
r
S
t
d
o
u
t
F
i
l
e
H
a
n
d
l
e
r
[
]
−
U
n
h
a
n
d
l
e
d
e
x
c
e
p
t
i
o
n
.
o
r
g
.
a
p
a
c
h
e
.
f
l
i
n
k
.
u
t
i
l
.
F
l
i
n
k
E
x
c
e
p
t
i
o
n
:
T
h
e
f
i
l
e
S
T
D
O
U
T
d
o
e
s
n
o
t
e
x
i
s
t
o
n
t
h
e
T
a
s
k
E
x
e
c
u
t
o
r
.
a
t
o
r
g
.
a
p
a
c
h
e
.
f
l
i
n
k
.
r
u
n
t
i
m
e
.
t
a
s
k
e
x
e
c
u
t
o
r
.
T
a
s
k
E
x
e
c
u
t
o
r
.
l
a
m
b
d
a
Worker.run(ThreadPoolExecutor.java:624) ~[?:1.8.0_232] at java.lang.Thread.run(Thread.java:748) ~[?:1.8.0_232] Caused by: org.apache.flink.util.FlinkException: The file STDOUT does not exist on the TaskExecutor. … 5 more 2022-08-30 11:17:08.425 [flink-akka.actor.default-dispatcher-3] ERROR org.apache.flink.runtime.rest.handler.taskmanager.TaskManagerStdoutFileHandler [] – Unhandled exception. org.apache.flink.util.FlinkException: The file STDOUT does not exist on the TaskExecutor. at org.apache.flink.runtime.taskexecutor.TaskExecutor.lambda
W
or
k
er
.
r
u
n
(
T
h
re
a
d
P
oo
lE
x
ec
u
t
or
.
ja
v
a
:
624
)
[
?
:
1.8.
0
2
32
]
a
t
ja
v
a
.
l
an
g
.
T
h
re
a
d
.
r
u
n
(
T
h
re
a
d
.
ja
v
a
:
748
)
[
?
:
1.8.
0
2
32
]
C
a
u
se
d
b
y
:
or
g
.
a
p
a
c
h
e
.
f
l
ink
.
u
t
i
l
.
Fl
ink
E
x
ce
pt
i
o
n
:
T
h
e
f
i
l
e
ST
D
O
U
T
d
oes
n
o
t
e
x
i
s
t
o
n
t
h
e
T
a
s
k
E
x
ec
u
t
or
….5
m
ore
2022
−
08
−
3011
:
17
:
08.425
[
f
l
ink
−
akka
.
a
c
t
or
.
d
e
f
a
u
lt
−
d
i
s
p
a
t
c
h
er
−
3
]
ERROR
or
g
.
a
p
a
c
h
e
.
f
l
ink
.
r
u
n
t
im
e
.
res
t
.
han
d
l
er
.
t
a
s
kmana
g
er
.
T
a
s
k
M
ana
g
er
St
d
o
u
tF
i
l
eH
an
d
l
er
[
]
−
U
nhan
d
l
e
d
e
x
ce
pt
i
o
n
.
or
g
.
a
p
a
c
h
e
.
f
l
ink
.
u
t
i
l
.
Fl
ink
E
x
ce
pt
i
o
n
:
T
h
e
f
i
l
e
ST
D
O
U
T
d
oes
n
o
t
e
x
i
s
t
o
n
t
h
e
T
a
s
k
E
x
ec
u
t
or
.
a
t
or
g
.
a
p
a
c
h
e
.
f
l
ink
.
r
u
n
t
im
e
.
t
a
s
k
e
x
ec
u
t
or
.
T
a
s
k
E
x
ec
u
t
or
.
l
amb
d
a
requestFileUploadByFilePath
24
(
T
a
s
k
E
x
e
c
u
t
o
r
.
j
a
v
a
:
2064
)
[
f
l
i
n
k
−
d
i
s
t
2
.
11
−
1.13.6.
j
a
r
:
1.13.6
]
a
t
j
a
v
a
.
u
t
i
l
.
c
o
n
c
u
r
r
e
n
t
.
C
o
m
p
l
e
t
a
b
l
e
F
u
t
u
r
e
24(TaskExecutor.java:2064) ~[flink-dist_2.11-1.13.6.jar:1.13.6] at java.util.concurrent.CompletableFuture
24
(
T
a
s
k
E
x
ec
u
t
or
.
ja
v
a
:
2064
)
[
f
l
ink
−
d
i
s
t
2
.11
−
1.13.6.
ja
r
:
1.13.6
]
a
t
ja
v
a
.
u
t
i
l
.
co
n
c
u
rre
n
t
.
C
o
m
pl
e
t
ab
l
e
F
u
t
u
re
AsyncSupply.run(CompletableFuture.java:1590) ~[?:1.8.0_232]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) ~[?:1.8.0_232]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) ~[?:1.8.0_232]
at java.lang.Thread.run(Thread.java:748) ~[?:1.8.0_232]
3.报错内容分析
2022-08-30 11:17:08.425 [flink-akka.actor.default-dispatcher-3] ERROR org.apache.flink.runtime.rest.handler.taskmanager.TaskManagerStdoutFileHandler [] - Unhandled exception.
org.apache.flink.util.FlinkException: The file STDOUT does not exist on the TaskExecutor.
at
该报错主要是找不到STDOUT文件,原因是程序中没有sout输出,当你去web-ui点击stdout目录,就会报一个这儿样的接口请求错误,并不影响程序运行,可忽略。
4.解决方案
建议忽略
如果一定要修复,提供以下方案:
1.修复flink runtime源码
2.如果没有sout输出,不要点击stdout目录
3.随便加一点sout输出在程序里