2024-09-14 03:19:34,766 INFO org.apache.flink.client.cli.CliFrontend [] - -------------------------------------------------------------------------------- 2024-09-14 03:19:34,769 INFO org.apache.flink.client.cli.CliFrontend [] - Starting Command Line Client (Version: 1.19.1, Scala: 2.12, Rev:5edb5a9, Date:2024-06-06T14:45:33+02:00) 2024-09-14 03:19:34,769 INFO org.apache.flink.client.cli.CliFrontend [] - OS current user: root 2024-09-14 03:19:34,769 INFO org.apache.flink.client.cli.CliFrontend [] - Current Hadoop/Kerberos user: 2024-09-14 03:19:34,769 INFO org.apache.flink.client.cli.CliFrontend [] - JVM: OpenJDK 64-Bit Server VM - Red Hat, Inc. - 11/11.0.22+7-LTS 2024-09-14 03:19:34,769 INFO org.apache.flink.client.cli.CliFrontend [] - Arch: amd64 2024-09-14 03:19:34,769 INFO org.apache.flink.client.cli.CliFrontend [] - Maximum heap size: 30688 MiBytes 2024-09-14 03:19:34,769 INFO org.apache.flink.client.cli.CliFrontend [] - JAVA_HOME: 2024-09-14 03:19:34,770 INFO org.apache.flink.client.cli.CliFrontend [] - No Hadoop Dependency available 2024-09-14 03:19:34,770 INFO org.apache.flink.client.cli.CliFrontend [] - JVM Options: 2024-09-14 03:19:34,770 INFO org.apache.flink.client.cli.CliFrontend [] - -XX:+IgnoreUnrecognizedVMOptions 2024-09-14 03:19:34,770 INFO org.apache.flink.client.cli.CliFrontend [] - -Dsource.pb.enable=false 2024-09-14 03:19:34,770 INFO org.apache.flink.client.cli.CliFrontend [] - -Dsource.json.enable=true 2024-09-14 03:19:34,770 INFO org.apache.flink.client.cli.CliFrontend [] - -Dsource.json.kafka.brokers=kafka.observe.svc.cluster.local:9092 2024-09-14 03:19:34,770 INFO org.apache.flink.client.cli.CliFrontend [] - -Dsource.json.kafka.topics=otel 2024-09-14 03:19:34,770 INFO org.apache.flink.client.cli.CliFrontend [] - -DMYSQL_DSN=jdbc:mysql://mysql.observe.svc.cluster.local:3306/observe 2024-09-14 03:19:34,770 INFO org.apache.flink.client.cli.CliFrontend [] - -DtraceURL.tableName=otel.otel_traces_url_local 2024-09-14 03:19:34,771 INFO org.apache.flink.client.cli.CliFrontend [] - -Dlog.file=/root/deploy/ob-agent-stream/log/flink-root-client-k8smaster.log 2024-09-14 03:19:34,771 INFO org.apache.flink.client.cli.CliFrontend [] - -Dlog4j.configuration=file:/root/deploy/ob-agent-stream/conf/log4j-cli.properties 2024-09-14 03:19:34,771 INFO org.apache.flink.client.cli.CliFrontend [] - -Dlog4j.configurationFile=file:/root/deploy/ob-agent-stream/conf/log4j-cli.properties 2024-09-14 03:19:34,771 INFO org.apache.flink.client.cli.CliFrontend [] - -Dlogback.configurationFile=file:/root/deploy/ob-agent-stream/conf/logback.xml 2024-09-14 03:19:34,771 INFO org.apache.flink.client.cli.CliFrontend [] - Program Arguments: 2024-09-14 03:19:34,773 INFO org.apache.flink.client.cli.CliFrontend [] - run-application 2024-09-14 03:19:34,773 INFO org.apache.flink.client.cli.CliFrontend [] - --target 2024-09-14 03:19:34,773 INFO org.apache.flink.client.cli.CliFrontend [] - kubernetes-application 2024-09-14 03:19:34,773 INFO org.apache.flink.client.cli.CliFrontend [] - -Dkubernetes.cluster-id=ob-agent-stream 2024-09-14 03:19:34,773 INFO org.apache.flink.client.cli.CliFrontend [] - -Dkubernetes.container.image.ref=reg.cestong.com.cn/cecf/ob-agent-stream:v2.0.0 2024-09-14 03:19:34,773 INFO org.apache.flink.client.cli.CliFrontend [] - -Dkubernetes.namespace=ob 2024-09-14 03:19:34,773 INFO org.apache.flink.client.cli.CliFrontend [] - local:///opt/flink/usrlib/ob-agent-stream.jar 2024-09-14 03:19:34,773 INFO org.apache.flink.client.cli.CliFrontend [] - Classpath: /root/deploy/ob-agent-stream/lib/flink-cep-1.19.1.jar:/root/deploy/ob-agent-stream/lib/flink-connector-files-1.19.1.jar:/root/deploy/ob-agent-stream/lib/flink-csv-1.19.1.jar:/root/deploy/ob-agent-stream/lib/flink-json-1.19.1.jar:/root/deploy/ob-agent-stream/lib/flink-scala_2.12-1.19.1.jar:/root/deploy/ob-agent-stream/lib/flink-table-api-java-uber-1.19.1.jar:/root/deploy/ob-agent-stream/lib/flink-table-planner-loader-1.19.1.jar:/root/deploy/ob-agent-stream/lib/flink-table-runtime-1.19.1.jar:/root/deploy/ob-agent-stream/lib/log4j-1.2-api-2.17.1.jar:/root/deploy/ob-agent-stream/lib/log4j-api-2.17.1.jar:/root/deploy/ob-agent-stream/lib/log4j-core-2.17.1.jar:/root/deploy/ob-agent-stream/lib/log4j-slf4j-impl-2.17.1.jar:/root/deploy/ob-agent-stream/lib/flink-dist-1.19.1.jar::: 2024-09-14 03:19:34,774 INFO org.apache.flink.client.cli.CliFrontend [] - -------------------------------------------------------------------------------- 2024-09-14 03:19:34,776 INFO org.apache.flink.configuration.GlobalConfiguration [] - Using standard YAML parser to load flink configuration file from /root/deploy/ob-agent-stream/conf/config.yaml. 2024-09-14 03:19:34,848 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: kubernetes.taskmanager.annotations.prometheus.io/port, 9249 2024-09-14 03:19:34,849 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: jobmanager.execution.failover-strategy, region 2024-09-14 03:19:34,849 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: jobmanager.rpc.address, localhost 2024-09-14 03:19:34,849 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: taskmanager.memory.task.off-heap.size, 256m 2024-09-14 03:19:34,849 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: metrics.reporter.prom.factory.class, org.apache.flink.metrics.prometheus.PrometheusReporterFactory 2024-09-14 03:19:34,849 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: kubernetes.jobmanager.cpu.limit-factor, 2 2024-09-14 03:19:34,849 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: jobmanager.bind-host, localhost 2024-09-14 03:19:34,849 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: kubernetes.taskmanager.cpu.amount, 1 2024-09-14 03:19:34,849 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: taskmanager.host, localhost 2024-09-14 03:19:34,849 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: parallelism.default, 3 2024-09-14 03:19:34,850 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: taskmanager.numberOfTaskSlots, 1 2024-09-14 03:19:34,850 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: kubernetes.taskmanager.cpu.limit-factor, 4 2024-09-14 03:19:34,850 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: kubernetes.taskmanager.annotations.prometheus.io/scrape, true 2024-09-14 03:19:34,850 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: kubernetes.taskmanager.annotations.prometheus.io/path, / 2024-09-14 03:19:34,850 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: metrics.reporter.prom.scope.variables.additional.biz, ob-agent-stream 2024-09-14 03:19:34,850 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: env.java.opts.all, -Dsource.pb.enable=false -Dsource.json.enable=true -Dsource.json.kafka.brokers=kafka.observe.svc.cluster.local:9092 -Dsource.json.kafka.topics=otel -DMYSQL_DSN=jdbc:mysql://mysql.observe.svc.cluster.local:3306/observe -DtraceURL.tableName=otel.otel_traces_url_local 2024-09-14 03:19:34,850 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: taskmanager.memory.process.size, 4gb 2024-09-14 03:19:34,850 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: metrics.reporter.prom.port, 9249 2024-09-14 03:19:34,851 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: taskmanager.bind-host, localhost 2024-09-14 03:19:34,851 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: kubernetes.pod-template-file.taskmanager, ./conf/taskmanager-pod-template.yaml 2024-09-14 03:19:34,851 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: metrics.latency.interval, 5 2024-09-14 03:19:34,851 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: jobmanager.memory.process.size, 1600m 2024-09-14 03:19:34,852 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: taskmanager.memory.network.fraction, 0.2 2024-09-14 03:19:34,852 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: jobmanager.rpc.port, 6123 2024-09-14 03:19:34,852 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: rest.bind-address, localhost 2024-09-14 03:19:34,852 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: pipeline.serialization-config, [{io.opentelemetry.proto.collector.trace.v1.ExportTraceServiceRequest: {type: kryo, kryo-type: registered, class: com.twitter.chill.protobuf.ProtobufSerializer}}] 2024-09-14 03:19:34,853 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: kubernetes.jobmanager.cpu.amount, 0.5 2024-09-14 03:19:34,853 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: rest.address, localhost 2024-09-14 03:19:34,853 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: kubernetes.pod-template-file.jobmanager, ./conf/jobmanager-pod-template.yaml 2024-09-14 03:19:34,889 INFO org.apache.flink.client.cli.CliFrontend [] - Loading FallbackYarnSessionCli 2024-09-14 03:19:34,918 INFO org.apache.flink.core.fs.FileSystem [] - Hadoop is not in the classpath/dependencies. The extended set of supported File Systems via Hadoop is not available. 2024-09-14 03:19:34,938 INFO org.apache.flink.core.plugin.DefaultPluginManager [] - Plugin loader with ID not found, creating it: metrics-influx 2024-09-14 03:19:34,944 INFO org.apache.flink.core.plugin.DefaultPluginManager [] - Plugin loader with ID not found, creating it: metrics-statsd 2024-09-14 03:19:34,944 INFO org.apache.flink.core.plugin.DefaultPluginManager [] - Plugin loader with ID not found, creating it: metrics-slf4j 2024-09-14 03:19:34,944 INFO org.apache.flink.core.plugin.DefaultPluginManager [] - Plugin loader with ID not found, creating it: metrics-datadog 2024-09-14 03:19:34,945 INFO org.apache.flink.core.plugin.DefaultPluginManager [] - Plugin loader with ID not found, creating it: metrics-graphite 2024-09-14 03:19:34,945 INFO org.apache.flink.core.plugin.DefaultPluginManager [] - Plugin loader with ID not found, creating it: metrics-jmx 2024-09-14 03:19:34,945 INFO org.apache.flink.core.plugin.DefaultPluginManager [] - Plugin loader with ID not found, creating it: metrics-prometheus 2024-09-14 03:19:34,945 INFO org.apache.flink.core.plugin.DefaultPluginManager [] - Plugin loader with ID not found, creating it: external-resource-gpu 2024-09-14 03:19:34,986 INFO org.apache.flink.runtime.security.modules.HadoopModuleFactory [] - Cannot create Hadoop Security Module because Hadoop cannot be found in the Classpath. 2024-09-14 03:19:35,001 INFO org.apache.flink.runtime.security.modules.JaasModule [] - Jaas file will be created as /tmp/jaas-5328656921725087208.conf. 2024-09-14 03:19:35,008 INFO org.apache.flink.runtime.security.contexts.HadoopSecurityContextFactory [] - Cannot install HadoopSecurityContext because Hadoop cannot be found in the Classpath. 2024-09-14 03:19:35,009 INFO org.apache.flink.client.cli.CliFrontend [] - Running 'run-application' command. 2024-09-14 03:19:35,017 INFO org.apache.flink.client.deployment.application.cli.ApplicationClusterDeployer [] - Submitting application in 'Application Mode'. 2024-09-14 03:19:35,019 INFO org.apache.flink.client.deployment.DefaultClusterClientServiceLoader [] - Could not load factory due to missing dependencies. 2024-09-14 03:19:36,111 INFO org.apache.flink.runtime.util.config.memory.ProcessMemoryUtils [] - The derived from fraction jvm overhead memory (160.000mb (167772162 bytes)) is less than its min value 192.000mb (201326592 bytes), min value will be used instead 2024-09-14 03:19:36,620 INFO org.apache.flink.kubernetes.utils.KubernetesUtils [] - Kubernetes deployment requires a fixed port. Configuration blob.server.port will be set to 6124 2024-09-14 03:19:36,621 INFO org.apache.flink.kubernetes.utils.KubernetesUtils [] - Kubernetes deployment requires a fixed port. Configuration taskmanager.rpc.port will be set to 6122 2024-09-14 03:19:37,620 WARN org.apache.flink.kubernetes.KubernetesClusterDescriptor [] - Please note that Flink client operations(e.g. cancel, list, stop, savepoint, etc.) won't work from outside the Kubernetes cluster since 'kubernetes.rest-service.exposed.type' has been set to ClusterIP. 2024-09-14 03:19:37,634 INFO org.apache.flink.kubernetes.KubernetesClusterDescriptor [] - Create flink application cluster ob-agent-stream successfully, JobManager Web Interface: http://ob-agent-stream-rest.ob:8081