SparkSql执行到sql语句就会报错

  • Post author:
  • Post category:其他


18/10/30 11:52:17 INFO yarn.Client:

client token: Token { kind: YARN_CLIENT_TOKEN, service:  }

diagnostics: N/A

ApplicationMaster host: 10.16.208.172

ApplicationMaster RPC port: 0

queue: root.users.test

start time: 1540871495657

final status: FAILED

tracking URL: http://g1-bdp-cdhtest-02.dns.guazi.com:8088/proxy/application_1537373615079_0827/

user: test

Exception in thread “main” org.apache.spark.SparkException: Application application_1537373615079_0827 finished with failed status

at org.apache.spark.deploy.yarn.Client.run(Client.scala:1031)

at org.apache.spark.deploy.yarn.Client$.main(Client.scala:1078)

at org.apache.spark.deploy.yarn.Client.main(Client.scala)

at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)

at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)

at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)

at java.lang.reflect.Method.invoke(Method.java:498)

at org.apache.spark.deploy.SparkSubmit$.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:730)

at org.apache.spark.deploy.SparkSubmit$.doRunMain$1(SparkSubmit.scala:181)

at org.apache.spark.deploy.SparkSubmit$.submit(SparkSubmit.scala:206)

at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:121)

at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)

18/10/30 11:52:17 INFO util.ShutdownHookManager: Shutdown hook called

18/10/30 11:52:17 INFO util.ShutdownHookManager: Deleting directory /tmp/spark-0241f96e-9674-473c-b0a7-6cad3747c130

执行到这一步hql语句,就会报上面的错误,表也不是分区表,那几个startTime的参数,是传进来的变量



版权声明:本文为qq_41626645原创文章,遵循 CC 4.0 BY-SA 版权协议,转载请附上原文出处链接和本声明。