博客

oozie 调度shell权限问题解决（非目录问题）

  • Post author:
  • Post category:其他


2019-10-18 16:58:26,303  INFO ActionStartXCommand:520 - SERVER[bigdata.t02.58btc.com] USER[bigdata] GROUP[-] TOKEN[] APP[oozieTest] JOB[0000004-190919182638476-oozie-oozi-W] ACTION[0000004-190919182638476-oozie-oozi-W@:start:] Start action [0000004-190919182638476-oozie-oozi-W@:start:] with user-retry state : userRetryCount [0], userRetryMax [0], userRetryInterval [10]
2019-10-18 16:58:26,304  INFO ActionStartXCommand:520 - SERVER[bigdata.t02.58btc.com] USER[bigdata] GROUP[-] TOKEN[] APP[oozieTest] JOB[0000004-190919182638476-oozie-oozi-W] ACTION[0000004-190919182638476-oozie-oozi-W@:start:] [***0000004-190919182638476-oozie-oozi-W@:start:***]Action status=DONE
2019-10-18 16:58:26,304  INFO ActionStartXCommand:520 - SERVER[bigdata.t02.58btc.com] USER[bigdata] GROUP[-] TOKEN[] APP[oozieTest] JOB[0000004-190919182638476-oozie-oozi-W] ACTION[0000004-190919182638476-oozie-oozi-W@:start:] [***0000004-190919182638476-oozie-oozi-W@:start:***]Action updated in DB!
2019-10-18 16:58:26,372  INFO WorkflowNotificationXCommand:520 - SERVER[bigdata.t02.58btc.com] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[0000004-190919182638476-oozie-oozi-W] ACTION[0000004-190919182638476-oozie-oozi-W@:start:] No Notification URL is defined. Therefore nothing to notify for job 0000004-190919182638476-oozie-oozi-W@:start:
2019-10-18 16:58:26,372  INFO WorkflowNotificationXCommand:520 - SERVER[bigdata.t02.58btc.com] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[0000004-190919182638476-oozie-oozi-W] ACTION[] No Notification URL is defined. Therefore nothing to notify for job 0000004-190919182638476-oozie-oozi-W
2019-10-18 16:58:26,393  INFO ActionStartXCommand:520 - SERVER[bigdata.t02.58btc.com] USER[bigdata] GROUP[-] TOKEN[] APP[oozieTest] JOB[0000004-190919182638476-oozie-oozi-W] ACTION[0000004-190919182638476-oozie-oozi-W@shell_4] Start action [0000004-190919182638476-oozie-oozi-W@shell_4] with user-retry state : userRetryCount [0], userRetryMax [0], userRetryInterval [10]
2019-10-18 16:58:27,556  INFO ShellActionExecutor:520 - SERVER[bigdata.t02.58btc.com] USER[bigdata] GROUP[-] TOKEN[] APP[oozieTest] JOB[0000004-190919182638476-oozie-oozi-W] ACTION[0000004-190919182638476-oozie-oozi-W@shell_4] Trying to get job [job_1568888835612_0371], attempt [1]
2019-10-18 16:58:27,585  INFO ShellActionExecutor:520 - SERVER[bigdata.t02.58btc.com] USER[bigdata] GROUP[-] TOKEN[] APP[oozieTest] JOB[0000004-190919182638476-oozie-oozi-W] ACTION[0000004-190919182638476-oozie-oozi-W@shell_4] checking action, hadoop job ID [job_1568888835612_0371] status [RUNNING]
2019-10-18 16:58:27,589  INFO ActionStartXCommand:520 - SERVER[bigdata.t02.58btc.com] USER[bigdata] GROUP[-] TOKEN[] APP[oozieTest] JOB[0000004-190919182638476-oozie-oozi-W] ACTION[0000004-190919182638476-oozie-oozi-W@shell_4] [***0000004-190919182638476-oozie-oozi-W@shell_4***]Action status=RUNNING
2019-10-18 16:58:27,589  INFO ActionStartXCommand:520 - SERVER[bigdata.t02.58btc.com] USER[bigdata] GROUP[-] TOKEN[] APP[oozieTest] JOB[0000004-190919182638476-oozie-oozi-W] ACTION[0000004-190919182638476-oozie-oozi-W@shell_4] [***0000004-190919182638476-oozie-oozi-W@shell_4***]Action updated in DB!
2019-10-18 16:58:27,603  INFO WorkflowNotificationXCommand:520 - SERVER[bigdata.t02.58btc.com] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[0000004-190919182638476-oozie-oozi-W] ACTION[0000004-190919182638476-oozie-oozi-W@shell_4] No Notification URL is defined. Therefore nothing to notify for job 0000004-190919182638476-oozie-oozi-W@shell_4
2019-10-18 16:58:46,709  INFO CallbackServlet:520 - SERVER[bigdata.t02.58btc.com] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[0000004-190919182638476-oozie-oozi-W] ACTION[0000004-190919182638476-oozie-oozi-W@shell_4] callback for action [0000004-190919182638476-oozie-oozi-W@shell_4]
2019-10-18 16:58:46,745  INFO ShellActionExecutor:520 - SERVER[bigdata.t02.58btc.com] USER[bigdata] GROUP[-] TOKEN[] APP[oozieTest] JOB[0000004-190919182638476-oozie-oozi-W] ACTION[0000004-190919182638476-oozie-oozi-W@shell_4] Trying to get job [job_1568888835612_0371], attempt [1]
2019-10-18 16:58:46,791  INFO ShellActionExecutor:520 - SERVER[bigdata.t02.58btc.com] USER[bigdata] GROUP[-] TOKEN[] APP[oozieTest] JOB[0000004-190919182638476-oozie-oozi-W] ACTION[0000004-190919182638476-oozie-oozi-W@shell_4] action completed, external ID [job_1568888835612_0371]
2019-10-18 16:58:46,802  WARN ShellActionExecutor:523 - SERVER[bigdata.t02.58btc.com] USER[bigdata] GROUP[-] TOKEN[] APP[oozieTest] JOB[0000004-190919182638476-oozie-oozi-W] ACTION[0000004-190919182638476-oozie-oozi-W@shell_4] Launcher ERROR, reason: Main class [org.apache.oozie.action.hadoop.ShellMain], main() threw exception, Cannot run program "oozieTest.sh" (in directory "/hadoop/yarn/local/usercache/bigdata/appcache/application_1568888835612_0371/container_e04_1568888835612_0371_01_000004"): error=13, 权限不够
2019-10-18 16:58:46,803  WARN ShellActionExecutor:523 - SERVER[bigdata.t02.58btc.com] USER[bigdata] GROUP[-] TOKEN[] APP[oozieTest] JOB[0000004-190919182638476-oozie-oozi-W] ACTION[0000004-190919182638476-oozie-oozi-W@shell_4] Launcher exception: Cannot run program "oozieTest.sh" (in directory "/hadoop/yarn/local/usercache/bigdata/appcache/application_1568888835612_0371/container_e04_1568888835612_0371_01_000004"): error=13, 权限不够
java.io.IOException: Cannot run program "oozieTest.sh" (in directory "/hadoop/yarn/local/usercache/bigdata/appcache/application_1568888835612_0371/container_e04_1568888835612_0371_01_000004"): error=13, 权限不够
	at java.lang.ProcessBuilder.start(ProcessBuilder.java:1048)
	at org.apache.oozie.action.hadoop.ShellMain.execute(ShellMain.java:110)
	at org.apache.oozie.action.hadoop.ShellMain.run(ShellMain.java:69)
	at org.apache.oozie.action.hadoop.LauncherMain.run(LauncherMain.java:75)
	at org.apache.oozie.action.hadoop.ShellMain.main(ShellMain.java:59)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at org.apache.oozie.action.hadoop.LauncherMapper.map(LauncherMapper.java:231)
	at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:54)
	at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:453)
	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:343)
	at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:170)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:422)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1869)
	at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:164)
Caused by: java.io.IOException: error=13, 权限不够
	at java.lang.UNIXProcess.forkAndExec(Native Method)
	at java.lang.UNIXProcess.<init>(UNIXProcess.java:247)
	at java.lang.ProcessImpl.start(ProcessImpl.java:134)
	at java.lang.ProcessBuilder.start(ProcessBuilder.java:1029)
	... 17 more

2019-10-18 16:58:46,904  INFO ActionEndXCommand:520 - SERVER[bigdata.t02.58btc.com] USER[bigdata] GROUP[-] TOKEN[] APP[oozieTest] JOB[0000004-190919182638476-oozie-oozi-W] ACTION[0000004-190919182638476-oozie-oozi-W@shell_4] ERROR is considered as FAILED for SLA
2019-10-18 16:58:46,966  INFO ActionStartXCommand:520 - SERVER[bigdata.t02.58btc.com] USER[bigdata] GROUP[-] TOKEN[] APP[oozieTest] JOB[0000004-190919182638476-oozie-oozi-W] ACTION[0000004-190919182638476-oozie-oozi-W@kill] Start action [0000004-190919182638476-oozie-oozi-W@kill] with user-retry state : userRetryCount [0], userRetryMax [0], userRetryInterval [10]

权限不够 unicode编码 == 权限不够

解决办法：一、 编辑操作的话，增加此列

二、拖拽操作，配置这里，制定文件。


版权声明：本文为MR_REN019235原创文章，遵循 CC 4.0 BY-SA 版权协议，转载请附上原文出处链接和本声明。