求教:spark-submit提交作业到yarn上一直accepted? INFO yarn.Client: ...st

玉瑩***

(刚开始学spark的小白谢谢大牛了?)
输入代码如下 $ spark-submit --master yarn --name spark-yarn /home/hadoop/script/spark04.py hdfs://hadoop000:8020/hello.txt hdfs://hadoop000:8020/hello/output

但是跑起来后一直卡着:(代码在local或者standalone都能正常执行)
19/05/17 22:44:03 INFO yarn.Client: Application report for application_1558100973798_0001 (state: ACCEPTED)
19/05/17 22:44:04 INFO yarn.Client: Application report for application_1558100973798_0001 (state: ACCEPTED)
19/05/17 22:44:05 INFO yarn.Client: Application report for application_1558100973798_0001 (state: ACCEPTED)
19/05/17 22:44:06 INFO yarn.Client: Application report for application_1558100973798_0001 (state: ACCEPTED)
19/05/17 22:44:07 INFO yarn.Client: Application report for application_1558100973798_0001 (state: ACCEPTED)
19/05/17 22:44:08 INFO yarn.Client: Application report for application_1558100973798_0001 (state: ACCEPTED)
19/05/17 22:44:09 INFO yarn.Client: Application report for application_1558100973798_0001 (state: ACCEPTED)
19/05/17 22:44:10 INFO yarn.Client: Application report for application_1558100973798_0001 (state: ACCEPTED)
19/05/17 22:44:11 INFO yarn.Client: Application report for application_1558100973798_0001 (state: ACCEPTED)
19/05/17 22:44:12 INFO yarn.Client: Application report for application_1558100973798_0001 (state: ACCEPTED)
19/05/17 22:44:13 INFO yarn.Client: Application report for application_1558100973798_0001 (state: ACCEPTED)
19/05/17 22:44:14 INFO yarn.Client: Application report for application_1558100973798_0001 (state: ACCEPTED)
19/05/17 22:44:15 INFO yarn.Client: Application report for application_1558100973798_0001 (state: ACCEPTED)
19/05/17 22:44:16 INFO yarn.Client: Application report for application_1558100973798_0001 (state: ACCEPTED)

我的一些配置如下: yarn-site.xml只有这个

capacity-scheduler.xml中yarn分配的也照网上的由0.1改为0.5了

节点也没挂

请问要怎么做呢?

18k***

这个至少有两种情况
1，任务申请不到足够的资源启动
2. 提交任务的用户被限制了。不能提交任务了

已有账号？

找人解决需求

求教:spark-submit提交作业到yarn上一直accepted? INFO yarn.Client: ...st

全部参与1

热门问答

玉瑩***

今日需求悬赏

今日问答求助

发布任务需求已有1031166位用户正在使用天盟网服务

新手帮助

平台规则

关于天盟

一键快捷导航

微信公众号

手机客户端