各种调度工具对比
下面的表格对上述四种hadoop工作流调度器的关键特征进行了比较,尽管这些工作流调度器能够解决需求场景基本一致,但在设计理念,目标用户,应用场景等方面还是存在显著的区别,在技术选型时可供参考
|
|
|
|
|
|
xml |
xml(xpdl、based) |
text file with key/value pairs |
java API |
|
data-driven |
explicit |
explicit |
explicit |
|
no |
yes |
yes |
no |
|
console/log message |
web page |
web page |
java API |
|
no |
yes |
yes |
yes |
|
command line utility |
daemon |
daemon |
api |
|
yes |
yes |
yes |
yes |
|
no |
no |
no |
yes |
|
no |
yes |
yes |
no |
|
0.18+ |
0.20+ |
currently unknown |
0.18+ |
|
no |
workflow node evel |
yes |
yes |
|
yes |
yes |
yes |
yes |
|
yes |
no |
currently unknow |
yes |