spark提交命令

spark提交命令

client模式提交

bin/spark-submit –class spark.test.AppMain –deploy-mode cluster –master spark://node001:7077 spark-test-1.0-jar-with-dependencies.jar

不使用assembly包提交

bin/spark-submit –driver-memory 5g –executor-memory 10g –total-executor-cores 3 –class spark.test.AppMain –deploy-mode client –master spark://node001:7077 –jars $(echo lib/*.jar | tr ‘ ‘ ‘,’) spark-test-1.0.jar