Spark local test failure: System memory should meet the minimum requirement of 471859200.
发布时间
阅读量：
阅读量
Spark本地测试内存异常解决方案
-
- 一、存在的异常情况
- 二、引发异常的因素
- 三、应对措施
- 一、存在的异常情况
一、异常如下
java.lang.IllegalArgumentException: System memory 259522560 must be at least 471859200. Please increase heap size using the --driver-memory option or spark.driver.memory in Spark configuration.
at org.apache.spark.memory.UnifiedMemoryManager$.getMaxMemory(UnifiedMemoryManager.scala:217)
at org.apache.spark.memory.UnifiedMemoryManager$.apply(UnifiedMemoryManager.scala:199)
at org.apache.spark.SparkEnv$.create(SparkEnv.scala:332)
at org.apache.spark.SparkEnv$.createDriverEnv(SparkEnv.scal全部评论 (0)
还没有任何评论哟~