diff --git a/docs/interpreter/livy.md b/docs/interpreter/livy.md index 295a5080f40..225cd817bee 100644 --- a/docs/interpreter/livy.md +++ b/docs/interpreter/livy.md @@ -23,6 +23,11 @@ Additional requirements for the Livy interpreter are: * Livy server. ### Configuration +We added some common configurations for spark, and you can set any configuration you want. +This link contains all spark configurations: http://spark.apache.org/docs/latest/configuration.html#available-properties. +And instead of starting property with `spark.` it should be replaced with `livy.spark.`. +Example: `spark.master` to `livy.spark.master` +
Property | @@ -30,7 +35,7 @@ Additional requirements for the Livy interpreter are:Description | ||
---|---|---|---|
zeppelin.livy.master | +livy.spark.master | local[*] | Spark master uri. ex) spark://masterhost:7077 | 1000 | Max number of SparkSQL result to display. | +
livy.spark.driver.cores | ++ | Driver cores. ex) 1, 2. | +|
livy.spark.driver.memory | ++ | Driver memory. ex) 512m, 32g. | +|
livy.spark.executor.instances | ++ | Executor instances. ex) 1, 4. | +|
livy.spark.executor.cores | ++ | Num cores per executor. ex) 1, 4. | +|
livy.spark.executor.memory | ++ | Executor memory per worker instance. ex) 512m, 32g. | +|
livy.spark.dynamicAllocation.enabled | ++ | Use dynamic resource allocation. ex) True, False. | +|
livy.spark.dynamicAllocation.cachedExecutorIdleTimeout | ++ | Remove an executor which has cached data blocks. | +|
livy.spark.dynamicAllocation.minExecutors | ++ | Lower bound for the number of executors. | +|
livy.spark.dynamicAllocation.initialExecutors | ++ | Initial number of executors to run. | +|
livy.spark.dynamicAllocation.maxExecutors | ++ | Upper bound for the number of executors. | +