[BRANCH-1.1][SPARK-2652] change the default spark.serializer in pyspa…

…rk back to Kryo This reverts #2916 . We shouldn't change the default settings in a minor release. JoshRosen davies Author: Xiangrui Meng <[email protected]> Closes #3187 from mengxr/SPARK-2652-1.1 and squashes the following commits: 372166b [Xiangrui Meng] change the default spark.serializer in pyspark back to Kryo
apache · Nov 11, 2014 · 11798d0 · 11798d0
1 parent d313be8
commit 11798d0
Showing 1 changed file with 1 addition and 0 deletions.
diff --git a/python/pyspark/context.py b/python/pyspark/context.py
@@ -40,6 +40,7 @@
 # These are special default configs for PySpark, they will overwrite
 # the default ones for Spark if they are not configured by user.
 DEFAULT_CONFIGS = {
+    "spark.serializer": "org.apache.spark.serializer.KryoSerializer",
     "spark.serializer.objectStreamReset": 100,
     "spark.rdd.compress": True,
 }