Skip to content

Commit

Permalink
NETFLIX-BUILD: Fix pyspark rdd.materialize.
Browse files Browse the repository at this point in the history
Materialize is not in the Java API, so pyspark needs to call the method
on the underlying Scala RDD.
  • Loading branch information
rdblue committed Feb 19, 2019
1 parent 407f948 commit f1a4200
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion python/pyspark/rdd.py
Original file line number Diff line number Diff line change
Expand Up @@ -257,7 +257,7 @@ def materialize(self):
"""
Action to force materialization of this RDD. Returns a new RDD.
"""
return RDD(self._jrdd.materialize(), self.ctx,
return RDD(self._jrdd.rdd().materialize(), self.ctx,
self._jrdd_deserializer)

def checkpoint(self):
Expand Down

0 comments on commit f1a4200

Please sign in to comment.