[SPARK-5831][Streaming]When checkpoint file size is bigger than 10, t…

…hen delete the old ones Author: Xutingjun <[email protected]> Closes apache#4621 from XuTingjun/checkpointFile and squashes the following commits: b5f2816 [Xutingjun] fix bug
zzcclp · Mar 11, 2015 · 6a4f909 · 6a4f909
1 parent ddb62d3
commit 6a4f909
Showing 1 changed file with 1 addition and 1 deletion.
diff --git a/streaming/src/main/scala/org/apache/spark/streaming/Checkpoint.scala b/streaming/src/main/scala/org/apache/spark/streaming/Checkpoint.scala
@@ -152,7 +152,7 @@ class CheckpointWriter(
 
           // Delete old checkpoint files
           val allCheckpointFiles = Checkpoint.getCheckpointFiles(checkpointDir, fs)
-          if (allCheckpointFiles.size > 4) {
+          if (allCheckpointFiles.size > 10) {
             allCheckpointFiles.take(allCheckpointFiles.size - 10).foreach(file => {
               logInfo("Deleting " + file)
               fs.delete(file, true)