Spark 3.5: Parallelize reading files in snapshot and migrate procedures #19904
Job | Run time |
---|---|
40m 0s | |
38m 30s | |
42m 9s | |
40m 55s | |
50m 16s | |
48m 18s | |
35m 43s | |
37m 43s | |
42m 13s | |
42m 39s | |
49m 47s | |
50m 10s | |
35m 19s | |
36m 15s | |
41m 55s | |
45m 10s | |
48m 26s | |
42m 52s | |
12h 48m 20s |