Spark 3.5: Parallelize reading files in snapshot and migrate procedures #44
Job | Run time |
---|---|
35m 10s | |
37m 22s | |
33m 58s | |
40m 13s | |
39m 7s | |
41m 14s | |
41m 38s | |
47m 12s | |
40m 14s | |
48m 16s | |
37m 19s | |
37m 40s | |
40m 57s | |
42m 59s | |
41m 59s | |
43m 45s | |
43m 39s | |
46m 10s | |
12h 18m 52s |