Avoid materializing list of segment files when finding a partition file during shuffle#11903

Merged

loquisgon merged 2 commits intoapache:masterfrom loquisgon:find_part_file

Nov 11, 2021

+4-9

Commits on Nov 10, 2021

Avoid materializing list of segment files (it can cause OOM/memory pressure) as well as looping over the files.
Agustin Gonzalez
committed

Commits on Nov 11, 2021

Validate subTaskId
Agustin Gonzalez
committed