-
Notifications
You must be signed in to change notification settings - Fork 425
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
TEZ-4407: Misleading split info in TezSplitGrouper logs when adjusting small splits #202
Conversation
This comment was marked as outdated.
This comment was marked as outdated.
" Min splitLength: " + minLengthPerGroup + | ||
" New desired splits: " + newDesiredNumSplits + | ||
" Total length: " + totalLength + | ||
" Original splits: " + originalSplits.size()); | ||
desiredNumSplits = newDesiredNumSplits; | ||
} |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
what about adding an else branch here with some useful log message describing whatever happens (or doesn't happen) when allSplitsHaveLocalhost=true
otherwise LGTM
cc: @rbalamohan
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I added a log message here c715c0b and also made a small refactoring to gather logging in one place and always log if splitLength bounds are exceeded.
Anyways the most important point in this patch is to be able to see the original desiredNumSplits
in every case; especially when it is different from newDesiredNumSplits
or not.
💔 -1 overall
This message was automatically generated. |
No description provided.