Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix gather for sliced input structs column #9218

Merged
merged 5 commits into from
Sep 17, 2021

Conversation

ttnghia
Copy link
Contributor

@ttnghia ttnghia commented Sep 11, 2021

This PR fixes the gather API for structs columns when the input is a sliced column. Previously, gather calls child_begin() and child_end() to access the children column so if the input structs column is sliced then the output is incorrect.

This closes #9213, and is blocked by #9194 due to conflict work.

@ttnghia ttnghia added bug Something isn't working libcudf Affects libcudf (C++/CUDA) code. 5 - Merge After Dependencies non-breaking Non-breaking change labels Sep 11, 2021
@ttnghia ttnghia requested a review from a team as a code owner September 11, 2021 05:22
@ttnghia ttnghia self-assigned this Sep 11, 2021
@ttnghia ttnghia added the 3 - Ready for Review Ready for review by team label Sep 11, 2021
@ttnghia
Copy link
Contributor Author

ttnghia commented Sep 13, 2021

Rerun tests.

@ttnghia
Copy link
Contributor Author

ttnghia commented Sep 13, 2021

Rerun tests.

@rapidsai rapidsai deleted a comment from codecov bot Sep 13, 2021
@rapidsai rapidsai deleted a comment from codecov bot Sep 13, 2021
@mythrocks
Copy link
Contributor

Hey, @ttnghia. I just merged #9194. Please rebase this change.

# Conflicts:
#	cpp/include/cudf/detail/gather.cuh
#	cpp/tests/copying/gather_struct_tests.cpp
@rapidsai rapidsai deleted a comment from codecov bot Sep 14, 2021
@rapidsai rapidsai deleted a comment from codecov bot Sep 14, 2021
@ttnghia
Copy link
Contributor Author

ttnghia commented Sep 17, 2021

@gpucibot merge

@rapids-bot rapids-bot bot merged commit 3bbec6e into rapidsai:branch-21.10 Sep 17, 2021
@ttnghia ttnghia deleted the fix_gather_with_structs branch September 20, 2021 18:42
rapids-bot bot pushed a commit that referenced this pull request Sep 21, 2021
This PR add support for struct type into the existing `drop_list_duplicates` API. This is the first time a nested type is supported in this function. Some more code cleanup has also been done.

To be clear: Only structs of basic types and structs of structs are supported. Structs of lists are not, due to their complex nature.

Closes #8972.
Blocked by #9218 (it is merged).

Authors:
  - Nghia Truong (https://github.com/ttnghia)

Approvers:
  - Vyas Ramasubramani (https://github.com/vyasr)
  - https://github.com/nvdbaranec
  - Mark Harris (https://github.com/harrism)

URL: #9202
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
3 - Ready for Review Ready for review by team bug Something isn't working libcudf Affects libcudf (C++/CUDA) code. non-breaking Non-breaking change
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[BUG] lists::detail::sort_lists returns wrong result for sliced lists column containing structs entries
3 participants