-
Notifications
You must be signed in to change notification settings - Fork 28.5k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Improved GraphX PageRank Test Coverage #1228
Conversation
Merged build triggered. |
Merged build started. |
@ankurdave thanks for pointing out this bug! |
Merged build finished. |
Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/16151/ |
Jenkins, test this please |
test this please |
QA tests have started for PR 1228 at commit
|
QA tests have finished for PR 1228 at commit
|
@jegonzal seems like these GraphX tests actually fail -- any ideas what's going on? |
Yes. This is an extension of the unit tests to catch a class of bugs addressed in PR #1217 (which has not been merged). I believe @ankurdave was working on a merge of these two pull requests. |
Can one of the admins verify this patch? |
487c968
to
8498483
Compare
This should now be addressed in the latest master and does not depend on PR #1217 |
ok to test |
Jenkins, test this please. |
Test build #23072 has started for PR 1228 at commit
|
Test build #23072 has finished for PR 1228 at commit
|
Test PASSed. |
@ankurdave and @rxin can we merge this now? |
Test build #24257 has started for PR 1228 at commit
|
Test build #24257 has finished for PR 1228 at commit
|
Test PASSed. |
@jegonzal cleaning house a bit -- this is the oldest oustanding PR. Are you proceeding with it? |
I think we have covered most of this code in later tests (PR #1217) and the remaining tests need to be substantially updated which I can do in a later PR. I am going to go ahead and close this one. Sorry about the delay. |
…e#1228) ### What changes were proposed in this pull request? This PR adds connector APIs for DELETE/UPDATE/MERGE operations. It is similar to what we had in 3.1 but with changes to support merge-on-read per [this](https://docs.google.com/document/d/12Ywmc47j3l2WF4anG5vL4qlrhT2OKigb7_EbIKhxg60/) design doc. ### Why are the changes needed? These changes are needed to support DELETE/UPDATE/MERGE operations. ### Does this PR introduce _any_ user-facing change? This PR adds isolated connector APIs that will be used only by Iceberg. ### How was this patch tested? Local testing.
This PR adds additional tests that identify a bug in the current implementation of
staticPagerank
. This bug is addressed in #1217.