Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[SPARK-38246][CORE][SQL][SS][WEBUI] Refactor KVUtils and add UTs related to RocksDB #35563

Closed
wants to merge 1 commit into from

Conversation

LuciferYang
Copy link
Contributor

@LuciferYang LuciferYang commented Feb 18, 2022

What changes were proposed in this pull request?

The main change of this pr as follows:

  1. Refactor KVUtils to let the open method can use the passed conf to construct the corresponding KVStore
  2. Use new KVUtils#open to add UTs related to RocksDB, the new UTs cover the scenarios LevelDB has tested.

Why are the changes needed?

Add more test scenarios related to RocksDB.

Does this PR introduce any user-facing change?

No

How was this patch tested?

Pass GA and add new UTs

@LuciferYang LuciferYang changed the title [SPARK-38246][SQL] Refactor KVUtils and add UTs related to RocksDB [SPARK-38246][CORE][SQL][SS][WEBUI] Refactor KVUtils and add UTs related to RocksDB Feb 18, 2022
@LuciferYang
Copy link
Contributor Author

cc @dongjoon-hyun

Copy link
Member

@dongjoon-hyun dongjoon-hyun left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

+1, LGTMl. Thank you, @LuciferYang .
Merged to master.

@LuciferYang
Copy link
Contributor Author

thanks @dongjoon-hyun

@LuciferYang LuciferYang deleted the kvutils-open branch October 22, 2023 07:44
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants