Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

rocksdb version metaserver takes up a lot of memory #1381

Closed
YunhuiChen opened this issue Apr 29, 2022 · 1 comment
Closed

rocksdb version metaserver takes up a lot of memory #1381

YunhuiChen opened this issue Apr 29, 2022 · 1 comment
Assignees
@Wine93
Labels
bug Something isn't working need test Completion of development, requires QA verification
Milestone
Curve-2.2.0-beta

Comments

@YunhuiChen
Copy link
Contributor

Describe the bug (描述bug)
rocksdb version metaserver takes up a lot of memory

To Reproduce (复现方法)

image
image

Expected behavior (期望行为)

Versions (各种版本)
OS:
Compiler:
branch:
commit id:

Additional context/screenshots (更多上下文/截图)
@YunhuiChen YunhuiChen added the bug Something isn't working label Apr 29, 2022
@YunhuiChen YunhuiChen added this to the Curve-2.2.0-beta milestone Apr 29, 2022
@Wine93 Wine93 mentioned this issue May 4, 2022
Merged
2 tasks
Wine93 added a commit that referenced this issue May 6, 2022
@Wine93
curvefs/metaserver: fixed rocksdb storage memory leak caused by unrel…
f78f563 
…easing iterator and transaction. (#1381)
@Wine93 Wine93 mentioned this issue May 6, 2022
Merged
2 tasks
YunhuiChen pushed a commit that referenced this issue May 6, 2022
@Wine93 @YunhuiChen
curvefs/metaserver: fixed rocksdb storage memory leak caused by unrel…
68a3e6d 
…easing iterator and transaction. (#1381)
@Wine93
Copy link
Contributor

Wine93 commented May 6, 2022 •
edited
Loading

The bug fixed, for test, i deploy a cluster and run mdtest to create many files for monitor metaserver's memory. the cluster
running about 17 hours and creates 7633225 files, and the metaserver cost about 5GB memory, it's what we expected.
the below images will explain it.

  • mdtest:
$ mdtest -C -F -L -z 4 -b 10 -I 10000 -d /path/to/mount -w 1024

  • number of files:
    image

  • cluster status:
    image

  • metaserver memory usage:
    image

  • jeprof:
    image

@Wine93 Wine93 added the need test Completion of development, requires QA verification label May 6, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@Wine93 Wine93

Labels
bug Something isn't working need test Completion of development, requires QA verification
Projects
None yet
Milestone
Curve-2.2.0-beta
Development

No branches or pull requests
2 participants
@Wine93 @YunhuiChen