Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Plugin] 多机 wdPoSt 支持 #483

Closed
4 of 6 tasks
0x5459 opened this issue Oct 13, 2022 · 9 comments · Fixed by #844
Closed
4 of 6 tasks

[Plugin] 多机 wdPoSt 支持 #483

0x5459 opened this issue Oct 13, 2022 · 9 comments · Fixed by #844
Assignees
Labels
enhancement New feature or request good first issue Good for newcomers P1 High - we should be working on this now or in the immediate future v0.8
Milestone

Comments

@0x5459
Copy link
Collaborator

0x5459 commented Oct 13, 2022

模块 / Components

  • venus-sector-manager
  • venus-worker
  • 工具链 / toolchains
  • 文档 / docs

描述 / Description

当前 wdPoSt 是由 VSM 启动 wdPoSt 子进程(我们称之为外部执行器或插件)并下发任务由子进程执行 wdPoSt。 默认的外部执行器仅支持单机执行 wdPoSt。 考虑实现一种支持多机 wdPoSt 外部执行器(插件)

Architecture:

      +-----------------------------+
      | Running on the same machine |
      |                             |
      |        +-----------+        |
      |        |    vsm    |        |
      |        +-----+-----+        |
      |              |              |
      |          exec/pipe          |
      |       send wdPoSt task      |
      |              |              |
      |       +------v-------+      |
      |       | wdPoSt plugin|      |
      |       +------+-------+      |
      |              |              |
      +--------------+--------------+
                     |
                     |
     +---------------+-------------------+
     |               |                   |
    rpc             rpc                 rpc
 send|sub task   send|sub task       send|sub task
     |               |                   |
+----v----+     +----v----+         +----v----+
|do wdPoSt|     |do wdPoSt|   ...   |do wdPoSt|
+---------+     +---------+         +---------+

Issue track:

@0x5459 0x5459 added enhancement New feature or request good first issue Good for newcomers labels Oct 13, 2022
@0x5459 0x5459 added this to the v0.6.0 milestone Oct 13, 2022
@Fatman13
Copy link
Contributor

这个对新手是不是还是比较难?😂

@litai686
Copy link

只是把winpost抽离一个组件独立进程运行而已,这样灵活性更强了,0.5.0目前是以子进程的模式工作,抽离出来更加符合微服务组件的设计框架理念。

@0x5459
Copy link
Collaborator Author

0x5459 commented Oct 15, 2022

只是把winpost抽离一个组件独立进程运行而已,这样灵活性更强了,0.5.0目前是以子进程的模式工作,抽离出来更加符合微服务组件的设计框架理念。

多机 wdPoSt plugin 这个东西本身还是以子进程的方式运行的。

@0x5459
Copy link
Collaborator Author

0x5459 commented Oct 15, 2022

这个对新手是不是还是比较难?😂

确实有点难, 但是目前来说可能是相对比较独立且已经有单机版本的实现。也不一定需要新手实现。(只是暂时没其他的 Good first issue

@litai686
Copy link

多机 wdPoSt plugin

为啥不直接把winpost业务抽出来做个二进制,独立进程去跑,这样更容易理解一些,既可以跟vsm部署在一台设备,也可以单独部署到其它专用的winpost设备上去不更容易理解些吗?

@0x5459
Copy link
Collaborator Author

0x5459 commented Oct 15, 2022

多机 wdPoSt plugin

为啥不直接把winpost业务抽出来做个二进制,独立进程去跑,这样更容易理解一些,既可以跟vsm部署在一台设备,也可以单独部署到其它专用的winpost设备上去不更容易理解些吗?

在我看来,子进程的方式更加灵活,给社区的用户提供足够的自定义的能力。也许有的人有更强大的 wdpost 算法或者其他定制需求,venus-cluster 可以给他们提供这样一个框架。

@0x5459 0x5459 added the v0.6 v0.6 features label Oct 24, 2022
@Fatman13

This comment was marked as off-topic.

@0x5459

This comment was marked as off-topic.

@0x5459
Copy link
Collaborator Author

0x5459 commented Mar 28, 2023

考虑让 venus-worker 支持 wdpost 和 winpost planner。 让 venus-worker 做这两种任务。 移除vsm的外部执行器以及proxy逻辑

@0x5459 0x5459 mentioned this issue Jul 28, 2023
5 tasks
@github-project-automation github-project-automation bot moved this from In Progress to Done in Venus Team Project(s) Jul 28, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request good first issue Good for newcomers P1 High - we should be working on this now or in the immediate future v0.8
Projects
Status: Done
Status: No status
Development

Successfully merging a pull request may close this issue.

5 participants