Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

TypeDispatcher support one type multiple serializers #3242

Merged

Conversation

fyrestone
Copy link
Contributor

What do these changes do?

Mars serializers are not compatible with Ray serializers because Ray needs to dispatch ActorHandle and ObjectRef to Ray's serializer for reference counting. But, some ActorHandle and ObjectRef are nested in objects, then we needs to register object type to RaySerializer which is not compatible with Mars object type serializer.

This PR allows Mars to register multile serializers to one type, then Ray serializers are compatible with Mars serializers. We don't needs to register_ray_serializers and unregister_ray_serializers.

Related issue number

Fixes #xxxx

Check code requirements

  • tests added / passed (if needed)
  • Ensure all linting tests pass, see here for how to run them

@fyrestone fyrestone changed the title Support one type multiple serializers TypeDispatcher support one type multiple serializers Sep 5, 2022
@fyrestone fyrestone marked this pull request as ready for review September 5, 2022 02:53
@fyrestone fyrestone requested a review from a team as a code owner September 5, 2022 02:53
Copy link
Collaborator

@qinxuye qinxuye left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

Copy link
Contributor

@chaokunyang chaokunyang left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@chaokunyang chaokunyang merged commit 5604cea into mars-project:master Sep 6, 2022
aresnow1 pushed a commit to aresnow1/mars that referenced this pull request Sep 7, 2022
* Dispatcher support multiple serializers to one type

* Remove register_ray_serializers, unregister_ray_serializers

* Add UT

* Fix

* Fix

* Fix lint

* Improve test coverage

* Fix

* Fix

Co-authored-by: 刘宝 <[email protected]>
(cherry picked from commit 5604cea)
qianduoduo0904 pushed a commit to qianduoduo0904/mars that referenced this pull request Sep 22, 2022
* Dispatcher support multiple serializers to one type

* Remove register_ray_serializers, unregister_ray_serializers

* Add UT

* Fix

* Fix

* Fix lint

* Improve test coverage

* Fix

* Fix

Co-authored-by: 刘宝 <[email protected]>
(cherry picked from commit 5604cea)
UranusSeven pushed a commit to xorbitsai/mars that referenced this pull request Sep 22, 2022
* Dispatcher support multiple serializers to one type

* Remove register_ray_serializers, unregister_ray_serializers

* Add UT

* Fix

* Fix

* Fix lint

* Improve test coverage

* Fix

* Fix

Co-authored-by: 刘宝 <[email protected]>
(cherry picked from commit 5604cea)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants