Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Write-space optimization for pregelix messages and genomix-data structures. #10

Closed
jakebiesinger opened this issue Oct 19, 2013 · 2 comments

Comments

@jakebiesinger
Copy link
Contributor

@anbangx

The messages we send are pretty big and sometimes they are larger than they need to be. For example, KILL_SELF messages don't need to carry an entire node with them, nor a srcVertexId. Same goes for our Node class-- we often write len=0 for edges that don't exist.

One solution is to use either boolean values or a flag representing what data values are present in the stream. We write the header to the stream. When we read, we only call the readFields functions on the values that are actually present.

@anbangx
Copy link
Collaborator

anbangx commented Oct 21, 2013

@jakebiesinger

I see what you mean. I did that before. I will do it after the test cases pass travis checking.

This was referenced Oct 31, 2013
@jakebiesinger
Copy link
Contributor Author

Fixed.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants