Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

(generic family): journal support rename command #698

Merged
merged 1 commit into from
Jan 18, 2023

Conversation

adiholden
Copy link
Collaborator

Signed-off-by: adi_holden [email protected]

@adiholden adiholden requested a review from dranikpg January 17, 2023 13:38
dranikpg
dranikpg previously approved these changes Jan 17, 2023
Comment on lines +412 to +427
if (es->journal()) {
OpArgs op_args = t->GetOpArgs(es);
string scratch;
// todo insert under multi exec
RecordJournal(op_args, "SET"sv, ArgSlice{dest_key, dest_it->second.GetSlice(&scratch)}, 2,
true);
if (dest_it->first.IsSticky()) {
RecordJournal(op_args, "STICK"sv, ArgSlice{dest_key}, 2, true);
}
if (dest_it->second.HasExpire()) {
auto time = absl::StrCat(src_res_.expire_ts);
RecordJournal(op_args, "PEXPIREAT"sv, ArgSlice{time}, 2, true);
}
RecordJournalFinish(op_args, 2);
}
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

So you send

  1. DEL with txid=T
  2. MUTLI(implied by opcode) SET EXPIREAT STICK EXEC with txid=T

In theory, do not DEL and SET have to be in one transaction (i.e. inside one multi)? But we cannot do such atomic operations on replica currently, right?

I'd also suggest assembling the latter command as one, because each RecordJournal puts pressure on the writing and receving side... But there is currently no option, because there is no stick parameter for set, right? Maybe we should add one in the future?

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The DEL and SET are in one transaction because we shard_count=2 and the same txid. This is the same as multi shard commands which are not inside multi command transaction. Currently the replica just does not executes the transaction if data from all shard is not received i.e it will not execute the SET if the DEL was not received.
I use the multi just in the SET flow because we want to execute EXPIREAT and STICK in the same transaction, this also does not guarantees atomicity because currently we do the execution of the commands one by one.

We could do optimization for the SET flow for one command which will include the expire info and the stick info, but I am not sure its needed. Rename is probably not common command, and if this is the only flow we have this multi commands this is probably not worth it. Lets implement all the rename flows and see if this is needed

@dranikpg
Copy link
Contributor

I refactored the transaction a little

@adiholden adiholden merged commit f175127 into main Jan 18, 2023
@romange romange deleted the journal_rename_command branch February 18, 2023 16:07
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants