-
Notifications
You must be signed in to change notification settings - Fork 998
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
(generic family): journal support rename command #698
Conversation
if (es->journal()) { | ||
OpArgs op_args = t->GetOpArgs(es); | ||
string scratch; | ||
// todo insert under multi exec | ||
RecordJournal(op_args, "SET"sv, ArgSlice{dest_key, dest_it->second.GetSlice(&scratch)}, 2, | ||
true); | ||
if (dest_it->first.IsSticky()) { | ||
RecordJournal(op_args, "STICK"sv, ArgSlice{dest_key}, 2, true); | ||
} | ||
if (dest_it->second.HasExpire()) { | ||
auto time = absl::StrCat(src_res_.expire_ts); | ||
RecordJournal(op_args, "PEXPIREAT"sv, ArgSlice{time}, 2, true); | ||
} | ||
RecordJournalFinish(op_args, 2); | ||
} |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
So you send
- DEL with txid=T
- MUTLI(implied by opcode) SET EXPIREAT STICK EXEC with txid=T
In theory, do not DEL and SET have to be in one transaction (i.e. inside one multi)? But we cannot do such atomic operations on replica currently, right?
I'd also suggest assembling the latter command as one, because each RecordJournal puts pressure on the writing and receving side... But there is currently no option, because there is no stick parameter for set, right? Maybe we should add one in the future?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
The DEL and SET are in one transaction because we shard_count=2 and the same txid. This is the same as multi shard commands which are not inside multi command transaction. Currently the replica just does not executes the transaction if data from all shard is not received i.e it will not execute the SET if the DEL was not received.
I use the multi just in the SET flow because we want to execute EXPIREAT and STICK in the same transaction, this also does not guarantees atomicity because currently we do the execution of the commands one by one.
We could do optimization for the SET flow for one command which will include the expire info and the stick info, but I am not sure its needed. Rename is probably not common command, and if this is the only flow we have this multi commands this is probably not worth it. Lets implement all the rename flows and see if this is needed
I refactored the transaction a little |
Signed-off-by: adi_holden <[email protected]>
f9af60b
to
3b69da2
Compare
Signed-off-by: adi_holden [email protected]