Skip to content

Commit

Permalink
Suspend mutations during snapshot (#385)
Browse files Browse the repository at this point in the history
* The `processMutations` function needed to be bound to the `mutationBuffer` object, as otherwise `this` referred to the `MutationObserver` object itself

* Enable external pausing of mutation buffer emissions

 - no automatic pausing based on e.g. pageVisibility yet, assuming such a thing is desirable
   https://developer.mozilla.org/en-US/docs/Web/API/Page_Visibility_API
 - user code has to call new API method `freezePage` e.g. when page is hidden or after a timeout
 - automatically unpauses when the next user initiated event occurs
   (am assuming everything that isn't a mutation event counts as 'user initiated'
   either way think this is the correct thing to do until I see a counterexample
   of an event that shouldn't cause the mutations to be unbufferred)

* Avoid a build up of duplicate `adds` by delaying pushing to adds until emission time

* Need to export freezePage in order to use it from rrweb.min.js

* Add a test to check if mutations can be turned off with the `freezePage` method

* I noticed out of order ids (in terms of a DOM walk) in a FullSnapshot.  A DOM mutation was executed against the mirror asynchronously before it could be fully processed. This would lead to a situation in replay where a mutation is executed against a DOM tree that already has the mutation applied. This changeset fixes that by freezing any mutations until the snapshot is completed.

* Remove attribute modifications from a mutation event that were incorrect in that they were repeating the attributes of those nodes present in the 'adds' array of the same mutation

* I've manually verified that this empty text node is actually removed when the dropdown is opened:

document.getElementById('select2-results-1').childNodes
NodeList(2) [li.select2-results-dept-0.select2-result.select2-result-selectable.select2-highlighted, li.select2-results-dept-0.select2-result.select2-result-selectable]

and also that it is not reinstated after the second `await page.click('.select2-container');`

* Rearrange when removal happens in order to satisfy tests. I'm also reverting a recent test change (2600fe7) so that tests pass after this rearrangement; I believe that test change to still be the correct way of doing it, but maybe it is not strictly important that there are extra mutations on attributes of just added nodes

* As mutations are now paused during FullSnapshots, we shouldn't be counting this as a 'user emission'. We automatically emit mutations after unpause anyway ('emit anything queued up now')

* Ensure that we clear arrays before emitting, as the mutation could have the side effect of triggering a FullSnapshot (checkoutEveryNth), which would otherwise re-trigger emission of same mutation (through the new pause/fullsnapshot/mutationemit/unpause process)

* Don't let the programattic pausing during TakeFullSnapshot accidentally unpause a manual call to the API method `freezePage`

* Rename paused -> frozen for consistency and change to use getter/setter access methods
  • Loading branch information
eoghanmurray authored Oct 4, 2020
1 parent 3e18d20 commit 6655671
Show file tree
Hide file tree
Showing 10 changed files with 278 additions and 19 deletions.
3 changes: 2 additions & 1 deletion src/index.ts
Original file line number Diff line number Diff line change
Expand Up @@ -11,5 +11,6 @@ export {
} from './types';

const { addCustomEvent } = record;
const { freezePage } = record;

export { record, addCustomEvent, Replayer, mirror, utils };
export { record, addCustomEvent, freezePage, Replayer, mirror, utils };
27 changes: 26 additions & 1 deletion src/record/index.ts
Original file line number Diff line number Diff line change
@@ -1,5 +1,5 @@
import { snapshot, MaskInputOptions } from 'rrweb-snapshot';
import initObservers from './observer';
import { initObservers, mutationBuffer } from './observer';
import {
mirror,
on,
Expand Down Expand Up @@ -81,6 +81,20 @@ function record<T = eventWithTime>(
let lastFullSnapshotEvent: eventWithTime;
let incrementalSnapshotCount = 0;
wrappedEmit = (e: eventWithTime, isCheckout?: boolean) => {
if (
mutationBuffer.isFrozen() &&
e.type !== EventType.FullSnapshot &&
!(
e.type == EventType.IncrementalSnapshot &&
e.data.source == IncrementalSource.Mutation
)
) {
// we've got a user initiated event so first we need to apply
// all DOM changes that have been buffering during paused state
mutationBuffer.emit();
mutationBuffer.unfreeze();
}

emit(((packFn ? packFn(e) : e) as unknown) as T, isCheckout);
if (e.type === EventType.FullSnapshot) {
lastFullSnapshotEvent = e;
Expand Down Expand Up @@ -110,6 +124,9 @@ function record<T = eventWithTime>(
}),
isCheckout,
);

let wasFrozen = mutationBuffer.isFrozen();
mutationBuffer.freeze(); // don't allow any mirror modifications during snapshotting
const [node, idNodeMap] = snapshot(
document,
blockClass,
Expand Down Expand Up @@ -147,6 +164,10 @@ function record<T = eventWithTime>(
},
}),
);
if (!wasFrozen) {
mutationBuffer.emit(); // emit anything queued up now
mutationBuffer.unfreeze();
}
}

try {
Expand Down Expand Up @@ -325,4 +346,8 @@ record.addCustomEvent = <T>(tag: string, payload: T) => {
);
};

record.freezePage = () => {
mutationBuffer.freeze();
};

export default record;
46 changes: 35 additions & 11 deletions src/record/mutation.ts
Original file line number Diff line number Diff line change
Expand Up @@ -109,10 +109,12 @@ function isINode(n: Node | INode): n is INode {
* controls behaviour of a MutationObserver
*/
export default class MutationBuffer {
private frozen: boolean = false;

private texts: textCursor[] = [];
private attributes: attributeCursor[] = [];
private removes: removedNodeMutation[] = [];
private adds: addedNodeMutation[] = [];
private mapRemoves: Node[] = [];

private movedMap: Record<string, true> = {};

Expand Down Expand Up @@ -143,7 +145,7 @@ export default class MutationBuffer {
private maskInputOptions: MaskInputOptions;
private recordCanvas: boolean;

constructor(
public init(
cb: mutationCallBack,
blockClass: blockClass,
inlineStylesheet: boolean,
Expand All @@ -157,8 +159,30 @@ export default class MutationBuffer {
this.emissionCallback = cb;
}

public freeze() {
this.frozen = true;
}

public unfreeze() {
this.frozen = false;
}

public isFrozen() {
return this.frozen;
}

public processMutations = (mutations: mutationRecord[]) => {
mutations.forEach(this.processMutation);
if (!this.frozen) {
this.emit();
}
};

public emit = () => {
// delay any modification of the mirror until this function
// so that the mirror for takeFullSnapshot doesn't get mutated while it's event is being processed

const adds: addedNodeMutation[] = [];

/**
* Sometimes child node may be pushed before its newly added
Expand All @@ -182,7 +206,7 @@ export default class MutationBuffer {
if (parentId === -1 || nextId === -1) {
return addList.addNode(n);
}
this.adds.push({
adds.push({
parentId,
nextId,
node: serializeNodeWithId(
Expand All @@ -198,6 +222,10 @@ export default class MutationBuffer {
});
};

while (this.mapRemoves.length) {
mirror.removeNodeFromMap(this.mapRemoves.shift() as INode);
}

for (const n of this.movedSet) {
pushAdd(n);
}
Expand Down Expand Up @@ -253,10 +281,6 @@ export default class MutationBuffer {
pushAdd(node.value);
}

this.emit();
};

public emit = () => {
const payload = {
texts: this.texts
.map((text) => ({
Expand All @@ -273,7 +297,7 @@ export default class MutationBuffer {
// attribute mutation's id was not in the mirror map means the target node has been removed
.filter((attribute) => mirror.has(attribute.id)),
removes: this.removes,
adds: this.adds,
adds: adds,
};
// payload may be empty if the mutations happened in some blocked elements
if (
Expand All @@ -284,17 +308,17 @@ export default class MutationBuffer {
) {
return;
}
this.emissionCallback(payload);

// reset
this.texts = [];
this.attributes = [];
this.removes = [];
this.adds = [];
this.addedSet = new Set<Node>();
this.movedSet = new Set<Node>();
this.droppedSet = new Set<Node>();
this.movedMap = {};

this.emissionCallback(payload);
};

private processMutation = (m: mutationRecord) => {
Expand Down Expand Up @@ -373,7 +397,7 @@ export default class MutationBuffer {
id: nodeId,
});
}
mirror.removeNodeFromMap(n as INode);
this.mapRemoves.push(n);
});
break;
}
Expand Down
10 changes: 7 additions & 3 deletions src/record/observer.ts
Original file line number Diff line number Diff line change
Expand Up @@ -38,6 +38,8 @@ import {
} from '../types';
import MutationBuffer from './mutation';

export const mutationBuffer = new MutationBuffer();

function initMutationObserver(
cb: mutationCallBack,
blockClass: blockClass,
Expand All @@ -46,14 +48,16 @@ function initMutationObserver(
recordCanvas: boolean,
): MutationObserver {
// see mutation.ts for details
const mutationBuffer = new MutationBuffer(
mutationBuffer.init(
cb,
blockClass,
inlineStylesheet,
maskInputOptions,
recordCanvas,
);
const observer = new MutationObserver(mutationBuffer.processMutations);
const observer = new MutationObserver(
mutationBuffer.processMutations.bind(mutationBuffer)
);
observer.observe(document, {
attributes: true,
attributeOldValue: true,
Expand Down Expand Up @@ -560,7 +564,7 @@ function mergeHooks(o: observerParam, hooks: hooksParam) {
};
}

export default function initObservers(
export function initObservers(
o: observerParam,
hooks: hooksParam = {},
): listenerHandler {
Expand Down
Loading

0 comments on commit 6655671

Please sign in to comment.