-
-
Notifications
You must be signed in to change notification settings - Fork 1.5k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Add WebGL support #756
Add WebGL support #756
Conversation
rrweb-snapshot uses 3030, rrweb uses 3031
Idea: We might want to introduce a maximum framerate here for recording of webgl. |
if that decoupling was in place, we'd also likely want to respect the rrweb/packages/rrweb/src/record/index.ts Lines 477 to 479 in 5dcbfa5
|
WebGL is a bit of a black box so unfortunately its hard to tell which of the 200+ webgl2 invoked commands are necessary for playback of future frames. This makes it very hard to tell which commands we can leave out without breaking the (future) playback. There also isn't really a full snapshot like capability with webgl, whereby we could snapshot a point in time and animate with webgl commands from a full-snapshot. |
Allows you to do `record.freezePage()` and canvas events will get paused. Based on #756 (comment)
I've added a |
* Add very basic webgl support * document the default * only capture rr_dataURL in 2d canvas contexts * rr_dataURL no longer part of webgl snapshot * ignore __diff_output__ from jest-image-snapshot * Rename generic "Monorepo" to "RRWeb Monorepo" * Serialize WebGL variables * Move rrweb test port number to unique port rrweb-snapshot uses 3030, rrweb uses 3031 * Prepare for WebGL2 * Split up canvas replay and record webgl vars * fix typo * fix typo part 2 * fix typo * Handle non-variables too * provide correct context for warning * (De)Serialize a lot of different objects * monorepo root should be the first in the list * Upgrade puppeteer to 11.x * Correctly de-serialize webgl variables * Encode arrayBuffers contents to base64 * rename contents to base64 * add webgl2 support and serialize HTMLImageElements * Support serializing ImageData * Correctly classify WebGL2 events * Serialize format changed * check if canvas has contents before we save the dataURL * Remove blank dataURL * reference original file not type defintion file * update types * rename code worspace * update dependencies * add spector to inspect webgl * remove live server settings from code workspace * Save canvas context in the node Prevents from saving webgl canvases as 2d dataUrls * remove extra braces * add ICanvas type * use ICanvas from rrweb-snapshot in rrweb instead of OgmentedCanvas * add snapshots and webgl 2 tests * Upgrade to puppeteer 12.0.1 * Revert back to puppeteer 9.1.1 * Keep index order consistent between replay and record * keep correct index order in webgl2 * fixed forgotten import * buffer up pending canvas mutations * unify the way webgl and webgl2 get patched * fix parsing error * Add types for serialize-args * Add debugging for webgl replay * Move start-server to utils * turn off debug mode by default * Move pendingCanvasMutations to local object and fix if/else statement * Always save pending mutations * only use assert snapshot as it's clearer whats going on * Ugly fix for now * Making the tests more DRY * flush at the end of each request animation frame * Looks like the promise made this test more predictable * add waitForRAF * Make nested iframe recording robust no matter the test speed * mute noisy error in test * force a requestAnimationFrame * Bundle events within one frame together as much as possible WebGL events need to be bundled together as much as possible so they don't accidentally get split over multiple animation frames. `newFrame: true` is used to indicate the start of an new animation frame in the recording, and that the event shouldn't be bundled with the previous events. * Rename RafStamps * Override event.delay * cleanup * Add tests for addDelay * Add webgl e2e test * Remove settimeout * DRY-up test * Preload images in webgl * Add e2e test for webgl image preloading * don't turn on devtools by default! * Remove spector * close server after use * Add imageMap parameter * Make e2e image test more robust * document debug mode * cleanup * WebGL recording in iframes & Safari 14 support * fix tests * don't save null objects as WebGLVar * group (de)serialized webgl variables by context * Fix test * fix tests * bundle webgl mutations on request animation frame Instead of fixing it on the replay side we buffer up webgl canvas mutations and wait for a new RAF to flush them. This allows us to remove `newFrame` from the events and simplify things a little * Add canvas element to mutation observer file * Add Canvas (Mutation) Manager Allows you to do `record.freezePage()` and canvas events will get paused. Based on #756 (comment) * cleanup * Make sure the correct </body> gets replaced * Perf: Speed up check to see if canvas is blank * Access unpatched getImageData * Use is2DCanvasBlank only for 2d context * Only record canvas when recordCanvas is true
您好,我有个需求是记录地图变化,地图是mapbox_gl的,是否因为这个webgl渲染的原因导致无法记录 |
This PR adds support for
webgl
recording and replaying and adds tests to ensure its stability.This PR covers the following:
webgl
andwebgl2
).newFrame: true
) slows this down.record.freezePage()
Not implemented yet, out of scope from this PR:
pixels
argument (HTMLCanvasElement, HTMLVideoElement)OffscreenCanvas
andgetContext('bitmaprenderer')
Fix timing of webgl operations when importing events viaaddEvent
(addDelay()
needs to receive alastEvent
parameter)