Face tracking on Scratch 3 with Webcam only.
It uses facemesh package provided by MediaPipe and TensorFlow.js. If you want to know about the technology behind, please refer to "Face and hand tracking in the browser with MediaPipe and TensorFlow.js"
Read this in other languages: English, 日本語.
- Open https://stretch3.github.io/ (other custom extensions are available) or https://champierre.github.io/facemesh2scratch/ on Chrome.
- Open Facemesh2Scratch extension.
https://github.com/champierre/facemesh2scratch/raw/master/sample_projects/facemesh.sb3
Facemesh2Scratch is under AGPL-3.0 license, open source and freely available to anyone. You can use it at your classes, workshops. Commercial usage is also accepted. If you or your students created something cool using Facemesh2Scratch, please share it on SNS using hashtag #facemesh2scratch or let me know to any of these contacts. Interesting projects will be added to the "Examples of use".
- OS
- Windows 8 (TBD)
- Windows 10 (TBD)
- MacOS
- iOS
- Browser
- Chrome
- Safari(iOS)
Facemesh2Scratch sometimes does not work because of some Chrome extensions. Please switch to Guest Mode in such cases.
-
Q. acemesh2Scratch extension doesn't work properly.
-
A. Open the Developer Tools on Chrome and check the Console tab. If you see the error "Error: WebGL is not supported on this device", try to enable Hardware Acceleration by turning on "Use hardware acceleration when available available" in Settings and restarting Chrome.
Ref. How to Turn Hardware Acceleration On and Off in Chrome
- Setup LLK/scratch-gui on your computer.
% git clone [email protected]:LLK/scratch-gui.git
% cd scratch-gui
% npm install
- In scratch-gui folder, clone Facemesh2Scratch. You will have facemesh2scratch folder under scratch-gui.
% git clone [email protected]:champierre/facemesh2scratch.git
- Run the install script.
% sh facemesh2scratch/install.sh
- Run Scratch, then go to http://localhost:8601/.
% npm start