What kind of runtime backend this Plugin use?

[dayowoo]

Description

Hi, first Thank you for creating Mediapipe Plugin.

I want to know which runtime backend this Plugin use..

https://storage.googleapis.com/tfjs-models/demos/pose-detection/index.html?model=blazepose
There is 3type of runtime backend model (mediapipe-gpu, tfjs-webgl, tfjs-webgpu)

Thank you.

[homuler]

There is 3type of runtime backend model (mediapipe-gpu, tfjs-webgl, tfjs-webgpu)

1. This project doesn't run on the web. Therefore, the 3 options for the runtime-backend are not relevant to this project.
2. I believe the choice of runtime is determined by CalculatorGraphConfig rather than this plugin.

Could you please let me know the intention behind this question?

[dayowoo]

I'd like to increase fps speed, reduce mediapipe latency.
so I got the fastest fps speed when I use mediapipe-gpu runtime backend model in that site.
I still dont know how.....

Anyway I'm just curious, thanks for answering

[homuler]

I still dont know how.....

Sorry, what would you like to know?

[dayowoo]

Sorry for the late reply.
The purpose of my question is to reduce the mediapipe latency.

I am conducting a test by device.

The mediapipe latency is over 50 on the desktop and 30 on the iOS, but about 10 on the Galaxy series. (The application fps are all equal to 30.)

The difference is that graphic api is different from opengles and metal.
So, I modified my Holistic_opengles (OpenGlesConfig file in Holistic Tracking graph), but it doesnt make to improve latency.

I believe the choice of runtime is determined by CalculatorGraphConfig rather than this plugin.

and.. Is this the correct code for the CalculatorGraphConfig you mentioned?
Packages/com.github.homuler.mediapipe/Runtime/Scripts/Framework/CalculatorGraph.cs

Thank you.

[homuler]

Generally, the unit of latency is understood to be milliseconds (ms), but are you referring to FPS here? (would you like to improve the performance on the Android devices?)

If so, can you check if it is the same issue as #768 (comment) ?

Is this the correct code for the CalculatorGraphConfig you mentioned?

See https://developers.google.com/mediapipe/framework/framework_concepts/graphs