Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Executorch initial support #28425

Open
wants to merge 68 commits into
base: master
Choose a base branch
from

Conversation

cavusmustafa
Copy link
Contributor

@cavusmustafa cavusmustafa commented Jan 14, 2025

Details:

  • OV side changes for initial ExecuTorch OV backend

Tickets:

@github-actions github-actions bot added category: Python API OpenVINO Python bindings category: PyTorch FE OpenVINO PyTorch Frontend labels Jan 14, 2025
@cavusmustafa cavusmustafa marked this pull request as ready for review January 14, 2025 02:54
@cavusmustafa cavusmustafa requested review from a team as code owners January 14, 2025 02:54
Copy link
Member

@rkazants rkazants left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I have several question about this feature:

  1. Will is support ExecuTorch binary compiled to OV ExecuTorch backend?
  2. What other ExecuTorch binaries will be supported: default, xnnpack?
  3. We won't support ExecuTorch binary inference using native OpenVINO workflow, right?
  4. Do you have PR/branch with ExecuTorch OV backend implementation?

Best regards,
Roman

@cavusmustafa
Copy link
Contributor Author

I have several question about this feature:

  1. Will is support ExecuTorch binary compiled to ExecuTorch backend?
  2. What other ExecuTorch binaries will be supported: default, xnnpack?
  3. We won't support ExecuTorch binary inference using native OpenVINO workflow, right?
  4. Do you have PR/branch with ExecuTorch OV backend implementation?

Best regards, Roman

  1. Yes, the changes included in this PR to support ExecuTorch OpenVINO backend.
  2. POC will support OpenVINO backend only but we are also working on enabling fallback to default backend for unsupported ops.
  3. ExecuTorch binary inference will be using OpenVINO workflow similar to inference execution with torch.compile. The partition compiled for OpenVINO execution (which is stored in .pte file) is executed in ExecuTorch OpenVINO backend which uses OpenVINO C++ API.
  4. Branch: https://github.com/ynimmaga/executorch/tree/openvino_backend

Please let me know for additional questions and clarifications needed.

@github-actions github-actions bot removed category: CI OpenVINO public CI github_actions Pull requests that update GitHub Actions code labels Feb 13, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
category: Python API OpenVINO Python bindings category: PyTorch FE OpenVINO PyTorch Frontend Code Freeze
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants