Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add a build validation for Linux ARM64 cross-compile #18200

Merged
merged 31 commits into from
Nov 8, 2023
Merged

Add a build validation for Linux ARM64 cross-compile #18200

merged 31 commits into from
Nov 8, 2023

Conversation

snnn
Copy link
Member

@snnn snnn commented Oct 31, 2023

Description

  1. Add a build validation for Linux ARM64/ARM32 cross-compile to catch issues listed in [Build] Linux arm build error CompressedStorage.h:93:80: error: overflow #18195 .
  2. Revert eigen's commit id back to what we had before.

Motivation and Context

To catch cross-compile issues.
Related: AB#21639

@snnn snnn requested a review from a team as a code owner October 31, 2023 20:15
@snnn snnn marked this pull request as draft October 31, 2023 23:32
@snnn snnn linked an issue Oct 31, 2023 that may be closed by this pull request
@snnn snnn marked this pull request as ready for review November 1, 2023 02:29
@snnn
Copy link
Member Author

snnn commented Nov 3, 2023

/azp run Windows GPU CI Pipeline

Copy link

Azure Pipelines successfully started running 1 pipeline(s).

@snnn snnn requested a review from a team as a code owner November 3, 2023 17:58
@devigned
Copy link
Member

devigned commented Nov 7, 2023

Can confirm running this on darwin/arm64 results in a successful build and test pass.

100% tests passed, 0 tests failed out of 3

Total Test time (real) = 163.13 sec
2023-11-07 10:50:03,836 build [INFO] - Build complete

related #18322

@skottmckay
Copy link
Contributor

skottmckay commented Nov 8, 2023

I don't think the patch file for eigen is needed any more. It supposedly fixed an unused arg error but the eigen source seems to have that change included, it was only applied to ACL builds, and the args were incorrect for use with patch (has a git apply arg but that can't be used with the fetchcontent approach. See #15248.

Can be done as a separate PR if it helps get this checked in faster.

@snnn snnn merged commit 8125325 into main Nov 8, 2023
@snnn snnn deleted the snnn/arm_gcc branch November 8, 2023 21:03
snnn pushed a commit that referenced this pull request Nov 9, 2023
…d tests (#18346)

### Description
This PR gets the onnxruntime Rust bindings to a foundation where they
can be extended and validated as the onnxruntime progresses.
Specifically, the PR does the following.
- fixes some of the existing compilation issues due to missing some
enums output tensor data types.
- introduces a `just vendor` task that will vendor the source code from
the onnxruntime to enable a common base directory within the crate
directory rather than using a relative parent path. This enables `crate
package` to be able to archive the onnxruntime native code, which will
enable consumers of the onnxruntime-sys crate to be able to compile on
their target.
- introduces a GH action to lint the Rust code (rustfmt, clippy), build
the library, validate through tests, and validate crate can package
correctly.


TODOs:
- [x] This PR is based on #18200 and will need to be rebased once that
PR is merged.



### Motivation and Context
<!-- - Why is this change required? What problem does it solve?
- If it fixes an open issue, please link to the issue here. -->

This is the first step to getting new onnxruntime Rust crates published
through this project, which will unblock community Rust projects which
would like to take a dependency on onnxruntime Rust.

Follow up work to enable publication of onnxruntime Rust crates:
- change name of the crates to be published (onnxruntime-rs and
onnxruntime-sys are already taken and we'll need new names)
- update authors / license to reflect contributions from previous
maintainer(s) and new maintainers
- introduce a crate publish GH action or ADO pipeline

---------

Signed-off-by: David Justice <[email protected]>
kleiti pushed a commit to kleiti/onnxruntime that referenced this pull request Mar 22, 2024
### Description
1. Add a build validation for Linux ARM64/ARM32 cross-compile to catch
issues listed in microsoft#18195 .
2. Revert eigen's commit id back to what we had before. 


### Motivation and Context
To catch cross-compile issues.
Added a TODO item for fixing the compile warnings in Linux ARM32 build: AB#21639
kleiti pushed a commit to kleiti/onnxruntime that referenced this pull request Mar 22, 2024
…d tests (microsoft#18346)

### Description
This PR gets the onnxruntime Rust bindings to a foundation where they
can be extended and validated as the onnxruntime progresses.
Specifically, the PR does the following.
- fixes some of the existing compilation issues due to missing some
enums output tensor data types.
- introduces a `just vendor` task that will vendor the source code from
the onnxruntime to enable a common base directory within the crate
directory rather than using a relative parent path. This enables `crate
package` to be able to archive the onnxruntime native code, which will
enable consumers of the onnxruntime-sys crate to be able to compile on
their target.
- introduces a GH action to lint the Rust code (rustfmt, clippy), build
the library, validate through tests, and validate crate can package
correctly.


TODOs:
- [x] This PR is based on microsoft#18200 and will need to be rebased once that
PR is merged.



### Motivation and Context
<!-- - Why is this change required? What problem does it solve?
- If it fixes an open issue, please link to the issue here. -->

This is the first step to getting new onnxruntime Rust crates published
through this project, which will unblock community Rust projects which
would like to take a dependency on onnxruntime Rust.

Follow up work to enable publication of onnxruntime Rust crates:
- change name of the crates to be published (onnxruntime-rs and
onnxruntime-sys are already taken and we'll need new names)
- update authors / license to reflect contributions from previous
maintainer(s) and new maintainers
- introduce a crate publish GH action or ADO pipeline

---------

Signed-off-by: David Justice <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants