Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[BUG]: ransomware_detection pipeline running slowly on AArch64 #2124

Closed
2 tasks done
dagardner-nv opened this issue Jan 22, 2025 · 1 comment
Closed
2 tasks done

[BUG]: ransomware_detection pipeline running slowly on AArch64 #2124

dagardner-nv opened this issue Jan 22, 2025 · 1 comment
Labels
bug Something isn't working

Comments

@dagardner-nv
Copy link
Contributor

Version

25.02

Which installation method(s) does this occur on?

Source

Describe the bug.

This pipeline typically executes in about 2 minutes (1m50.896s on my system), however on an Arm64 system this takes about 13 minutes.

Similar to #2120, and potentially the same issue.

Minimum reproducible example

Run the `ransomware_detection` pipeline as documented

Relevant log output

Click here to see error details
[Paste the error here, it will be hidden by default]

Full env printout

Click here to see environment details
[Paste the results of print_env.sh here, it will be hidden by default]

Other/Misc.

No response

Code of Conduct

  • I agree to follow Morpheus' Code of Conduct
  • I have searched the open bugs and have found no duplicates for this bug report
@dagardner-nv dagardner-nv added the bug Something isn't working label Jan 22, 2025
@dagardner-nv dagardner-nv mentioned this issue Jan 22, 2025
Closed
2 tasks
@dagardner-nv dagardner-nv changed the title [BUG]: ransomware_detection pipeline running slowly on AArch64 [BUG]: ransomware_detection pipeline running slowly on AArch64 Jan 23, 2025
@dagardner-nv
Copy link
Contributor Author

In testing we found that the performance problems observed happened under Ubuntu 22.04, but did not exist on Ubuntu 24.04.

@dagardner-nv dagardner-nv mentioned this issue Jan 31, 2025
Merged
rapids-bot bot pushed a commit that referenced this issue Jan 31, 2025
@dagardner-nv
Document known Arm64 issues and work-around PyTorch installation issu…
e43ee8a 
…es for DFP (#2162)

* Document Arm64 performance issues on older Linux Kernels
* Manually install PyTorch in the DFP container allowing Arm64 users to run the pipeline work-around issue #2095 (fix slated for PyTorch 2.6 / Morpheus 25.06).

Closes #2120
Closes #2124

## By Submitting this PR I confirm:
- I am familiar with the [Contributing Guidelines](https://github.com/nv-morpheus/Morpheus/blob/main/docs/source/developer_guide/contributing.md).
- When the PR is ready for review, new or existing tests cover these changes.
- When the PR is ready for review, the documentation is up to date with these changes.

Authors:
  - David Gardner (https://github.com/dagardner-nv)

Approvers:
  - Eli Fajardo (https://github.com/efajardo-nv)
  - Michael Demoret (https://github.com/mdemoret-nv)

URL: #2162
@github-project-automation github-project-automation bot moved this from Todo to Done in Morpheus Boards Jan 31, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
bug Something isn't working
Projects
Morpheus Boards
Status: Done
Milestone
No milestone
Development

No branches or pull requests
1 participant
@dagardner-nv