Skip to content

Issues: mlcommons/mlperf-automations

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

48 Open 19 Closed
48 Open 19 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Use mlc logger in scripts instead of print statements enhancement New feature or request good first issue Good for newcomers
#165 opened Jan 28, 2025 by arjunsuresh
Missing git config is causing the below failure on MLC docker runs bug Something isn't working
#149 opened Jan 25, 2025 by arjunsuresh
Support Automotive 3d Object Detection Benchmark Automation mlperf-work
#142 opened Jan 24, 2025 by arjunsuresh
10 tasks
@anandhu-eng
Support Reference models for MLPerf Inference v5.0 mlperf-work
#141 opened Jan 24, 2025 by arjunsuresh
2 of 3 tasks
MLPerf Submission Automation Tasks mlperf-work
#140 opened Jan 24, 2025 by arjunsuresh
4 of 20 tasks
Better naming for github action runs enhancement New feature or request good first issue Good for newcomers
#134 opened Jan 23, 2025 by arjunsuresh
Add support for calibration dataset - igbh mlperf-work
#72 opened Dec 23, 2024 by anandhu-eng
@anandhu-eng
1
Configure self hosted github runners to run on MLCommons server (8xH100) github-actions testing
#67 opened Dec 22, 2024 by arjunsuresh
Update all MLPerf inference benchmark READMEs to include MLC commands for downloading model and datasets documentation Improvements or additions to documentation enhancement New feature or request mlperf-work
#62 opened Dec 21, 2024 by arjunsuresh
11 tasks
Script features to be added to MLC testing
#48 opened Dec 12, 2024 by anandhu-eng
5 tasks
@arjunsuresh
Sharing of meta data among CM scripts enhancement New feature or request
#46 opened Dec 12, 2024 by anandhu-eng
Adding validation check for meta files enhancement New feature or request
#45 opened Dec 12, 2024 by anandhu-eng
3
Running mlperf inference benchmarks on systems without internet connectivity
#44 opened Dec 12, 2024 by anandhu-eng
2
Adding support for multi-level organization enhancement New feature or request
#43 opened Dec 12, 2024 by anandhu-eng
New CM scripts needed as part of the reproducibility challenge for MLPerf inference 3.1 enhancement New feature or request help wanted Extra attention is needed
#42 opened Dec 12, 2024 by anandhu-eng
1 of 6 tasks
Keep track of CM script failures
#41 opened Dec 12, 2024 by anandhu-eng
Adding a universal file upload script
#40 opened Dec 12, 2024 by anandhu-eng
Default version is not working as expected bug Something isn't working
#39 opened Dec 12, 2024 by anandhu-eng
Support base variation inside combination of variations
#38 opened Dec 12, 2024 by anandhu-eng
@arjunsuresh
Support multiple python virtual environment in a CM workflow
#37 opened Dec 12, 2024 by anandhu-eng
Adding Implementation name to the MLPerf inference framework field
#36 opened Dec 12, 2024 by anandhu-eng
Packages requiring SUDO are installed in user cache path enhancement New feature or request
#35 opened Dec 12, 2024 by anandhu-eng
@arjunsuresh
1
Identify if git user configs are saved enhancement New feature or request
#34 opened Dec 12, 2024 by anandhu-eng
@arjunsuresh
Pending tasks for Inference v4.1
#32 opened Dec 12, 2024 by anandhu-eng
11 of 15 tasks
@arjunsuresh @anandhu-eng
Create CM scripts to measure GPU/CPU/system information during an MLPerf run - similar to how power is measured enhancement New feature or request
#31 opened Dec 12, 2024 by anandhu-eng
ProTip! Exclude everything labeled bug with -label:bug.