Skip to content

Issues: mlcommons/mlperf-automations

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

48 Open 3 Closed
48 Open 3 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Add support for calibration dataset - igbh
#72 opened Dec 23, 2024 by anandhu-eng
Configure self hosted github runners to run on MLCommons server (8xH100) github-actions testing
#67 opened Dec 22, 2024 by arjunsuresh
Update all MLPerf inference benchmark READMEs to include CM commands for downloading model and datasets documentation Improvements or additions to documentation enhancement New feature or request
#62 opened Dec 21, 2024 by arjunsuresh
11 tasks
Script features to be added to CM testing
#48 opened Dec 12, 2024 by anandhu-eng
3 tasks
@arjunsuresh
Option to provide custom cache repository for a given script install
#47 opened Dec 12, 2024 by anandhu-eng
1
Sharing of meta data among CM scripts enhancement New feature or request
#46 opened Dec 12, 2024 by anandhu-eng
Adding validation check for meta files enhancement New feature or request
#45 opened Dec 12, 2024 by anandhu-eng
3
Running mlperf inference benchmarks on systems without internet connectivity
#44 opened Dec 12, 2024 by anandhu-eng
2
Adding support for multi-level organization enhancement New feature or request
#43 opened Dec 12, 2024 by anandhu-eng
New CM scripts needed as part of the reproducibility challenge for MLPerf inference 3.1 enhancement New feature or request help wanted Extra attention is needed
#42 opened Dec 12, 2024 by anandhu-eng
1 of 6 tasks
Keep track of CM script failures
#41 opened Dec 12, 2024 by anandhu-eng
Adding a universal file upload script
#40 opened Dec 12, 2024 by anandhu-eng
Default version is not working as expected bug Something isn't working
#39 opened Dec 12, 2024 by anandhu-eng
Support base variation inside combination of variations
#38 opened Dec 12, 2024 by anandhu-eng
@arjunsuresh
Support multiple python virtual environment in a CM workflow
#37 opened Dec 12, 2024 by anandhu-eng
Adding Implementation name to the MLPerf inference framework field
#36 opened Dec 12, 2024 by anandhu-eng
Packages requiring SUDO are installed in user cache path enhancement New feature or request
#35 opened Dec 12, 2024 by anandhu-eng
@arjunsuresh
1
Identify if git user configs are saved enhancement New feature or request
#34 opened Dec 12, 2024 by anandhu-eng
@arjunsuresh
Support podman in CM enhancement New feature or request
#33 opened Dec 12, 2024 by anandhu-eng
@arjunsuresh
1
Pending tasks for Inference v4.1
#32 opened Dec 12, 2024 by anandhu-eng
11 of 15 tasks
@arjunsuresh @anandhu-eng
Create CM scripts to measure GPU/CPU/system information during an MLPerf run - similar to how power is measured enhancement New feature or request
#31 opened Dec 12, 2024 by anandhu-eng
Update the MLPerf inference Intel scripts to work with v4.0 code (currently most of the benchmarks use v3.1 code) for all the benchmarks enhancement New feature or request
#30 opened Dec 12, 2024 by anandhu-eng
Fix the automatically generated script READMEs - currently some of the category links are broken due to capitalization bug Something isn't working documentation Improvements or additions to documentation
#29 opened Dec 12, 2024 by anandhu-eng
@arjunsuresh
Add Nvidia 4.1 inference code support enhancement New feature or request
#28 opened Dec 12, 2024 by anandhu-eng
3
Add Intel 4.1 inference code support enhancement New feature or request
#27 opened Dec 12, 2024 by anandhu-eng
ProTip! Mix and match filters to narrow down what you’re looking for.