Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Sharing of meta data among CM scripts #46

Open
anandhu-eng opened this issue Dec 12, 2024 · 0 comments
Open

Sharing of meta data among CM scripts #46

anandhu-eng opened this issue Dec 12, 2024 · 0 comments
Labels
enhancement New feature or request

Comments

@anandhu-eng
Copy link
Contributor


Migrated from mlcommons/mlperf-automations_archived#40
Originally created by @arjunsuresh on Mon, 26 Dec 2022 12:33:25 GMT


We can have data preprocessing scripts needing information about the model for which the dataset is going to be used but the model as such is not needed. It would be good to have a way to share the model meta between the model download script and the dataset preprocessing script which can avoid duplicating the meta information in _cm.json.

Can we add a dependency with no-deps and fake-run options so that only the script meta gets processed?

@anandhu-eng anandhu-eng added the enhancement New feature or request label Dec 12, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant