New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[DO NOT REVIEW] Runtime estimation with FakeTensor + TorchDispatchMode #536

Open

weifengpy wants to merge 2 commits into pytorch:main from weifengpy:autofsdp

Contributor

weifengpy commented Aug 20, 2024

Runtime estimation with FakeTensor + TorchDispatchMode

estimate runtime: ./run_runtime_estimation.sh --runtime_estimation.estimate_mode_type operator-level-cost-model
actual runtime: ./run_runtime_estimation.sh --runtime_estimation.estimate_mode_type operator-level-benchmark

Most code are copy-pasted from https://github.com/sanketpurandare/scyther credit to @sanketpurandare @xuanzhang816

Screenshot 2024-08-19 at 10 04 56 PM


          runtime benchmark

e24ebed

Summary:

Test Plan:

Reviewers:

Subscribers:

Tasks:

Tags:

facebook-github-bot added the CLA Signed label


          support mode="actual" and profiler trace

e7795ef

Summary:

Test Plan:

Reviewers:

Subscribers:

Tasks:

Tags:

weifengpy mentioned this pull request

Runtime Estimator for estimating GPU compute time pytorch/pytorch#134243

Closed

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels