AOTI tutorial CUDA_HOME

[bhack]

📚 The doc issue

I am trying to follow https://pytorch.org/tutorials/recipes/torch_export_aoti_python.html but it seems it doesn't work on our nightly runtime images cause missing CUDA_HOME.

Suggest a potential alternative/fix

No response

cc @svekars @brycebortree @sekyondaMeta @ezyang @chauhang @penguinwu @avikchaudhuri @gmagogsfm @zhxchen17 @tugsbayasgalan @angelayi @suo @ydwu4 @desertfire @chenyang78

[bhack]

/cc @agunapal @angelayi @svekars it is working only with devel image

[agunapal]

Hi @bhack I believe that is correct. Generation of the .so requires a devel image. That was my observation too when I tried it few months ago.

[bhack]

Is this what we want? If yes do we want to document it?

[agunapal]

Will update the tutorial once pytorch/pytorch#140055 and pytorch/pytorch#140053 are resolved. This likely already works in the nightlies

[bhack]

Any update?

[agunapal]

@bhack i will update the tutorial for PT 2.6

[bhack]

@agunapal I am adding g++ in runtime images with pytorch/pytorch#138612 to solve pytorch/pytorch#116696 (torch.compile) but I suppose that it is not enough for you export. What do you think?

[agunapal]

Yes, I will mention in the updated tutorial that you need a devel image to create .pt2 package