Skip to content

Pull requests: pytorch/torchtitan

New pull request New
30 Open 430 Closed
30 Open 430 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

[doc] Update README with reference to Flight Recorder CLA Signed This label is managed by the Meta Open Source bot.
#599 opened Oct 4, 2024 by c-p-i-o Loading…
@c-p-i-o
1
ensure reproducible determinsitc numerics CLA Signed This label is managed by the Meta Open Source bot.
#597 opened Oct 2, 2024 by weifengpy Loading…
1
8
Retrieve schedules from get_schedule_class() CLA Signed This label is managed by the Meta Open Source bot.
#595 opened Oct 1, 2024 by H-Huang Loading…
1
enable Context Parallel CLA Signed This label is managed by the Meta Open Source bot.
#592 opened Sep 30, 2024 by XilunWu • Draft
3
fix mixed precision for replicate / pure DDP CLA Signed This label is managed by the Meta Open Source bot.
#591 opened Sep 29, 2024 by 152334H Loading…
16
Add a ViT Encoder to TorchTitan CLA Signed This label is managed by the Meta Open Source bot.
#589 opened Sep 27, 2024 by fduwjj • Draft
21
[not for land yet] hack max and abs out of ops eligible for AC CLA Signed This label is managed by the Meta Open Source bot.
#580 opened Sep 17, 2024 by vkuzo Loading…
add pp validation for schedule CLA Signed This label is managed by the Meta Open Source bot.
#568 opened Sep 5, 2024 by H-Huang Loading…
3
3d with fp8 in test runner CLA Signed This label is managed by the Meta Open Source bot.
#564 opened Aug 29, 2024 by H-Huang • Draft
Moved logits .float() to loss and compiled it if compiling CLA Signed This label is managed by the Meta Open Source bot.
#551 opened Aug 21, 2024 by awgu Loading…
3
[WIP] zero bubble CLA Signed This label is managed by the Meta Open Source bot.
#546 opened Aug 20, 2024 by H-Huang • Draft
[DO NOT REVIEW] Runtime estimation with FakeTensor + TorchDispatchMode CLA Signed This label is managed by the Meta Open Source bot.
#536 opened Aug 20, 2024 by weifengpy Loading…
[Not for land] Added changes for GPT-2 perf CLA Signed This label is managed by the Meta Open Source bot.
#533 opened Aug 19, 2024 by awgu • Draft
5
[Not for land] Added GPT-2-like config CLA Signed This label is managed by the Meta Open Source bot.
#532 opened Aug 19, 2024 by awgu • Draft
[Not for land] GaLore example CLA Signed This label is managed by the Meta Open Source bot.
#488 opened Jul 29, 2024 by awgu • Draft
[torchtitan][debug] integrated CommDebugMode into TorchTitan CLA Signed This label is managed by the Meta Open Source bot.
#480 opened Jul 24, 2024 by sinhaanshul Loading…
8
[not for land] TE experiments CLA Signed This label is managed by the Meta Open Source bot.
#477 opened Jul 23, 2024 by vkuzo Loading…
[Do not review] Activation offloading CLA Signed This label is managed by the Meta Open Source bot.
#467 opened Jul 18, 2024 by awgu • Draft
3
[POC] Adam-mini without explicit collectives CLA Signed This label is managed by the Meta Open Source bot.
#459 opened Jul 15, 2024 by awgu • Draft
1
Updates to support new sdpa function CLA Signed This label is managed by the Meta Open Source bot.
#458 opened Jul 13, 2024 by jainapurva • Draft
2
Fix parsing of pp split points from toml file CLA Signed This label is managed by the Meta Open Source bot.
#450 opened Jul 10, 2024 by wconstab Loading…
[DO NOT MERGE][example] fold batch and sequence dimensions to accelerate Sequence Parallel CLA Signed This label is managed by the Meta Open Source bot.
#437 opened Jul 4, 2024 by tianyu-l Loading…
5
Add load from HF ckpts to FSDP model fails. CLA Signed This label is managed by the Meta Open Source bot.
#427 opened Jun 25, 2024 by MinghaoYan • Draft
updates here CLA Signed This label is managed by the Meta Open Source bot.
#417 opened Jun 24, 2024 by H-Huang • Draft
1
WIP change to run a zero-bubble like schedule CLA Signed This label is managed by the Meta Open Source bot.
#416 opened Jun 21, 2024 by wconstab Loading…
ProTip! Filter pull requests by the default branch with base:main.