InternEvo-v0.5.2dev20240525

What's Changed

• fix(moe): fix interface for megablock by @blankde in #233
• feat(npu): support npu fused adamw by @SolenoidWGT in #188
• feat(npu): support npu fusion rotary mul by @SolenoidWGT in #187
• Feat(RMSNorm NPU): Add RMSNormNPU and CI by @li126com in #203
• fix(QA): add real tgs to train_CI by @li126com in #227
• Fix(mha,linear): fix norm_head and mha inference by @KimmiShi in #234

New Contributors

• @KimmiShi made their first contribution in #234

Full Changelog: v0.5.1dev20240517...v0.5.2dev20240525