Skip to content

FA2 Fully Shared QKV SMEM🎉
Compare
Choose a tag to compare
@DefTruth DefTruth released this 19 Dec 08:10
· 19 commits to main since this release
v2.6.9
4687e1d
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Learn about vigilant mode.

What's Changed

  • [FA2] Update flash-attn-mma shared-kv/qkv🎉 by @DefTruth in #163
  • [FA2] Update flash-attn-mma shared-kv/qkv🎉 by @DefTruth in #164
  • [FA2] Update flash-attn-mma shared-qkv🎉 by @DefTruth in #165
  • [FA2] Update flash-attn-mma shared-kv🎉 by @DefTruth in #166
  • [FA2] Update flash-attn-mma split-kv/q🎉 by @DefTruth in #167
  • [FA2] Update flash-attn-mma shared-qkv🎉 by @DefTruth in #168
  • [FA2] flash-attn-mma get rid of transpose-k✔️ by @DefTruth in #169

Full Changelog: v2.6.8...v2.6.9

Contributors

DefTruth
Assets 2
Loading