Moonshot AI Open-Sources FlashKDA: CUTLASS Kernels for Kimi Delta Attention with Variable-Length Batching and H20 Benchmarks
The team behind Kimi.ai (Moonshot AI) recently made a significant contribution to the open AI infrastructure space. The research team has made significant contributions to the open AI infrastructure space. They let go FlashKDA (Flash Me Delta Attention), high performance CUTLASS based kernel Kimi Delta Attention (KDA) way. I FlashKDA the library is available on … Read more