Moonshot AI Open-Sources FlashKDA: CUTLASS Kernels for Kimi Delta Attention with Variable-Length Batching and H20 Benchmarks

Moonshot AI Open-Sources FlashKDA: CUTLASS Kernels for Kimi Delta Attention with Variable-Length Batching and H20 Benchmarks

The team behind Kimi.ai (Moonshot AI) recently made a significant contribution to the open AI infrastructure space. The research team has made significant contributions to the open AI infrastructure space. They let go FlashKDA (Flash Me Delta Attention), high performance CUTLASS based kernel Kimi Delta Attention (KDA) way. I FlashKDA the library is available on … Read more

Microsoft Research’s World-R1 Uses Flow-GRPO and 3D-Aware Rewards to Inject Geometric Consistency in Wan 2.1 Without Architectural Changes

Microsoft Research’s World-R1 Uses Flow-GRPO and 3D-Aware Rewards to Inject Geometric Consistency in Wan 2.1 Without Architectural Changes

Video base models can paint a nice frame. They are still notorious for missing it. Push the camera down the hall in Wan 2.1 or CogVideoX and walls warp, objects morph, and details disappear — a giveaway that these models are suited to 2D pixel correlation rather than 3D scene simulation. A team of researchers … Read more

Research: AI can outperform doctors in diagnosing cases

Research: AI can outperform doctors in diagnosing cases

“Thinking” artificial intelligence is now able to diagnose real-life conditions as well as or better than doctors, according to the results of a study published on Thursday Science. The researchers used previously unknown clinical cases to test OpenAI’s o1 reasoning model against the company’s older model, the GPT-4, with doctors and medical residents in training. … Read more