Thanks! I think computers are fun and I want reading about them to be fun too. I... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		charles_irl 2 days ago \| parent \| context \| favorite \| on: We reverse-engineered Flash Attention 4 Thanks! I think computers are fun and I want reading about them to be fun too. I was also reminded of HazyResearch's MegaKernels. Didn't want to distract from the main thrust of the post, but definitely think that's a promising approach.

emaadm 1 day ago [–]

There's some interesting work in NeurIPS this year on fused kernels for MoE too: https://flash-moe.github.io/

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact