Apple researcher, lead author of sigmoid self-attention
Machine Learning Researcher · current
Jason led the sigmoid attention work that made transformer attention measurably faster and then open-sourced the hardware-aware kernels to prove it. Shipping the code alongside the theory is what makes a paper a contribution.
We built this from your public work because we think it deserves celebrating. You did not ask us to, so the only fair thing is that you decide what happens to it. Claim it and it is yours to edit. Ask us to change something and we will. Ask us to take it down and it is gone within 72 hours — free, no account needed, and nobody will try to talk you out of it.