I’m certainly not a domain expert, but one thing I have read repeatedly about Tr...

		ttul on May 30, 2024 \| parent \| context \| favorite \| on: New attention mechanisms that outperform standard ... I’m certainly not a domain expert, but one thing I have read repeatedly about Transformers is that not all tricks scale the same.