QuaRot: Outlier-Free 4-Bit Inference in Rotated LLMs (SOTA sub-4-bit inference) | Hacker News

Hacker News new | past | comments | ask | show | jobs | submit

login

		QuaRot: Outlier-Free 4-Bit Inference in Rotated LLMs (SOTA sub-4-bit inference) (arxiv.org)
		1 point by Hugsun on May 11, 2024 \| hide \| past \| favorite

Consider applying for YC's Fall 2025 batch! Applications are open till Aug 4
Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact