Llama.cpp has --n-gpu-layers that lets you set how much of the model to put on t...

		sp332 on Jan 27, 2024 \| parent \| context \| favorite \| on: Brave Leo now uses Mixtral 8x7B as default Llama.cpp has --n-gpu-layers that lets you set how much of the model to put on the GPU.