No. They want you to target HIP, which is compatible with both CUDA and ROCm. ht...

Kelteseth · on Aug 7, 2023

And with HIP now supporting Windows[0] it could be a game changer. I would love to see it working with llama.cpp[1]. I tried HIP via Blender, but it did not work for my 6600XT, it still used my CPU...

[0] https://github.com/RadeonOpenCompute/ROCm/issues/666#issueco...

[1] https://github.com/ggerganov/llama.cpp/discussions/915#discu...