Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Excellent work - enjoyed the rick roll. Would you mind sharing how you've done the GPU deployment?


lol, thanks! onnx, docker, and fastAPI on CPUs with AWS fargate. although i'm switching to GPUs in a month or two, so if you have any suggestions let me know.


I've also been searching for GPU solutions for potential small projects like this, and so far banana.dev and runpod.io seem promising.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: