Hacker News
new
|
past
|
comments
|
ask
|
show
|
jobs
|
submit
login
sunshadow
on April 19, 2023
|
parent
|
context
|
favorite
| on:
StableLM: A new open-source language model
Demo is overloaded. Here is Colab link if you wanna check the quality:
https://colab.research.google.com/github/Stability-AI/Stable...
BudaDude
on April 19, 2023
|
next
[–]
This notebook will need high ram and a premium GPU. It blew past the 16gb GPU that comes with Colab Pro
drexlspivey
on April 19, 2023
|
prev
[–]
Your session crashed after using all available RAM. If you are interested in access to high-RAM runtimes, you may want to check out Colab PRO
sunshadow
on April 19, 2023
|
parent
[–]
You can try 8bit
xkapastel
on April 19, 2023
|
root
|
parent
[–]
Using 8-bit still runs out of RAM for both the 3B and 7B models. It's unclear if it's because it still uses more than the available RAM, or if it's just quietly not using 8-bit since it's not implemented.
Consider applying for YC's Winter 2026 batch! Applications are open till Nov 10
Guidelines
|
FAQ
|
Lists
|
API
|
Security
|
Legal
|
Apply to YC
|
Contact
Search:
