Hacker News
new
|
past
|
comments
|
ask
|
show
|
jobs
|
submit
login
JackC
on April 4, 2020
|
parent
|
context
|
favorite
| on:
Ask HN: Best practices for ethical web scraping?
In some cases, especially during development, local caching of responses can help reduce load. You can write a little wrapper that tries to return url contents from a local cache and then falls back to a live request.
Consider applying for YC's Winter 2026 batch! Applications are open till Nov 10
Guidelines
|
FAQ
|
Lists
|
API
|
Security
|
Legal
|
Apply to YC
|
Contact
Search: