Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Where did you get that date?

On July 1, 2019, Google announced the proposal of the Robots Exclusion Protocol as an official standard under Internet Engineering Task Force.[8]

https://en.wikipedia.org/wiki/Robots.txt



That is not when they started recommending it. It would be nice if you acknowledged the rest of my comment, I even quoted from the [8] reference.




Consider applying for YC's Winter 2026 batch! Applications are open till Nov 10

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: