Hacker News new | past | comments | ask | show | jobs | submit login

Some different views. For instance, to give some sense of a scale for the 250 or so v2 torrents seen every day is, here's a view of the total number of torrents it discovers each day [1]. (Or, more properly, this is the number of torrents it gathered complete metadata and validated against the infohash each day).

One of these days I should find somewhere to put all these bits of metadata I've been downloading.

[1] https://imgur.com/a/8pWhjxD




Consider creating a collection at the Internet Archive for these data sets.


Sure:

https://archive.org/details/torrent_metadata_archive_sample

I'll start uploading monthly archives.


I genuinely appreciate that you took the time to do this. Thank you.


For anyone looking to download the data: Click on my name in archive.org to see the monthly archives. I'm slowly working my way through the months, though there may be breaks in the work as other work takes priority.

The first few months will be the biggest, then it should settle down to something like 15-30gb a month.


Neat! I don’t have it handy, but years ago I scrapped the states traffic page and then made time lapses from them. One of the road segments had a bad sensor that would toggle into a stuck state.

Keep it up!




Consider applying for YC's Fall 2025 batch! Applications are open till Aug 4

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: