I found this out when I moved recently and I find it incredibly stupid. I'm now simultaneously annoyed that my new address seems to still receive mail for the last 3 tenants, but I also didn't do a change of address so whoever ends up renting my old apartment is going to be annoyed with me.
The last house I lived in was torn down and rebuilt. The address changed from 311 to 313 in the process. I've always wondered if it was because they were tired of receiving my junkmail.
