Let's say you apply for a job. They ask you for an address, and you give it to them. Most bosses may be cool people, but some of them tend to pry. If they get to see the street view of your house at the click of a button, they can estimate how rich/poor your family is, and can use it against you. For example, if the job applicant comes from a very poor family, they may play hard-ball with salary negotiations.

Or your sister posts a pic of herself on Instagram, showing a quarter of the house-front. Some random creep who recognizes the locality can use street-view to narrow down where she lives. All from the comfort of his own home.