It does if you are building on the same host with preserved state and didn't clean it.

There are lots of cases where people end up with with an empty docker repo at every CI run or regularly empty the repo because docker doesn't have any sort of intelligence space management (like LRU).