When you're dealing with unix-y Git repositories for example.
If you mean more from a user perspective, it really depends. For registry keys for example, since they're interacted with programmatically for the most part, I was expecting them to be case-sensitive. They're case-insensitive though, so that was a bit of a whiplash.
Usually preferable, except when not. Just like distinguishing between upper- and lowercase letters, and other misery.
[0] https://en.wikipedia.org/wiki/Natural_sort_order