In the margin, branches are more likely close to the hot path, so they are more likely to 'pollute' the instruction cache. Whilst exceptions have less of this.

Though profile guided optimization will probably catch this. And it might be that even without, compilers still optimize around this.