> why do we never factor gun violence into these conversations about safety

Because it doesn't particularly matter if you are robbed, hurt, or killed by a gun, knife, bat, or fists.

(And when looking at stats, remember: over half of gun deaths in the U.S. are self-inflicted. Which is still tragic, but different than assault.)