The classic libertarian adage is that a government powerful enough to give you everything you want is powerful enough to take everything you have.
Some corollary would apply here. (it's not that anyone particularly loves letting criminals off the hook, it's granting that ability is a slippery slope)
Having stolen coins recovered seems like an OK thing.