When one entity has so much leverage over another it compromises the sovereignty of the other.

Also it's a 'gray area' -- Switzerland belongs to many EU institutions like Schengen and EEA without being in the EU proper. Using Euros would also be common in parts of Switzerland.