> If you want to do business in every EU country you basically have to register a business in each of them.

This is false. Some types of business that are more heavily regulated do require you to set up a local branch.