Given that America is a democracy, it would appear that a majority of Americans do not share your morals, so on the contrary it is your moral duty to pay your taxes.
I would bet that in aggregate, more than half the taxes you pay go to your state, or some local polity smaller than state. Local political entities (county, city, town) are absolutely democracies and also have the maximum amount of actual impact on your life. The federal government is mostly irrelevant.
By avoiding paying taxes, you first and foremost damage the community you live in.