No, they weren't. In the 18-59 age group, they made up about 20% of every response group. Even in the 60+ group it was about 10%. [1] And in the YouGov poll [2] that surveyed all Americans instead of just voters, and also asked the question in a less leading way found 37% "don't know" amongst all Americans.
The Emerson poll quite disingenuously chose to frame the typical "don't know" as "neutral", which is going to be interpreted as a value position - not the lack of a formed position, which their poll completely lacked. Their questions and answers were poorly framed if the goal was to actually query public sentiment and not just get a desired response.
Not the case. The "neutrals" were only a few %, while 68% said "somewhat unacceptable" or "unacceptable".