So this "even-handeness" metric is a pretty explicit attempt to aim for the middle on everything, regardless of where the endpoints are.
This is well-suited to Anthropic's business goals (alienating as few customers as possible.) But it entirely gives up on the notion of truth or factual accuracy in favor of inoffensiveness.
Did Tiananmen square happen? Sure, but it wasn't as bad as described. Was the holocaust real? Yes, lots of people say it was, but a lot of others claim it was overblown (and maybe even those who thought the Jews had it coming actually had a valid complaint.) Was Jan 6 an attempt to overthrow the election? Opinions differ! Should US policy be to "deport" immigrants with valid visas who are thinly accused of crimes, without any judicial process or conviction? Who, really, is to say whether this is a good thing or a bad thing.
Aside from ethical issues, this also leaves the door wide open to Overton-hacking and incentivizes parties to put their most extreme arguments forward, just to shift the middle.
The fallacy of the middle is a poison that extremists with power and media reach use to kill productive discourse.
People who don't care about the distinction between truth and falsehood understand this very well, and use it to its full potential. After all, the half-way point between truth and a wild, brazen, self-serving lie is... A self-serving lie.
The media has been largely complicit in this (Because controversy sells), but now we're getting this crap cemented in AI models. Wonderful.
---
The promise that hackers are making is that these systems will enhance our knowledge and understanding. The reality that they have delivered in a bullshit generator which serves its operators.
The middle is not a fallacy. There is more than a binary choice most of the time and most of politics is subjective. The media is largely complicit in selling the lie that there are only two flavours of ice cream available at any given time.
So a neat thing about truth is that these questions actually have answers! I encourage you to research them, if you're curious. We really don't need to live in this world of both-sides-ism.
(Also, I'm a bit bemused that these are the examples you chose... with everything going on in the world, what's got you upset is a possibly dubious investigation of your guy which never even came to anything...?)
People believe incorrect things all the time, for a variety of reasons. It doesn't mean the truth doesn't exist. Sure, sometimes, there isn't sufficient evidence to reasonably take a side.
But lots of times there is. For example, just because a lot of people now believe Tylenol causes autism doesn't mean we need to both-sides it... the science is pretty clear that it doesn't.
Lots of people can be wrong on this topic, and it should be ok to say that they're wrong. Whether you're an individual, a newspaper, an encyclopedia, or a LLM.
Not everybody is going to agree, heck even Nixon had like 24% support or so when was proven guilty of orchestration watergate and taping the whole thing. The benchmark isn't every human agreeing, it's just finding out what's true, and a lot of the times the facts are actually pretty compelling.
This is well-suited to Anthropic's business goals (alienating as few customers as possible.) But it entirely gives up on the notion of truth or factual accuracy in favor of inoffensiveness.
Did Tiananmen square happen? Sure, but it wasn't as bad as described. Was the holocaust real? Yes, lots of people say it was, but a lot of others claim it was overblown (and maybe even those who thought the Jews had it coming actually had a valid complaint.) Was Jan 6 an attempt to overthrow the election? Opinions differ! Should US policy be to "deport" immigrants with valid visas who are thinly accused of crimes, without any judicial process or conviction? Who, really, is to say whether this is a good thing or a bad thing.
Aside from ethical issues, this also leaves the door wide open to Overton-hacking and incentivizes parties to put their most extreme arguments forward, just to shift the middle.
Our society does NOT need more of that.