No. In fact, not only no, but <insert expletive-laden but not-acceptable-language-for-HN negative>.
I do not want vibe-coding the law, especially criminal law. I do not want vibe-coding the tax rules. I do not want vibe-coding traffic safety.
And, in fact, we won't be governed by AI, even if we are. If we're governed by AI, we're really governed by whoever trained the AI, and/or whoever curated the training data. Do we want to be governed by them? Again, no, with expletives.
Maybe this boils down to people who think AI is on an exponential (self-improving) curve, materially unbounded by physical resources, and people who think it's on a series of sigmoid curves with material physical constraints.
If someone assumes AI will become significantly more capable than humans at reasoning through complexity, then I can empathize with their opinion. I was previously convinced (open to) this possibility, but in recent years and the better AI gets the clearer it is to me that it's going to take a lot longer, and the super AGI outcome is a lot harder to see.
I'm sure by the time it could possibly be a feasible and positive option people will be plenty ready for it... So no need to prepare prematurely.
TLDR: I agree with you, but without the expletives.
Well, at the moment, AIs don't get to vote. So step 1 is, don't vote them into office (or even into the franchise).
That is, AIs don't get to govern things without being put into governmental power by humans. Don't let the humans be the voters.
That doesn't stop office holders from using them like a magic 8-ball. So step 2 is, vote out office holders that let AIs write laws (or even replies to constituents).
My magic 8-ball says that major corporations are training the LLMs and pushing LLM features into our eyeballs at every opportunity. How do you propose we convince the average voter that our stance on AI is the correct one? If I were a power-hungry corporation, I'd be feeding my LLMs with the texts of laws as I want them to written, transcripts of cases as I'd wish they'd been tried, arguments for candidates and policies that I like... so I, an individual with less than a million dollars to my name, do not know how to compete with this.
How do I propose to convince them? I don't need to. As corporations push LLM features into their eyeballs at every opportunity, they'll get the picture.
I do not want vibe-coding the law, especially criminal law. I do not want vibe-coding the tax rules. I do not want vibe-coding traffic safety.
And, in fact, we won't be governed by AI, even if we are. If we're governed by AI, we're really governed by whoever trained the AI, and/or whoever curated the training data. Do we want to be governed by them? Again, no, with expletives.