I'm surprised at the model dim being 2.8k with an output size of 200k. My gut feeling had told me you don't want too large of a gap between the two, seems I was wrong.

This is normal. Rope was introduced after bert/gpt2

What is it like living a life completely ignorant of reality?

If you'd like to learn, feel free to ask chatgpt on the leftish pushback against abundance. Or historical examples of leftists blocking housing projects. Or environmentalists prioritizing niche interests over those of the general community. There are many, many examples.

We're all gonna be PMs.

That’s basically what it amounts to, being a PM to a team of extremely cracked and also highly distractable coders.

Think the microsoft terminal saga shows a pretty clear track record.

This is very good. I've also noticed I do the polite engagement sometimes and how its roboticsness is obvious to any person with not low EQ. Some people seem to just be naturally happy in almost any settings and its a very valuable trait imo.

So this is not the case for https://gemini.google.com ?

It is, everything you send to google will be used for training.

An AI trained on all Gmail user data, including business accounts and their attachments, would cause chaos of unprecedented levels.

Then again, with DOGE accessing classified government data and DOGE's links to xAI, we may have a chance to experience something like this.

(Shrug) Copyright is a bargain with the public domain, and so are LLMs.

It's a fair deal as long as the terms are disclosed, which they are. As usual, don't upload anything to the Internet today that you don't want to see in the New York Times tomorrow.

If your friends are the sort that stick to tribes instead of thinking independently get smarter friends.

this is me trying haha

Not the same thing at all. Corporations care about their data a lot and would cancel deals over this. Noone cares if some authors get upset, they have no leverage. Disappointing how people will make confident statements while being so clearly clueless.

> Corporations care about their data a lot and would cancel deals over this. Since you have mentioned "a lot" share few examples, pls.