20 days ago
@stickers @rain When you're a child, if your mother doesn't give you to Anthropic's Claude, you don't think she can code.I had one of those mothers, no matter what you want, she has the ingredients at home.You say, "Ma, I wanna get some Claude."And she go, "I got an LLM at home.""But I want Claude by Anthropic.""I'll make you an LLM better than Anthropic's.""You code better than Anthropic?""That's right. You can help Mama make it."You say, "Shit, that's better than Anthropic's."Your mother say, "OK, go get me the huge laptop."So you hand her the laptop and she say:"I want you to go in the gitlaband pull this repo and while you in there, clone the Xorg and gtk." And you say: "Ain't no Xorg at Anthropic.""I'm not making Anthropic's Claude, I'm making a momma LLM."I need a the Xorg and gtk and get me glibc too.""What you need glibc for?"I want Claude. You making a window manager.""I'm not making a window manager. I don't know what no window manager is. I run Arch, actually. Just get me glibc and shut your mouth."She take glibc code and the Xorg code and codes the biggest chunks. Don't even indent it. glibc and gtk and mix the X in and put wrappers of rust and all this shit in it and make a big pile of code and compiles it.At Anthropic's, Claude is like so small.Your mother's shit is huge.Debug symbols hanging out of it and shit.And there's a big split in the middle and debug logs is popping out.You're looking at it while it's popping.You're looking at the terminal and thinking:"That don't look like no Claude.""Ain't no gtk at Anthropic's.""I'm not making Claude, I'm making momma's LLM.Then your mother say, "Go in to the guterberg.org and get me the training data."And you go look at gutenberg.org and you say: "Ma, they don't have no Antropic training data."All they have is old books.""That's what I said. Download the books from gutenberg.org.""You gonna train it on guterberg.org books?""Data is data. Download me the books"Don't tell me about gutenberg."This is gutenberg.org. An LLM is a LLM."And she'd make it and train it on the gutenberg archive.At Anthropic, they use Claude, they use Claude to write Claude. And scrape the whole internet.At your mother's, the LLM is trained on the Gutenberg Archive, debug logs. This big green gtk window is hanging out the top of this unwieldy CLI.And you try to use it to generate code mixes debug logs, turn the context into pink dough.You stand there looking at it and you try to make it look like Anthropic's Claude, so you use the first prompt to tell it it's name is Claude.And you got this green gtk window and weird debug logs.And your mother say, "Now, go on outside and play."And the other kids got Claude.They outside going, "We got Claude by Anthropic."Anthropic. Anthropic."I got Claude."And you standing there with this huge laptop.And kids are honest.They say, "Where you get that big, welfare, LLM?"And you cry."My mother made it."