← Back to context Comment by DrewADesign 14 hours ago Feel free to elucidate if you want to add anything to this thread other than vibes. 4 comments DrewADesign Reply electroglyph 13 hours ago after you go from from millions of params to billions+ models start to get weird (depending on training) just look at any number of interpretability research papers. Anthropic has some good ones. HumanOstrich 13 hours ago > things start to get weird> just look at research papersYou didn't add anything other than vibes either. Barbing 10 hours ago Interesting, what kind of weird? DrewADesign 13 hours ago Getting weird doesn’t mean calling it text prediction is actually ‘bullshit’? Text prediction isn’t pejorative…
electroglyph 13 hours ago after you go from from millions of params to billions+ models start to get weird (depending on training) just look at any number of interpretability research papers. Anthropic has some good ones. HumanOstrich 13 hours ago > things start to get weird> just look at research papersYou didn't add anything other than vibes either. Barbing 10 hours ago Interesting, what kind of weird? DrewADesign 13 hours ago Getting weird doesn’t mean calling it text prediction is actually ‘bullshit’? Text prediction isn’t pejorative…
HumanOstrich 13 hours ago > things start to get weird> just look at research papersYou didn't add anything other than vibes either.
DrewADesign 13 hours ago Getting weird doesn’t mean calling it text prediction is actually ‘bullshit’? Text prediction isn’t pejorative…
after you go from from millions of params to billions+ models start to get weird (depending on training) just look at any number of interpretability research papers. Anthropic has some good ones.
> things start to get weird
> just look at research papers
You didn't add anything other than vibes either.
Interesting, what kind of weird?
Getting weird doesn’t mean calling it text prediction is actually ‘bullshit’? Text prediction isn’t pejorative…