It's obviously not just language models at work here, it's transformer based architectures in general. Why do you think we can generate video, text, and transcribe audio, and a host of other things like protein discovery all dramatically better than a couple years ago? And this all happened around the same time? Major tech companies are currently folding up their prior machine learning efforts because they've been BTFO by this leap in tech. This is something that is absolutely happening in the ML space across the software industry.

The fact that you think I'm even talking about LLMs exclusively is such a myopic view of what's really going on.

We're talking about the same shit lol, a natural language is just another process for these things to model. I never said it wasn't an advancement over previous methods, it's obviously better than a Markov chain or previous architectures of neural networks. Idek what we're arguing about anymore. What is your ultimate point here?

I am also tired of arguing (I'm not arrogant enough to call it educating lol). But I will look into those companies you mentioned

[–] AtmosphericRiversCuomo@hexbear.net 3 points 1 week ago (1 children)

Sorry to be a dickhead. This is just what strong difference of opinion looks. Everyone jumps up my ass about daring to say that "AI" is not just a grift but an actual threat (and opportunity). Like yes, silicon valley are grifters, but that doesn't preclude them from cooking up useful engineering once in a while.

My whole point is that we need to abandon our immature/dirtbag analysis of this issue and get more professionalized about things or we're gonna get really rinsed in the 21st century.

[–] PaX@hexbear.net 3 points 1 week ago

Eh it's okay, no hard feelings, I probably also got too heated :3

Would be down to talk more about it with you later cuz it is a rly important issue, not to mention technically fascinating

Rn I am out of spoons for internet talking, will be back later though