this post was submitted on 10 Jul 2023
353 points (91.7% liked)
Technology
59264 readers
3689 users here now
This is a most excellent place for technology news and articles.
Our Rules
- Follow the lemmy.world rules.
- Only tech related content.
- Be excellent to each another!
- Mod approved content bots can post up to 10 articles per day.
- Threads asking for personal tech support may be deleted.
- Politics threads may be removed.
- No memes allowed as posts, OK to post as comments.
- Only approved bots from the list below, to ask if your bot can be added please contact us.
- Check for duplicates before posting, duplicates may be removed
Approved Bots
founded 1 year ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
I can tell for a fact that there's nothing new going on. Only the MASSIVE investment from Microsoft to allow them to train on an insane amount of data. I am no "expert" per se, but I've been studying and working with AI for over a decade - so feel free to judge my reply as you please
Uhhhh the available models are improving by leaps and bounds by the month, and there's quite a bit of tangible advancement happening every week. Even more critically the models that can be run on a single computer are very quickly catching up to those that just a year or two ago required some percentage of a hyperscaler's datacenter to operate
Unless you mean to say that the current insane pace of advancement is all built off of decades of research and a lot of the specific advancements recently happen to be fairly small innovations into previous research infused with a crapload of cash and hype (far more than most researchers could only dream of)
That's exactly what I mean! The research projects I've been 5-7 years ago had already created LLMs like this that were as impressive as GPT. I don't mean that the things that are going on aren't impressive, I just mean that there's nothing actually new. That's all. IT's similar to the previous hype wave that happened in AI with machine learning models when google was pushing deep learning. I really just want to point that out.
EDIT: Typo
I can't think of anything less accurate to say about LLMs other than that they're a world-ending threat.
This is a bit like saying "The internet is a cute thing for tech nerds but will never go mainstream" in like 1995.
Cool, thanks for your take
Yw!