this post was submitted on 28 Jan 2025
1066 points (97.5% liked)
Microblog Memes
6320 readers
3777 users here now
A place to share screenshots of Microblog posts, whether from Mastodon, tumblr, ~~Twitter~~ X, KBin, Threads or elsewhere.
Created as an evolution of White People Twitter and other tweet-capture subreddits.
Rules:
- Please put at least one word relevant to the post in the post title.
- Be nice.
- No advertising, brand promotion or guerilla marketing.
- Posters are encouraged to link to the toot or tweet etc in the description of posts.
Related communities:
founded 2 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
I don't understand why everyone's freaking out about this.
Saying you can train an AI for "only" 8 million. It is a bit like saying that it's cheaper to have a bunch of university professors do something than to teach a student how to do it. Yeah and that is true, as long as you forget about the expense of training the professors in the first place.
It's a distilled model, so where are you getting the original data from if not for the other LLMs?
They implied it wasn't something that could be caught up to in order to get funding, now ppl that believed that finally get that they were bsing, thats what they are freaking out over, ppl caught up for way cheaper prices on a moden anyone can run open source
Right but my understanding is you still need Open AIs models in order to have something to distill from. So presumably you still need 500 trillion GPUs and 75% of the world's power generating capacity.
The message that OpenAI, Nvidia, and others which bet big on AI delivered was that no one else could run AI because only they had the resources to do that. They claimed to have a physical monopoly, and no one else would be able to compete. Enter Deepseek doing exactly what OpenAI and Nvidia said was impossible. Suddenly there is competition and that scared investors because their investments into AI are not guaranteed wins anymore. It doesn't matter that it's derivative, it's competition.
Yes I know but what I'm saying is they're just repackaging something that openAI did, but you still need openAI making advances if you want R1 to ever get any brighter.
They aren't training on large data sets themselves, they are training on the output of AIs that are trained on large data sets.
Oh I totally agree, I probably could have made my comment less argumentative. It's not truly revolutionary until someone can produce an AI training method that doesn't consume the energy of a small nation to get results in a reasonable amount of time. Which isn't even mentioning the fact that these large data sets already include everything and that's not enough. I'm glad that there's a competitive project even if I'm going to wait a while and let smarter people than me sus it out.