AI

4126 readers

4 users here now

Artificial intelligence (AI) is intelligence demonstrated by machines, unlike the natural intelligence displayed by humans and animals, which involves consciousness and emotionality. The distinction between the former and the latter categories is often revealed by the acronym chosen.

founded 3 years ago

Nvidia’s ‘Nemotron-4 340B’ model redefines synthetic data generation, rivals GPT-4 (venturebeat.com)

submitted 4 months ago by ylai@lemmy.ml to c/artificial_intel@lemmy.ml

4 comments fedilink hide all child comments

top 4 comments

sorted by: hot top controversial new old

[–] MagicShel@programming.dev 2 points 4 months ago (1 children)

Redefines synthetic data generation? From "making fake data" to what? (I get it, it's hyperbole.)

Training on synthetic data is the most garbage-sounding thing I've ever heard. Isn't Reddit and Wattpad fake enough? At least those posts were generated by actual humans.

I guess I'll wait and see, but I'm really skeptical that this will be a good thing.

[–] Daxtron2@startrek.website 6 points 4 months ago

Its a promising idea. Limitless training data in any domain you want. Whether or not it actually pans out is a whole different story.

[–] Fisch@discuss.tchncs.de 1 points 4 months ago (1 children)

340B is fucking huge, holy shit. How big is GPT-4?

[–] ylai@lemmy.ml 2 points 4 months ago

The rumor is 1.76 trillion, or 8x220B (mixture of experts) to be specific: https://wandb.ai/byyoung3/ml-news/reports/AI-Expert-Speculates-on-GPT-4-Architecture---Vmlldzo0NzA0Nzg4