Technology

37717 readers

564 users here now

A nice place to discuss rumors, happenings, innovations, and challenges in the technology sphere. We also welcome discussions on the intersections of technology and society. If it’s technological news or discussion of technology, it probably belongs here.

Remember the overriding ethos on Beehaw: Be(e) Nice. Each user you encounter here is a person, and should be treated with kindness (even if they’re wrong, or use a Linux distro you don’t like). Personal attacks will not be tolerated.

Subcommunities on Beehaw:

This community's icon was made by Aaron Schneider, under the CC-BY-NC-SA 4.0 license.

founded 2 years ago

MODERATORS

alyaza@beehaw.org

TheRtRevKaiser@beehaw.org

gyrfalcon@beehaw.org

rs5th@beehaw.org

coldredlight@beehaw.org

Los@beehaw.org

SemioticStandard@beehaw.org

TheRtRevKaiser@kbin.social

remington@beehaw.org

AI model output quality decreases when trained with AI models (futurism.com)

submitted 1 year ago by shanghaibebop@beehaw.org to c/technology@beehaw.org

56 comments fedilink hide all child comments

"Our primary conclusion across all scenarios is that without enough fresh real data in each generation of an autophagous loop, future generative models are doomed to have their quality (precision) or diversity (recall) progressively decrease," they added. "We term this condition Model Autophagy Disorder (MAD)."

Interestingly, this might be a more challenging problem as we increase the use of generative AI models online.

(page 2) 2 comments

sorted by: hot top controversial new old

[–] h3ndrik@feddit.de 0 points 1 year ago* (last edited 1 year ago) (2 children)

Wow. How is this going to affect all the projects that fine-tune Meta's Llama model with synthetic training data?

load more comments (2 replies)

load more comments