Technology

59588 readers

3192 users here now

This is a most excellent place for technology news and articles.

Our Rules

Follow the lemmy.world rules.
Only tech related content.
Be excellent to each another!
Mod approved content bots can post up to 10 articles per day.
Threads asking for personal tech support may be deleted.
Politics threads may be removed.
No memes allowed as posts, OK to post as comments.
Only approved bots from the list below, to ask if your bot can be added please contact us.
Check for duplicates before posting, duplicates may be removed

Approved Bots

founded 1 year ago

MODERATORS

153

Child safety org launches AI model trained on real child sex abuse images (arstechnica.com)

submitted 2 days ago by Xatolos@reddthat.com to c/technology@lemmy.world

89 comments fedilink hide all child comments

Today, a prominent child safety organization, Thorn, in partnership with a leading cloud-based AI solutions provider, Hive, announced the release of an AI model designed to flag unknown CSAM at upload. It's the earliest AI technology striving to expose unreported CSAM at scale.

you are viewing a single comment's thread
view the rest of the comments

[–] JackbyDev@programming.dev 1 points 1 day ago (1 children)

Alright, I found the name of what I was thinking of that sounds similar to what they're suggesting: generative adversarial network (GAN).

The core idea of a GAN is based on the "indirect" training through the discriminator, another neural network that can tell how "realistic" the input seems, which itself is also being updated dynamically. This means that the generator is not trained to minimize the distance to a specific image, but rather to fool the discriminator. This enables the model to learn in an unsupervised manner.

[–] Railcar8095@lemm.ee 1 points 1 day ago (1 children)

Applying GAN won't work. If used for filtering would result on results being skewed to a younger, but it won't show 9 the body of a 9 year old unless the model could do that from the beginning.

If used to "tune" the original model, it will result on massive hallucination and aberrations that can result in false positives.

In both cases, decent results will be rare and time consuming. Anybody with the dedication to attempt this already has pictures and can build their own model.

Source: I'm a data scientist

[–] JackbyDev@programming.dev 1 points 1 day ago

At least it's not "Source: I am a pedophile" lol