UAE-based Falcon AI NSFW classifier among top global open-source models (2025)

Posted by instagraham 8 hours ago

Counter23Comment24OpenOriginal

Comments

Comment by DC-3 7 hours ago

Coincidentally I was trying this out yesterday as a potential option for automated porn filtering for the imageboard that I administrate. It is very lightweight which is good but the performance is not great. Some weird false positives and it does a bad job with flat chested women which is very concerning to me because it leads me to think it won’t be effective against CSAM.

Comment by unglaublich 6 hours ago

I guess CSAM detection will remain hard as the training data raises so many ethical concerns.

I wonder if there's a way in which we can forward-hash sensitive material like CSAM and train a classifier that only consumes the 'hashed' version of the material for training and detection.

Comment by maaaaattttt 5 hours ago

Very naive approach but wouldn't training a model on a few specific buckets like "someone is naked", "image is explicit" and "there is a child" in the picture, would do the job without having to train explicitely on CSAM? If the model returns both a high probability of "there is a child" and a high probability of any other bucket than this image is classified as CSAM. It'd be high recall,low precision but one would be on a rather safe side.

Comment by PxldLtd 5 hours ago

This is already done, there's hashed indexes of known CSAM and you can apply vector steering to the latent space to shift detections to trigger on CSAM material. You can also use two detectors for age estimation and a separate one for nudity and use them in combination.

Comment by tao_oat 5 hours ago

I believe this is how many CSAM classifiers work. There isn't a simple legal avenue to host CSAM for classifier training, for good reason.

Comment by GoblinSlayer 2 hours ago

Share the training data :)

Comment by RobotToaster 7 hours ago

Weird, with it being from the UAE I'd expect it to detect any woman with an exposed ankle as porn.

Comment by gumby 6 hours ago

Have you been to the UAE? Sure t the beach there re women in burkinis and more, but also women in two piece bikinis.

Comment by wolvoleo 6 hours ago

There's a big difference between international jersetters partying in Dubai and locals.

The jersetters are basically exempted from the strict laws because they bring in money.

Alcohol is illegal there, homosexuality is, even unmarried sex is.

I certainly will never visit there even if they choose not to apply those laws to me as a visitor.

Comment by wolvoleo 33 minutes ago

Sorry for some reason my device keeps correcting 'jetsetters' to 'jersetters' :?

Comment by figmert 6 hours ago

What a strange Islamophobic comment to make. You should probably go out a little more.

Comment by echelon_musk 5 hours ago

Afghanistan.

Comment by figmert 4 hours ago

Great rebuttal. /s

Comment by instagraham 7 hours ago

it is amusing that a model from a country that has banned porn would ever be developed. Wouldn't there be hurdles for them to access "data" at every stage?

(I know they must have used a VPN for training but it does seem like an added hoop. OFC the UAE's block is also not particularly thorough.)

You'd assume such models would do better in a laissez-faire nsfw environment than in a walled garden of relatively-less sin.

Comment by dfish 7 hours ago

It's for research purposes :wink: :wink:

Comment by waffleiron 6 hours ago

There are plenty western CSAM detection models

Comment by DC-3 6 hours ago

Can you suggest a good one?

Comment by sillyfluke 7 hours ago

It's a story as old as time so I'm frankly less amused by it. The old school censors always saw every "data" that was taboo under the sun prior to censoring it for public consumption.

Comment by ggm 8 hours ago

Always two sides to classification. Finding and Banning. It's tempting to ask if this is one, the other or both by the same people.

Comment by totetsu 7 hours ago

Planet-scale nude-selfie extenuation racket?

Comment by londons_explore 6 hours ago

How many people download classifiers?

The number of downloads really doesn't seem like a good way to measure the quality of a bit of work. One download could be deployed on a bit website and classify billions of users images.

Comment by londons_explore 6 hours ago

Smells like someone is botting the download numbers to get a press release....

Comment by TacticalCoder 5 hours ago

> UAE AI model tops 50 million monthly downloads

So in a bit more than a year, 10% of the planet has downloaded a NSFW classifier?

I mean: in the end there are only 8 billion people on earth, which projects do, all added up, need to download one NSFW classifier 600 million times a year?

Something something something makes me think there are inefficiencies at play here.

Comment by relaxing 5 hours ago

Depends, if every time a project redeploys it redownloads all external resources from their respective CDNs, do you consider that to be inefficient? What if it’s part of a service that runs on thousands of instances to keep up with the volume of user generate content?

Comment by nlanandkumar 8 hours ago

[dead]