https://www.nytimes.com/2022/08/21/technology/google-surveil...
At least with AWS they're clear that this is the only type of proactive scanning they do on their ZDR AI endpoints. With Azure it's actually unclear exactly how much more falls into the synchronous scanning pipeline, though I may be missing some docs.
The way this was explained to me is although there is no legal requirement to do this, vendors are concerned that AI processing constitutes "actual knowledge" of the content unlike a lot of traditional cloud-based workloads, which would expose them to legal liability. Seems like a weird argument in a ZDR context, but anyway, there's also a public optics element too I'm sure.
Pornography is illegal to download or save in Singapore… I wonder how they were able to train a model without the data.
I’m thinking about how it used to be extremely impractical to track most of the population, the the enforcement comes after the crime, and there is no pressure to have detected it before it happened and stop it.
How should society/law change in response? Is it purely a give and take between surveillance/right-to-not-be-watch and trying to prevent all bad things from happened before they happen?
Privacy, unfortunately, is largely the result of it being impractical to violate it.
I see zero reason to believe that states wont read your thoughts if they can easily manage to.
When there's an active and urgent case to try and locate and rescue children in these situations, the volume of AI-generated content makes it that much harder to perform forensic investigations on background materials (often how they locate children being abused is by prosaic items like electrical outlets, household goods, etc. in the background of abuse photos and videos) because now they have to rule out whether an image is even real -- a task that often requires close attention and scrutiny to details of traumatizing and disturbing content (sometimes all the more traumatizing due to the 'creative freedom' of AI-generated material)
A model capable of shielding investigators from additional trauma is an excellent thing.
Isn't CSAM only material based on abuse of real humans? How could computer models multiply CSAM by that definition?
This is no different than how something like basic poster design is not a real service you can sell anymore since ChatGPT can make a passable one for free.
If that kind of pervert can’t be simply fixed (or even exterminated) with a magic wand, it would be far better for our society if they’re looking at fake images than tempted to make their own by harming kids. But we as a society can’t accept that so we police this as aggressively as we did the kind that had an actual victim.
Not saying I agree with them, just that this is one of the main points trotted out in support of intrusively policing generation and editing models.
If only.
The same "hard on crime" ratchet that happens to most every thing that's popular to punish and extremely unpopular to speak out against the tightening of said ratchet has happened here.
"So you don't think it's morally wrong to generate _______ using AI?"
"So you don't think it's morally wrong to _______ using AI?"
The matter can't be considered in isolation, and although anyone voicing a healthy fear of where this is going can be portrayed, through demagoguery, as "pro-CSAM" or "anti-children" at this juncture, the logical endpoint of this kind of surveillance is in far more unpalatable places.
As the good folks fighting--a losing battle, at present--for digital freedom and privacy know, guarding dearly held liberties means securing those liberties for criminals and antisocial pursuits, too. That's just the cost of freedom.
And yet, we have no means of disputing the accuracy of these inscrutable classifiers, nor any reason to think that similar approaches won't be applied to other "objectionable" content in other contexts, as is currently the fashion in Europe in the UK with regard to anything that could be conceivably deemed to be inciting hate, animus or disorder.
Automated technological surveillance and censorship is really, really having a moment right now. I'm not holding my breath that the pendulum swings the other way, but I sure hope it does.
Could be a great start for "rogue AI"
Jokes aside, I'm glad they are giving tools to help fight this as currently your options are limited because every provider will simply return a content warning if you try to use an LLM as a moderator.
>In SafetyKit’s evaluations involving drawings or animations that sexualize children, the classifier detected 90% of cases
>This is the first CSAM classifier with broad availability that has a specific signal on indicating if CSAM may be AI generated.
What children are being abused by drawings or AI generated images, stories, etc?
I understand the cases where it's problematic to make such content based on real children and share it, and I think it's probably a bad idea to allow photorealistic child porn to be publicly posted on the internet for the sake of not confusing law enforcement (in the same way posting misinformation is harmful), but if these images are not realistic, or if it's just text, or if they are realistic but they aren't being shared on the internet, who is being harmed?
Whatever you say about "non-offending" (and possessing child porn IS an offence in most places). I would definitely not have wanted you anywhere near my kids.
I believe AI is one of the only ways to engage with these desires in an ethical way.
Of course, you can always recommend abstinence, but unless you're rather conservative in your views, you probably don't think that's a good way to deal with teenage pregnancy, homosexuality, etc. So why would this be the exception?
I understand the distinction between offending and non offending.
But pedophile is inclusive of both.
We asked for further information so we could report the uploader to the NCMEC and remove the content from our systems. They refused to give us any information about this incident, denied our appeal, and have so far, illegally refused our privacy requests for data about our account.
OpenAI does not care about fighting child sexual abuse, this is completely performative.
EDIT: These image uploads are up to 20+ years old, and are being served through Cloudflare with their CSAM scanning product enabled. We've received no notification of any problems from Cloudflare. Something on OpenAI's system thinks that an image we sent to them for classification is CSAM, and they aren't willing to elaborate or communicate about it at all. For reference, our website is https://ytmnd.com
Another complicating factor is that it really blows to have humans look at stuff like that, so everyone would rather use automated classifiers; and if you assume good faith and share too much info with the affected parties, this will be exploited by the bad guys to gain insights into how the system works and how to circumvent it.
I don't think there's an elegant solution to this, other than "don't allow tech companies to get so big that they can afford not to care about individual customers".
Basically, keeping children from being miserably. Poverty isn't the only source of the exploitation of children but it's huge one and how little any anti-CSM crusaders care about this reveals a lot imo about their lack of sincerity.
But in our society, even in a much better society than this, bad things are going to happen at scale. At a certain, you have abandon the "we'll do anything to stop this terrible thing, no matter how much what you do hurts people otherwise, no matter how ineffective what you do is, you must do your thing since it can be done".
But this agenda is also ultimately about the power of those pushing it rather than just its goals, of course.
I think virtually every person and company does care. In fact I think its exceedingly obvious.
Even if OpenAI, Facebook, etc dont care be cause they are evil, they do care because pf liability.
None of this even excludes the possibility that CSAM controls are co-opted for power sometimes. Which is why it’s absurd to suggest these companies don’t care - you can concede that point and still argue its being co opted.
To actually care about something is not the same as doing arbitrary actions due to financial reasons. That's caring about money, and nothing else.
That doesn’t really follow from your experience.
OpenAI could care about child sexual abuse and not respond to your appeal, even wrongfully.
Frankly I am not interested in retaining an OpenAI account anymore so the only reason we appealed was to try to get more information, not to restore the account.
The fact that they did not previously have proper procedures in place for something like this is not proof that they don’t care. They are one of the fastest growing companies of all time, it’s hard to get disparate parts of an organization aligned on something. Their organization has more than doubled in size in the last nine months.
I used to view shit there a lot sometime in the mid-2000s.