OpenAI Supports California AI Bill Requiring 'Watermarking' of Synthetic Content 30
OpenAI said in a letter that it supports California bill AB 3211, which requires tech companies to label AI-generated content. Reuters reports: San Francisco-based OpenAI believes that for AI-generated content, transparency and requirements around provenance such as watermarking are important, especially in an election year, according to a letter sent to California State Assembly member Buffy Wicks, who authored the bill. "New technology and standards can help people understand the origin of content they find online, and avoid confusion between human-generated and photorealistic AI-generated content," OpenAI Chief Strategy Officer Jason Kwon wrote in the letter, which was reviewed by Reuters.
AB 3211 has already passed the state Assembly by a 62-0 vote. Earlier this month it passed the senate appropriations committee, setting it up for a vote by the full state Senate. If it passes by the end of the legislative session on Aug. 31, it would advance to Governor Gavin Newsom to sign or veto by Sept. 30.
AB 3211 has already passed the state Assembly by a 62-0 vote. Earlier this month it passed the senate appropriations committee, setting it up for a vote by the full state Senate. If it passes by the end of the legislative session on Aug. 31, it would advance to Governor Gavin Newsom to sign or veto by Sept. 30.
Re: (Score:2)
OpenAI's business model from day 1 has been spreading doomsday FUD while spending a fortune lobbying for regulation.
Hey man, you gotta pull that ladder up sometime. Just as well do it before you even climbed it yourself! If nothing else, they're setting up some really great barriers to entry by smaller players. Which, as far as "the business" is concerned has to be a win.
A good idea (Score:4, Interesting)
Any time it is potentially ambiguous... AI output should be identified as such. If it's a voice on a phone system, there should be beeps. If it's a video, a disclaimer. If it's text, there should be an attribution.
Re: (Score:2)
Re: (Score:2)
Personally, I'm starting to look forward to how the youngest generation is going to view all media.
There was a time when, "It's a photo, so you know it happened for real," was nearly always true, and that wasn't that long ago. For kids growing up now, there is little difference between raw video, video with filters, real video in cinema, CGI enhanced video in cinema, full CGI video in cinema, and now all the AI convenience and absurdities. They're probably going to grow up to assume that all 3rd party media
Re: (Score:2)
Or, inversely, you get an AI running on a Russian server farm to output your propaganda and then claim "see, no watermark, it must be true!"
Re: (Score:2)
These are getting easily within reach of the average "geek".
And hell, one can still fall back on good old photoshop type editing, if you're good enough...maybe even combining the two....you can generate stuff good enough to fool most people .....
Re: (Score:2)
"People can break the law, so having a law is pointless!"
It's not a great argument.
Re:A good idea: Evil bit (Score:2)
And any time you are hacking or doing some other nefarious thing on the internet, make sure you set the Evil Bit [wikipedia.org] on your packets.
Re: (Score:2)
I'm not talking about stopping that kind of thing, but setting a standard for legal use. We're not that far off from a future where you won't know if you're interacting with a human or not unless you're physically in the same place. I'd like to know.
Re: (Score:2)
What scenarios do you imagine where this would be beneficial?
Re: (Score:2)
Re: A good idea (Score:2)
There's a Reason It Is First (Score:1)
Congress shall make no law respecting an establishment of religion, or prohibiting the free exercise thereof; or abridging the freedom of speech, or of the press; or the right of the people peaceably to assemble, and to petition the Government for a redress of grievances.
-- First Amendment to the Constitution of the United States
Re: (Score:2)
This is California we're talking about. The First Amendment only applies to speech that State approves of. Anything that poses a threat to the apparatus of the State its enablers, and its sycophants is considered "misinformation" and is not protected by the First Amendment.
Re: There's a Reason It Is First (Score:2)
Re: (Score:2)
Have any evidence for that bizarre fantasy?
Regulatory capture (Score:2)
>OpenAI supports regulation that would hamper their competitors and help them maintain their rapidly diminishing edge, now that they've benefited from growing at a time when there was 0 AI regulation
Fuck them, and Sam Altman, so hard
cat and mouse (Score:2)
Re: (Score:2)
Any watermarking is easily removed and easily faked. The tools will be out there for both good and bad actors. Even enacting laws that punish falsifying such watermarks won't stop it. Somebody is going to try to solve it with blockchain provenance, but that will just be a complex mess and not catch on. Truth and falsehood are due for some serious scrutiny; let's hope our growing pains aren't too traumatic. We've got plenty of other issues to deal with that handling this poorly could make a lot worse.
Eventually, we'll have to have our Butlerian Jihad to free us from the "thinking" machines. I know they don't actually think yet, but the spewing of false info at scale is problematic. And the cat is DEFINITELY out of the bag on that front. Unfortunately, nearly every aspect of modern society depends on the machines. Our divorce from the technology we're slowly watching ourselves lose control of may very well be a violent one, simply for the fact that we're totally dependent on them today.
We're smart enough
Mark everything as synthetic (Score:2)
I make art and music. I'll purposely watermark *everything* and ideally, and mark it with keys that make it appear like it was generated by North Korea or other evil empires. That'd be sooooo coool!
The gameplan (Score:2)
AI to remove watermarks (Score:2)
Define AI generated (Score:2)
What counts as AI generated? World is full of tools that enhance and modify images, many of those technologies should be counted as AI based . Are we finally getting means to identify all those photoshopped selfies of celebrities? Thought not.
Back in the days one could patent any known process by applying a "...with a computer" as the methodology. Are we now getting similar distinction between old and new world with rules applying to things done "...with a large transformer model"?
Documentaries (Score:2)
this is backwards (Score:1)
I have already contacted my congressman's office and I have since heard of others voicing similar ideas but for some reason society isn't catching on very quickly...
We cannot succeed by watermarking fake videos. We must do the opposite: We watermark "verified" videos instead.
A "verified" video will have data encoded from the camera hardware into the image/frames that can be used as a checksum to verify that the content hasn't been modified post capture.
If modifications happen post capture, like by YouTube
Transparency is crucial (Score:1)