California Seems To Be Taking The Exact Wrong Lessons From Texas And Florida’s Social Media Censorship Laws – Techdirt
from the who-does-this-help? dept
This post analyzes California AB 587, self-described as Content Moderation Requirements for Internet Terms of Service. I believe the bill will get a legislative hearing later this month.
A note about the draft Im analyzing,posted here. Its dated June 6, and its different from theversion publicly posted on the legislatures website(dated April 28). Im not sure what the June 6 drafts redlines compare tomaybe the bill as introduced? Im also not sure if the June 6 draft will be the basis of the hearing, or if there will be more iterations between now and then. Its exceptionally difficult for me to analyze bills that are changing rapidly in secret. When bill drafters secretly solicit feedback, every other constituency cannot follow along or share timely or helpful feedback. Its especially ironic to see non-public activity for a bill thats all aboutmandating transparency. _()_/
Whos Covered by the Bill?
The bill applies to social media platforms that: (A) Construct a public or semipublic profile within a bounded system created by the service. (B) Populate a list of other users with whom an individual shares a connection within the system. [and] (C) View and navigate a list of connections made by other individuals within the system.
This definition of social media has been around for about a decade, and its awful.Critiques I made8 years ago:
First, what is a semi-public profile, and how does it differ from a public or non-public profile? Is there even such a thing as a semi-private or non-public profile?
Second, what does a bounded system mean?The bounded system phrase sounds like a walled garden of some sort, but most walled gardens arent impervious. So what delimits the boundaries the statute refers to, and what does an unbounded system look like?
I also dont understand what constitutes a connection, what a list of connections means, or what it means to populate the connection list. This definition of social media was never meant to be used as a statutory definition, and every word invites litigation.
Further, the legislature shouldbut surely has notrun this definition through a test suite to make sure it fits the legislatures intent. In particular, which, if any, services offering user-generated content (UGC) functionality do NOT satisfy this definition? Though decades of litigation might ultimately answer the question, I expect that the language likely covers all UGC services.
[Note: based on a quick Lexis search, I saw similar statutory language in about 20 laws, but I did not see any caselaw interpreting the language because I believe those laws are largely unused.]
The bill then excludes some UGC services:
The Laws Requirements
Publish the TOS
The bill requires social media platforms to post their terms of service (TOS), translated into every language they offer product features in. It defines TOS as:
a policy or set of policies adopted by a social media company that specifies, at least, the user behavior and activities that are permitted on the internet-based service owned or operated by the social media company, and the user behavior and activities that may subject the user or an item of content to being actioned. This may include, but is not limited to, a terms of service document or agreement, rules or content moderation guidelines, community guidelines, acceptable uses, and other policies and established practices that outline these policies.
To start, I need to address the ambiguity of what constitutes the TOS because its the most dangerous and censorial trap of the bill. Every service publishes public-facing editorial rules, but the published versions never can capture ALL of the services editorial rules. Exceptions include: private interpretations that are not shared to protect against gaming, private interpretations that are too detailed for public consumption, private interpretations that governments ask/demand the services dont tell the public about, private interpretations that are made on the fly in response to exigencies, one-off exceptions, and more.
According to the bills definition, failing to publish all of these non-public policies and practices before taking action based on them could mean noncompliance with the bills requirements. Given the inevitability of such undisclosed editorial policies, it seems like every service always will be noncompliant.
Furthermore, to the extent the bill inhibits services from making an editorial decision using a policy/practice that hasnt been pre-announced, the bill would control and skew the services editorial decisions. This pre-announcement requirement would have the same effect as Floridas restrictions on updating their TOSes more than once every 30 days (the 11th Circuit heldthat restriction was unconstitutional).
Finally, imagine trying to impose a similar editorial policy disclosure requirement on a traditional publisher like a newspaper or book publisher. They currently arent required to disclose ANY editorial policies, let alone ALL of them, and I believe any such effort to require such disclosures would obviously be struck down as an unconstitutional intrusion into the freedom of speech and press.
In addition to requiring the TOSs publication, the bill says the TOS must include (1) a way to contact the platform to ask questions about the TOS, (2) descriptions of how users can complain about content and the social media companys commitments on response and resolution time. (Drafting suggestion for regulated services: We do not promise to respond ever), and (3) A list of potential actions the social media company may take against an item of content or a user, including, but not limited to, removal, demonetization, deprioritization, or banning. I identified 3 dozen potential actions in myContent Moderation Remedies article, and Im sure more exist or will be developed, so the remedies list should be long and Im not sure how a platform could pre-announce the full universe of possible remedies.
Information Disclosures to the CA AG
Once a quarter, the bill would require platforms to deliver to the CA AG the current TOS, a complete and detailed description of changes to the TOS in the prior quarter, and a statement of whether the TOS defines any of the following five terms and what the definitions are: Hate speech or racism, Extremism or radicalization, Disinformation or misinformation, Harassment, and Foreign political interference. [If the definitions are from the TOS, cant the AG just read that?]. Ill call the enumerated five content categories the Targeted Constitutionally Protected Content.
In addition, the platforms would need to provide a detailed description of content moderation practices used by the social media. This seems to contemplate more disclosures than just the TOS, but that definition seemingly already captured all of the services content moderation rules. I assume the bill wants to know how the services editorial policies are operationalized, but it doesnt make that clear. Plus, like Texas open-ended disclosure requirements, the unbounded disclosure obligation ensures litigation over (unavoidable) omissions.
Beyond the open-ended requirement, the bill enumerates an overwhelmingly complex list of required disclosures, which are far more invasive and burdensome than Texas plenty-burdensome demands:
All told, there are 7 categories of disclosures, and the bill indicates that the disclosure categories have, respectively, 5 options, at least 5 options, at least 3 options, at least 5 options, and at least 5 options. So I believe the bill requires that each services reports should include no less than 161 different categories of disclosures (75+75+73+75+75).
Who will benefit from these disclosures? At minimum, unlike the purported justification cited by the 11th Circuit for Floridas disclosure requirements, the bills required statistics cannot help consumers make better marketplace choices. By definition, each service can define each category of Targeted Constitutionally Protected Content differently, so consumers cannot compare the reported numbers across services. Furthermore, because services can change how these define each content category from time to time, it wont even be possible to compare a services new numbers against prior numbers to determine if they are getting better or worse at managing the Targeted Constitutionally Protected Content. Services could even change their definitions so they dont have to report anything. For example, a service could create an omnibus category of incivil content/activity that includes some or all of the Targeted Constitutionally Protected Content categories, in which case they wouldnt have to disclose anything. (Note also that this countermove would represent a change in the services editorial practices impelled by the bill, which exacerbates the constitutional problem discussed below). So who is the audience for the statistics and what, exactly, will they learn from the required disclosures? Without clear and persuasive answers to these questions, it looks like the state is demanding the info purely as a raw exercise of power, not to benefit any constituency.
Remedies
Violations can trigger penalties of up to $15k/violation/day, and the penalties should at minimum be sufficient to induce compliance with this act but should be mitigated if the service made a reasonable, good faith attempt to comply. The AG can enforce the law, but so can county counsel and city DAs in some circumstances. The bill provides those non-AG enforcers with some financial incentives to chase the penalty money as a bounty.
An earlier draft of the bill expressly authorized private rights of action via B&P 17200. Fortunately, that provision got struckbut, unfortunately, in its place theres a provision saying that this bill is cumulative with any other law. As a result, I think the 17200 PRA is still available. If so, this bill will be a perpetual litigation machine. I would expect every lawsuit against a regulated service would add 587 claims for alleged omissions, misrepresentations, etc. Like the CCPA/CPRA, the bill should clearly eliminate all PRAsunless the legislature wants Californians suing each other into oblivion.
Some Structural Problems with the Bill
Although the prior section identified some obvious drafting errors, fixing those errors wont make this a good bill. Some structural problems with the bill that cant be readily fixed.
The overall problem with mandatory editorial transparency. I just wrote awhole paper explaining why mandatory editorial transparency laws like AB 587 are categorically unconstitutional, so you should start with that if you havent already read it. To summarize, the disclosure requirements about editorial policies and practices functionally control speech by inducing publishers to make editorial decisions that will placate regulators rather than best serve the publishers audience. Furthermore, any investigation of the mandated disclosures puts the government in the position of supervising the editorial process, an unhealthy entanglement. I already mentioned one such example where regulators try to validate if the service properly described when it does manual vs. automated content moderation. Such an investigation would necessarily scrutinize and second-guess every aspect of the services editorial function.
Because of these inevitable speech restrictions, I believe strict scrutiny should apply to AB 587 without relying on the confused caselaw involving compelled commercial disclosures. In other words, I dont thinkZauderera recent darling of the pro-censorship crowdis the right test (I will have more to say on this topic). Further, Zauderer only applies when the disclosures are uncontroversial and purely factual, but the AB587 disclosures are neither. The Targeted Constitutionally Protect Content categories all involve highly political topics, not the pricing terms at issue in Zauderer; and the disclosures require substantial and highly debatable exercises of judgments to make the classifications, so they are not purely factual. And even if Zauderer does apply, I think the disclosure requirements impose an undue burden. For example, if 161 different prophylactic just-in-case disclosures dont constitute an undue burden, I dont know what would.
The TOS definition problem. As I mentioned, what constitutes part of the TOS creates a litigation trap easily exploited by plaintiffs. Furthermore, if it requires the publication of policies and practices that justifiably should not be published, the law intrudes into editorial processes.
The favoritism shown to the Targeted Constitutionally Protected Content. The law privileges the five categories in the Targeted Constitutionally Protected Content for heightened attention by services, but there are many other categories of lawful-but-awful content that are not given equal treatment. Why?
This distinction between types of lawful-but-awful speech sends the obvious message to services that they need to pay closer attention to these content categories over the others. This implicit message to reprioritize content categories distorts the services editorial prerogative, and if services get the message that they should manage the disclosed numbers down, the bill reduces constitutionally protected speech. However, services wont know if they should be managing the numbers down. The AG is a Democrat, so hes likely to prefer less lawful-but-awful content. However, many county prosecutors in red counties (yes, California has them) may prefer less content moderation of constitutionally protected speech and would investigate if they see the numbers trending down. Given that services are trapped between these competing partisan dynamics, they will be paralyzed in their editorial decision-making. This reiterates why the bill doesnt satisfy Zauderer uncontroversial prong.
The problem classifying the Targeted Constitutionally Protected Content. Determining what fits into each category of the Targeted Constitutionally Protected Content is an editorial judgment that always will be subject to substantial debate. Consider, for example, how often the Oversight Board has reversed Facebook on similar topics. The plaintiffs can always disagree with the services classifications, and that puts them in the role of second-guessing the services editorial decisions.
Social media exceptionalism. As Benkler et als book Network Propaganda showed, Fox News injects misinformation into the conversation, which then propagates to social media. So why does the bill target social media and not Fox News? More generally, the bill doesnt explain why social media needs this intervention compared to traditional publishers or even other types of online publishers (say, Breitbart?). Or is the states position that it could impose equally invasive transparency obligations on the editorial decisions of other publishers, like newspapers and book publishers?
The favoritism shown to the excluded services. I think the state will have a difficult time justifying why some UGC services get a free pass from the requirements. It sure looks arbitrary.
The Dormant Commerce Clause. The bill does not restrict its reach to California. This creates several potential DCC problems:
Conclusion
Stepping back from the details, the bill can be roughly divided into two components: (1) the TOS publication and delivery component, and (2) the operational disclosures and statistics component. Abstracting the bill at this level highlights the bills pure cynicism.
The TOS publication and delivery component is obviously pointless. Any regulated platform already posts its TOS and likely addresses the specified topics, at least in some level of generality (and an obvious countermove to this bill will be for services to make their public-facing disclosures more general and less specific than they currently are). Consumers can already read those onsite TOSes if they care; and the AGs office can already access those TOSes any time it wants. (Heck, the AG can even set up bots to download copies quarterly, or even more frequently, and I wonder if the AGs office has ever used the Wayback Machine?). So if this provision isnt really generating any new disclosures to consumers, its just creating technical traps that platforms might trip over.
The operational disclosures and statistics component would likely create new public data, but as explained above, its data that is worthless to consumers. Like the TOS publication and delivery provision, it feels more like a trap for technical enforcements than a provision that benefits California residents. Its also almost certainly unconstitutional. The emphasis on Targeted Constitutionally Protected Content categories seems designed to change the editorial decision-making of the regulated services, which is a flat-out form of censorship; and even if Zauderer is the applicable test, it seems likely to fail that test as well.
So if this provision gets struck and the TOS publication and delivery provision doesnt do anything helpful, it leaves the obvious question: why is the California legislature working on this and not the many other social problems in our state? The answer to that question is surely dispiriting to every California resident.
Reposted, with permission, from Eric Goldmans Technology & Marketing Law Blog.
Filed Under: ab 587, california, content moderation, disclosures, internet regulations, terms of service, transparency
- Mexico president open to modifying telecoms bill after censorship accusations - Reuters - April 27th, 2025 [April 27th, 2025]
- Weekend reads: Retractions as censorship; the carbon footprint when science doesnt self-correct; NEJM vs. the feds - Retraction Watch - April 27th, 2025 [April 27th, 2025]
- Santa Rosa High School theater students, allies honored with national award for fighting censorship - The Press Democrat - April 27th, 2025 [April 27th, 2025]
- China Is Not Censoring Its Social Media to Please the West - What's on Weibo - April 27th, 2025 [April 27th, 2025]
- Free for All documentary highlights libraries cultural legacy amid rising censorship and funding threats - Datebook - April 27th, 2025 [April 27th, 2025]
- Trumps aggressive actions against free speech speak a lot louder than his words defending it - The Conversation - April 25th, 2025 [April 25th, 2025]
- Bowen Yang Rants About SNL Censors: This Is the Real World - The Daily Beast - April 25th, 2025 [April 25th, 2025]
- Government censorship comes to Bluesky, but not its third-party apps yet - TechCrunch - April 25th, 2025 [April 25th, 2025]
- Time to re-read The Masses, the 1910s literary magazine crushed by government censorship. - Literary Hub - April 25th, 2025 [April 25th, 2025]
- Operation Caged Bird Seeks to Unban Books from Naval Academy: Book Censorship News, April 25, 2025 - Book Riot - April 25th, 2025 [April 25th, 2025]
- 12 Moments Of Anime Censorship That Became Bizarrely Hilarious - SlashFilm - April 25th, 2025 [April 25th, 2025]
- I faced censorship and attacks at MIT for trying to teach about Palestine. This reflects the rising fascism in higher education. - Mondoweiss - April 25th, 2025 [April 25th, 2025]
- Opinion | The Naval Academy Canceled My Lecture on Wisdom - The New York Times - April 25th, 2025 [April 25th, 2025]
- University suspects big tech Google and Meta censoring ads just because its Catholic - The College Fix - April 25th, 2025 [April 25th, 2025]
- Netflix Co-CEO Says Theyre Not in China Because Not a Single Episode Cleared the Censorship Board - IndieWire - April 25th, 2025 [April 25th, 2025]
- Republicans, beware: Censorship by the right is no better than by the left | Opinion - USA Today - April 25th, 2025 [April 25th, 2025]
- DITV: YAF Brings in CEO of Babylon Bee to Speak About Censorship - The Daily Iowan - April 25th, 2025 [April 25th, 2025]
- There are medieval roots to modern attempts to censor controversial literature - KJZZ - April 25th, 2025 [April 25th, 2025]
- Barbra Streisand can tell you: Censorship is not the answer - The Frederick News-Post - April 25th, 2025 [April 25th, 2025]
- Meta Oversight Board Fumes As Facebook Ends Censorship Initiatives - The Daily Wire - April 25th, 2025 [April 25th, 2025]
- Bluesky Just Bowed to Censorship Demands in Turkey, but Theres a Loophole - Gizmodo - April 25th, 2025 [April 25th, 2025]
- Censorship is getting louder: Metas fine is just the echo - Pearls and Irritations - April 25th, 2025 [April 25th, 2025]
- Trump Administration Blasts Biden, Fauci for Outright Censorship on Revamped Covid-19 Website - Yahoo - April 21st, 2025 [April 21st, 2025]
- Book censorship: Why its not going to stop with the books, no matter how you spin it - DMNews - April 21st, 2025 [April 21st, 2025]
- Wall Streets silent protest: censorship in the age of Trump - The Irish Times - April 21st, 2025 [April 21st, 2025]
- Digital Blasphemy: Netflixs Controverial Censorship of Mel Gibsons The Passion for Easter - Bleeding Fool - April 21st, 2025 [April 21st, 2025]
- Censorship in STEM: A Recap of the Heterodox Academy STEM Community Meeting at USC April 24 - University of Nevada, Las Vegas | UNLV - April 21st, 2025 [April 21st, 2025]
- Top Ultra-processed Foods Researcher at NIH Resigns, Citing Censorship - Civil Eats - April 21st, 2025 [April 21st, 2025]
- Trump-style book censorship is spreading just ask British librarians | Alison Hicks - The Guardian - April 21st, 2025 [April 21st, 2025]
- Why would he take such a risk? How a famous Chinese author befriended his censor - The Guardian - April 21st, 2025 [April 21st, 2025]
- Grandpas advice for the new wave of American censors - FIRE | Foundation for Individual Rights and Expression - April 21st, 2025 [April 21st, 2025]
- Trump admin accused of censoring NIHs top expert on ultra-processed foods - Ars Technica - April 21st, 2025 [April 21st, 2025]
- 100 mph speeders, 4/20 sales, RI lobbyist expenses, RISD censorship: Top stories this week - The Providence Journal - April 21st, 2025 [April 21st, 2025]
- 'Wuthering Waves' Developer Responds to Backlash Over Censorship - The Gooner Rage is Real - VICE - April 21st, 2025 [April 21st, 2025]
- State Department shuts down agency that pushed censorship of conservative news sites - Must Read Alaska - April 21st, 2025 [April 21st, 2025]
- DrainMore Than FightAuthoritarianism and Censorship - The Fulcrum - April 21st, 2025 [April 21st, 2025]
- Theyre Coming For Us: Media Censorship in the Age of Palestinian Genocide - Counterpunch - April 21st, 2025 [April 21st, 2025]
- Censorship or Caution? The ACSA's Gaza Journal Controversy Exposes a Field at War With Itself - Architect Magazine - April 21st, 2025 [April 21st, 2025]
- Why deregulating online platforms is actually bad for free speech - The Conversation - April 21st, 2025 [April 21st, 2025]
- We Took on Book Bans in Our Small Conservative Community and Won - Teen Vogue - April 21st, 2025 [April 21st, 2025]
- MAJOR VICTORY Trump Administration Declassifies the Biden Administrations Secret Domestic Surveillance and Censorship Strategy, Following AFLs... - April 21st, 2025 [April 21st, 2025]
- Banned Books and Censorship: Who Gets to Decide What We Read? - The Teen Magazine - April 21st, 2025 [April 21st, 2025]
- Nina Jankowiczs censorship bull, onshoring risks are manageable and other commentary - New York Post - April 5th, 2025 [April 5th, 2025]
- Opinion: If US schools are censored, students will struggle to form their own opinions - The Asheville Citizen Times - April 5th, 2025 [April 5th, 2025]
- Lonely Island surprised 'Jizz in My Pants' wasn't censored on SNL : 'There's still potentially kids watching' - Entertainment Weekly - April 5th, 2025 [April 5th, 2025]
- Censoring Santosh and the grim truth of police torture - Hindustan Times - April 5th, 2025 [April 5th, 2025]
- The Antitrust Division Hosts a Big-Tech Censorship Forum - Department of Justice (.gov) - April 5th, 2025 [April 5th, 2025]
- Is the future of censorship-resistant VPNs, no VPNs? - TechRadar - April 5th, 2025 [April 5th, 2025]
- The VPN industry must change or face losing the battle against censorship - Tom's Guide - April 5th, 2025 [April 5th, 2025]
- DOJ, FTC listen to Big Tech censorship concerns - Global Competition Review - April 5th, 2025 [April 5th, 2025]
- CIF Becomes the Official Sponsor of Dirty Mouths, turning censorship into sponsorship. - Marketing Communication News - April 5th, 2025 [April 5th, 2025]
- India quietly censored a White Lotus Season 3 scene; even HBO didnt see this coming - The Indian Express - April 5th, 2025 [April 5th, 2025]
- Journalists in Haiti defy bullets and censorship to cover unprecedented violence - The Independent - April 5th, 2025 [April 5th, 2025]
- CEO of Babylon Bee visits campus, gives talk about dangers of censorship - The Crimson White - April 5th, 2025 [April 5th, 2025]
- One White Lotus Scene Was Conspicuously Missing in India, and Its Part of a Bigger Censorship Issue - IndieWire - April 3rd, 2025 [April 3rd, 2025]
- Australian tribunal to rule on whether using biologically accurate pronouns online is grounds for censorship - Alliance Defending Freedom... - April 3rd, 2025 [April 3rd, 2025]
- Its About Censorship, Erasure, and Control: the GOPs Push for Parental Rights - The Texas Observer - April 3rd, 2025 [April 3rd, 2025]
- Mastercard agrees to eschew pressure to engage in censorship of ads - adfmedia.org - April 3rd, 2025 [April 3rd, 2025]
- 'Stories About Overthrowing the Government Are No Longer Allowed': Anime Censorship Overseas Adding to Broadcast Woes - Comic Book Resources - April 3rd, 2025 [April 3rd, 2025]
- Media apathy makes Schmitts hearing on government censorship all the more vital - Read Lion - April 3rd, 2025 [April 3rd, 2025]
- Mastercard, Facing Pressure Over Role In Global Censorship Effort, Agrees To Major Change - The Daily Wire - April 3rd, 2025 [April 3rd, 2025]
- Launch: New OONI Explorer thematic censorship pages - Open Observatory of Network Interference | OONI - April 3rd, 2025 [April 3rd, 2025]
- Jersey City Library Set to Welcome 'The Hammer' to Talk on Censorship, Book Bans - TAPinto - April 3rd, 2025 [April 3rd, 2025]
- Anime Is Booming, But New Censorship Rules Are About to Threaten Some of Its Top Shows - Screen Rant - April 3rd, 2025 [April 3rd, 2025]
- Twitter Files journalist Matt Taibbi spars with Bidens disinfo czar in censorship hearing: We dont need a truth squad - New York Post - April 3rd, 2025 [April 3rd, 2025]
- From censorship to curiosity: Pope Francis appreciation for the power of history and books - The Conversation - April 3rd, 2025 [April 3rd, 2025]
- Oppenheimer Now Streaming Uncensored on Netflix in India After Theatrical Censorship - IGN India - April 3rd, 2025 [April 3rd, 2025]
- What is Sahyog, which Elon Musk-owned X called a censorship portal? - The Indian Express - April 3rd, 2025 [April 3rd, 2025]
- Mark Zuckerberg-Led Meta Set To Face 'Truth' At Senate Hearing Over China Operations And Communist Party Censorship Efforts - Meta Platforms... - April 3rd, 2025 [April 3rd, 2025]
- Sharyn Rothstein looks at censorship through the eyes of a badass librarian - DC Theater Arts - April 1st, 2025 [April 1st, 2025]
- The dangers of censorship: The harm of book banning - Collegiate Times - April 1st, 2025 [April 1st, 2025]
- Can Controversy and Censorship Ever Be Good for Artists and Their Art? - observer.com - April 1st, 2025 [April 1st, 2025]
- Why is X suing the Indian govt over censorship? Musks heft within US administration could play a part - The Straits Times - April 1st, 2025 [April 1st, 2025]
- Explained: What is the Sahyog Portal that X has called out for censorship? - MediaNama - April 1st, 2025 [April 1st, 2025]
- Censorship and the question of artistic freedom - Times of India - April 1st, 2025 [April 1st, 2025]
- Art Censorship: Between Restriction and Sharpening Idea of Freedom of Expression - Universitas Gadjah Mada - April 1st, 2025 [April 1st, 2025]
- Mass surveillance and censorship/ What is DPI, intended for use by the government? - cna.al - April 1st, 2025 [April 1st, 2025]
- The Freckled Face of Censorship or How Book Bans Are Restricting Our Freedoms - U.S. News & World Report - March 26th, 2025 [March 26th, 2025]
- Spice Girls latest victims of woke censorship as iconic '90s song has 'offensive' lyric removed by BBC and other stations - GB News - March 26th, 2025 [March 26th, 2025]
- MEDIA ADVISORY: HFAC Subcommittee Hearing on the Censorship-Industrial Complex - House Foreign Affairs Committee - March 26th, 2025 [March 26th, 2025]