Speaker 0
0:00 – 0:09
Welcome to CDT's Tech Talks, where we dish on tech and Internet policy while also explaining what these policies mean to our daily lives. I'm Jamal Magby, and it's time to talk tech.
Speaker 1
0:10 – 0:13
Welcome to Tech Talk. Bye. CPT.
Speaker 0
0:14 – 1:20
Today's conversation sits right at the heart of one of the most pressing debates of our time, how to govern artificial intelligence while protecting free speech rights. As AI systems become more powerful and more embedded in our daily lives, from content moderation to generative tools, they're raising complex questions about expression, accountability, and the role of both government and private platforms. Where should we draw the line between regulation and censorship, and how do we ensure innovation doesn't come at the cost of fundamental rights? To dig into these questions, we're joined by two leading voices with thoughtful perspectives. John Coleman, legislative counsel on AI and free expression for FIRE, and Becca Branham, deputy director of the Free Expression Project at CDT. John and Becca, thank you so much for being here. Thanks, Jamal. Glad to be here. Thank you for having us. Yeah. Of course. So to kick us off, when each of you think about AI and free speech, what feels most urgent right now, and where do you see the biggest risks or misunderstandings in the public debate? Maybe I'll I'll start with what I think are some of the biggest misunderstandings,
Speaker 1
1:21 – 2:34
when we're talking about AI, and I think that misunderstanding itself, it is pretty urgent. So So I think one of the biggest misunderstandings in my view is that when we're talking about AI regulation, we're often not really thinking about what's really at stake, when we're thinking about regulating chatbots and their outputs. Just given litigation incentives and the like, when we're thinking about where we assign liability, we're often thinking in terms of the developer or the deployer's liability, the company, and who at the end of the day is gonna have to sign the check, to cover the bill for whoever is harmed. What's more interesting and more urgent in my view is what that regulation and allocation of liability means for the rest of us, the people who actually interact with AI, whether willingly or not. Restrictions on the kind of information that chatbots can provide aren't really just regulatory requirements. There are restrictions on what we as people can read, can learn about, and can create new technology. Too often, the regulatory debate, in my view, collapses into one that assumes people don't have choices or can't be trusted to make them. And that assumption that users lack autonomy, ironically, hands over a lot of power and a lot more power than is safe
Speaker 2
2:35 – 3:18
or warranted both to AI companies and potentially to the government. Becca, you make some really great points. And I would just follow-up by saying that AI is an expressive tool, and the people who use it retain their first amendment rights. It's really important that we get the conversation right about this interaction between this technology and people, and that very much fits into the narrative about how we regulate it. We need to take into consideration people's rights, and that includes the right to receive and share information, the right to speak anonymously, and the right to be free from compelled speech. If we bulldoze those rights, we're giving the government free reign over this technology
Speaker 0
3:18 – 3:34
that impacts us every day. So I I wanna pull that thread a little bit more because there's growing momentum for AI regulation at both the state and federal levels. John, I wanna kick this to you first. Where do you see the line between legitimate regulation and policies
Speaker 2
3:34 – 4:40
that could chill lawful speech? Yeah. Well, let's look at the environment right now. We have over 1,500 state bills that have been introduced this year alone. We have the senate moving federal legislation as we speak. On top of that, the White House is doing its own consideration of AI policy in a lot of different ways. There's a lot going on, and there's a lot of issues at stake from data centers to content based restrictions. Fire is particularly interested where the first amendment applies. That doesn't mean all regulation out there. If we focus on particular areas like access restrictions, content based restrictions, and things like age verification, we have a difficulty drawing a line between what's what's good and what's not. Those types of regulations are constitutionally suspect, and they're going to have an uphill battle in court if they're introduced and enacted. I agree. And and I think what will become increasingly important
Speaker 1
4:40 – 6:31
is drawing a line between what is speech and what is conduct and when folks are using AI for the purposes of communication and when they're using it, for example, through an AI agent to go out into the world and and buy them plane tickets or or reserve them a table at a restaurant for Friday night. Right? There that's a really hard line to draw, but we have seen the Supreme Court increasingly make clear that you can't dress up speech regulations as conduct, and get away or get around the first amendment. And so it's it's a line that's going to be extraordinarily important to draw, but I think it's important to do so because too often I hear from my my friends in the AI safety space concern that if we think about the first amendment, then that means that all regulation is off the table. And that's just simply not true. The first amendment is is important, and I I spend most of my day working to to defend it, in in the tech space, but it it's not absolute. And there are really important spaces where we can focus, whether it's civil rights enforcement, against discriminatory uses of AI, other types of conduct rather that that's regulated, ensuring that there's human oversight and redress for people who are harmed by automated decision making. There there's a lot of ground that can be covered. That doesn't mean that the first amendment isn't implicated at all, but it's a lot different than a regulation that says what you can read, what you can share with your friends, what you're allowed to think about in the privacy of your own home. And and drawing those lines appropriately, I think, will allow us in the tech policy space to both have our cake and eat it too, or we can have access to tools that allow us to create and learn while also not ignoring the very real harms that can come from this technology.
Speaker 2
6:32 – 7:18
Thankfully, this is not the first time courts have had to deal with a new technology. In fact, it's not the first time they've had to deal with a communicative technology. We even have recent decisions that have shown how the courts handle social media regulation, and that we can borrow from that precedent to to understand how courts are going to apply the first amendment to AI. And it's very informative when it does come to issues like output restrictions or even how developers design their AI models. So if you wanna go back even further, you can look at how the court has dealt with video games or even newspapers. It's very interesting to see a lot of the parallels that can be drawn from these past decisions
Speaker 1
7:19 – 8:41
and apply them here. And I think we're gonna see courts willing to do that. And if I can nerd out for just a second on the video games point, I think, I think that's a particularly good, analogy to draw into the AI context. When, there's a Supreme Court case that considered restrictions on kids' access to video games, and it was either the the main opinion or a concurrence by Scalia, that honed in on the interactive nature of that of the video game medium and and what that meant for first amendment protection and that that interactivity was actually quite important and was every bit as protected as a more passive type of communication. And AI chatbots, in particular, are very much of that same kind of technology and have that kind of interactivity that that I think is both important legally, but also really worth protecting. Right? When when you sit down to a chatbot and are requesting information, you are imparting something to the chatbot and then the chatbot's programming is is giving something back to you. But I think it's really important for first amendment purposes to keep in mind that that interactivity matters for doctrinal purposes but also for what it is that we're trying to protect, which is people's autonomy to to engage with the information that they care about. And I think the video game line of cases will actually end up being pretty important in the AI space.
Speaker 2
8:42 – 9:45
Yeah. Interactivity is definitely a good point to raise here. And, Becca, you wrote an article recently that kind of got at a different misconception, going back to the original question that you asked Jamal, about how we should view AI's separation between design and its ultimate output. I've heard criticisms that because there's a gap between the designer's intent and then the ultimate output that corresponds to a user's prompt, that there's no expression at at all there. But, Becca, you raised a lot of great examples in your article. The first one being art by telephone, which was the title of your piece. And I thought that article, just to nerd out a little bit with you, was so great, and it's something that I reference all the time talking to people that we can draw from the art world and see that even when there's a disconnect between the artist and the ultimate work, there's still an expression happening. Yeah. Thanks for raising that. So a bit of a background for folks who are tuning into the podcast.
Speaker 1
9:46 – 11:40
There was a an exhibit held at a museum in Chicago called Art by Telephone, and it was a really interesting sort of modern art exhibition where artists called curators and fabricators at the museum and gave direction for the pieces that they wanted made, and then the fabricators went forth and and created them, Whether it was music that they played or sculptures that were made, the artists obviously gave direction but the fabricators and the people making the art don't have complete knowledge of what the the artists wanted and so there was I guess, a bit of intermediary interpretation that happened between the giving of instructions and the art that was actually created. And it was a really interesting piece, an exhibition because it demonstrated that creativity happened all throughout that process, both in the giving of instructions by the artists themselves, the creation of the art, and the translation of those instructions into the ultimate piece. And when we think about chatbots in particular, you don't have to assign rights to the chatbot itself to recognize that when you give a prompt asking it to to write a what I do now. I I had a baby a few months ago. I ask it to write bedtime stories for me. Right? The chatbot itself is not someone that needs to have rights, and it doesn't have expressive intent itself, but it is a facilitator of my creativity and the creativity I'm asking it to to produce on my behalf. And and I think to to your point, John, art and the art world and that type of direction, I think, is is a good analogy for us to think about in this space. And, also, I think it's a way to to make some of these theoretical tech policy and speech conversations a little more concrete. Sometimes we can forget when it's just typeface on on a screen, and we're talking about human communication at the end of the day. And sometimes art and physical art can make that a little more real for people.
Speaker 0
11:41 – 12:04
I I love this, and I hate the fact that I I have to shift gears, but I I wanna make sure I I wanna make sure we keep pushing forward. So so, Becca, I wanna ask this question to you first because much of the AI ecosystem is driven by private companies. How should we think about their responsibilities when it comes to moderating AI generated content or or setting guardrails on these tools when we know these tools can sometimes,
Speaker 1
12:05 – 13:57
would some would say, cause harm? Right. I think it's really the space that has the most hope for this technology and for keeping people safe is in the design of these products rather than sort of a top down approach from the government telling companies how they have to behave or how they have to design their products. And so there's tons of room here, and we have an entire AI governance lab that is hyper focused on the types of design and and, safety mitigations that are really important to ensure that people can use this technology safely. And I think we can actually look to the social media and the broader Internet ecosystem for how this could potentially work. We've never assumed or we've generally been skeptical of the idea that there is a single way for people to talk to each other on the Internet or a single way for software to be designed, but rather we have trusted that market incentives and sort of the diversity of thought on the Internet will allow people to pursue what is best, what they are looking for, what they are hoping to get out of technology. And so through that diversity of approach and design, people can find what it is they need. There are certain corners of the Internet that I don't care to go to, but I'm glad in some ways that they exist because if they're over in that corner of the Internet, they're not in the corner of the Internet that I occupy. Right? And so that diversity can actually end up keeping people safe in certain things. That being said, there are very clear harms that I think all responsible AI developers should be pursuing, whether it's related to nonconsensual intimate imagery or other clear harms and other clear guardrails that not even just a legal matter, but it's an ethical matter. These companies need to be considering to ensure that people are not victimized, predictably through the technology that they're putting out into the world. Yeah. And we've kind of seen that
Speaker 2
13:57 – 15:28
reaction from companies that have had that problem in the past. I think of Grok, for example, getting into hot water publicly, maybe even legal trouble. I don't know at this point. But I know that they've since fixed it, but they had a problem in the past of their system generating CSAM and that that creating problems. But Becca's right. We can look at the broader universe of content out there and hope for diversity when it comes to all the various types of AI that could be created. Already, we have examples like anthropic, for example, relying on a constitution that structures how its system responds to prompts. On Grock's website, they say their model was based on the Hitchhiker's Guide to the Galaxy. I don't know how that approach necessarily differs from a constitution, but I'm sure there is one. One is more based in fiction, but that could produce interesting results. One on the constitution that's formalized and structural also sounds great too. What we need to make sure is that government regulation doesn't narrow this field to give us only a few AI systems to choose from. The more we have, the more that we can engage in truth seeking that is absolutely important for our self governing society. One thing we haven't touched on that I'd I'd love to hear your thoughts on are biases in AI systems because they often come up in these conversations. John, I'd like to pitch this to you first.
Speaker 0
15:28 – 15:37
How should policymakers and companies address claims of viewpoint discrimination without overcorrecting in ways that limit speech? Well, viewpoint discrimination
Speaker 2
15:38 – 17:39
can be defined in a very simple way. When the government favors one viewpoint over another in its policy, it commits what's known as viewpoint discrimination, and it is presumptively unconstitutional under the first amendment. Courts are very wary of this because of the fact that you're favoring one side over the other. So first off, when we're talking about policymakers, they should be very careful that they're not engaging in viewpoint discrimination. That came up recently in XAI's challenge to the Colorado law where they alleged that Colorado engaged in viewpoint discrimination by favoring ideas like diversity and historical discrimination, redressing historical discrimination over the other types of bias that could come up in AI use. The problem there zooming out is the fact that these risks of bias attached so upstream that it would affect how these systems were created. And just as we talked about in the pre you know, in regard to the previous question, we wanna give this ecosystem as much of a chance to survive and thrive as we can. So we need to be very careful about regulating bias where there's no harm attached yet. There is a place for anti discrimination laws as AI is deployed across various sectors, but we need to be careful about taking it so far upstream that it impacts how these systems are designed. That said, you also mentioned how companies can address it. That's gonna be a real friction point to figure out how best to do that. And I know companies right now are tackling that as their systems are deployed across the board, and we we just need to be careful how they're deployed to ensure that we don't have bias when they're used for certain uses that would be illegal under existing law. Law. Yeah. I I think that's right, and I think it's important to to keep in mind all the different ways that AI can be used and that in certain circumstances,
Speaker 1
17:40 – 20:03
people might not be seeking out a lack of bias. They might actually be seeking out a particular viewpoint. And so I wanna I want to disaggregate bias as it's applied in sort of civil rights law, which I think laws apply to AI and need to apply to AI. But when we're talking about bias in in a broader sense, in a sort of ideological neutrality or and or lack of neutrality type of way, I wanna challenge the idea a little bit that that's always desirable because it assumes that a person is interacting with AI and expecting the AI to sort of reflect truth back to them rather than them engaging with AI in a particular way. We know people use AI for all sorts of things, for for play acting, for for role play, for just seeing what they can get the AI to say back to them because they think it's fun to see what the guardrails will let them do. People interact with AI for in all kinds of different ways. And so I think I I want us to be careful about separating viewpoint from bias and and bias in conduct versus developers and AI systems being able to have a point of view. Again, there there are certain AI systems that I use more readily than others because, in fact, I prefer the the viewpoint and sort of the constitution or the guardrails that they have in place as compared to to some of their competitors. And I think that, in the end, ends up being better for everyone involved because it allows them to access the kind of information that they're looking for. At the same time, though, that makes it all the more important for companies to be clear about what it is they're offering to the public and to their consumers. We don't have the same types of transparency rubrics like the Santa Clara principles that we have in social media as applied to AI yet. And and that's a pretty dangerous thing for consumers because they don't always know what it is that they're signing up for or what it is that they are getting out of an AI system. And so companies companies are starting to but need to do a lot more to make clear what their viewpoints are and what it is that you are getting when you solicit information from these systems. I think that would also go a long way to both, identifying bias and making sure people can can make informed choices while not flattening the types of lawful information that are available to people. So, Becca, what kinds of transparency requirements,
Speaker 0
20:03 – 20:14
if any, makes sense for AI systems that generate or curate speech? Are there risks that transparency mandates could themselves create new problems? So I I'm gonna separate out sort of transparency
Speaker 1
20:15 – 21:49
that systems and companies can take on their own, and then I'll I'll I'll deal with the the first amendment elephant in the room as it applies to transparency requirements. I think all companies have an obligation to be transparent to the public about when a person is interacting with AI and what it is that they're actually offering. Fuling sort of tricking people, deceiving people into thinking they're interacting with real people or that they're getting information that's reliable when it isn't in fact reliable is not a good way to design a product. It's not a good way to run a business. I'd separate that out though from what the government can force AI developers to to to disclose to the public. When you mandate transparency and you mandate companies say things, that implicates the first amendment, and and it's not an absolute bar. There are things you can require companies to be transparent about, but it's a lot narrower of, a list of things that you can force companies to say about their products than you might otherwise think. Because what we've seen is sometimes transparency mandates, particularly transparency around content decisions and sort of ethical and safety judgments that companies are making can end up being a way of controlling content, but through a transparency mandate itself. And so I wish there we could say that transparency would solve all of our problems here. I think a lot of problems can be solved with transparency and transparency norms taken on by the industry. But, again, when the government gets involved, the first amendment has has a lot to say about it, and we have to be really careful about what we're mandating, lest we
Speaker 2
21:49 – 23:54
set these regulations up to fail. We can call it transparency when it comes to companies and compelled speech more often than not when it's when it comes from the government and it's mandated. I agree that there is just a narrow circumstance where the courts have get granted compelled speech a lower judicial standard. But for the most part, compelled speech requirements like disclosures or even disclaimers that you have to affix to AI content will likely get some sort of heightened judicial review, meaning these kinds of regulations are gonna face an uphill battle in court. And if we're talking about labels on speech itself, if you have to include a text on an image that's been generated by AI that says this has been generated by AI or something similar. Studies are starting to show that this might not be an effective way of helping people decide what was actually AI generated in the image. If it was wholly generated, you might have a case for it. But in most cases, people are using AI for all sorts of things, whether it's touch up touch ups on photos or moving things in the background to make it a a a more aesthetically pleasing image. And so if you just have a general label, one size fits all, you're not telling the viewer much about what's changed in the photo or whether it's even deceptive, which I think is oftentimes the the interest that states have to regulate here. Let me back up for a moment. I'm sorry. Another issue is that I think most people interacting with chatbots today know that they're interacting with the chatbot. You have to go to a website like ChatGPT or Character AI, and even they have disclaimers up top. But even if they didn't, the user is going to these chatbot sites. They know that they're interacting with the chatbot. So I don't know that a compelled government mandate to include a disclosure is all that necessary when most users know that they're interacting with the chatbot.
Speaker 0
23:54 – 24:04
So, John, do existing first amendment frameworks adequately address the challenges posed by AI, or are we heading into territory that requires new legal approaches?
Speaker 2
24:05 – 26:57
Let me try to answer this with a story. Two weeks ago, South Korea reported that a wolf had escaped a zoo, and authorities were asking for information or sightings about about the animal. Several tips came in, and I've heard two different stories here. Either someone submitted a deepfake of a wolf walking through the downtown area of the city, or someone had posted on social media a deepfake of this wolf, and authorities saw it. Either way, authorities were thrown off the case. They were searching inside of the city when the wolf was ultimately found well outside of the city limits. And the person who posted or created the steep fake now faces jail time. To answer your question about whether existing law is sufficient to cover an instance like this, well, whether or not AI was used to throw intentionally the the authorities off the trail is probably covered by, you know, a law like obstruction of justice if this happened here in The United States. So regardless of whether AI was used, a tip provided intentionally to police to throw them off the case could potentially be actionable here. Now I don't know if I don't know all the facts in this particular case, and I certainly don't wanna condemn this guy if if the facts are that he provided a tip or that a different person provided the tip having seen it on social media. So not to, assign any guilt here, only to say we do have obstruction of justice here, in most states, if not all, and perhaps providing a false tip intentionally could get you into hot water. On the other hand, posting on social media is a form of protected speech. And if that's the concern that a person engaging on something newsworthy, an animal having escaped the zoo, and authorities are now going after him because either he provided false information as a form of a joke or otherwise or because he was just providing AI and, it it was, you know, illegal to do so. That's probably a little bit more questionable here in The United States. So long story short, I think existing law is going to cover many of the harms that people are are concerned about now. The better approach rather than coming up with a large regulatory scheme to deal with the harms that AI can cause. Let's take a step back, and let's look at existing law first. And if we find any gaps in the law, let's identify them and let's address them specifically rather than sort of the broad approach that I've seen happen
Speaker 1
26:58 – 28:03
in other states and at the federal level. Yeah. I'll just quickly chime in to say that I I think that that's right. And I think right now, we are in a time of what's gonna be a lot of, I guess, I'd call doctrinal translation. Right? We've seen repeatedly, as as John mentioned earlier, the Supreme Court has repeatedly extended First Amendment protection to new media, from film to broadcast, to video games, to the Internet more broadly, and we have every reason to believe that will happen with AI. While that translation's happening, though, there might be misfires that come up where we need to adjust how we think about how the first amendment applies or adjust how we think about AI and and what that means when we're thinking about the first amendment. And so I think we have every reason to believe that our speech values can and should continue to to work and apply in the AI era, but there is a lot of work to be done to understand what these decidedly analog conceptions of of speech and liberty mean when there's so much attenuated responsibility and attenuated
Speaker 0
28:03 – 28:25
control throughout the AI system? For our last question, I want you both to get out your magic wands, if you have them available. Because I would love you guys to tell me if you could shape one principle or safeguard that guides AI policy over the next few years, what would it be and why? And, John, because you're our guest, I'm gonna start with you, and then Becca, would love to hear from you. That we have an affirmation
Speaker 2
28:26 – 28:51
that people have a right to share AI content. They have a right to receive AI content, that they have a clear right to speak anonymously when it comes to AI assisted content, and that people are will be free from compelled speech when they use AI. I think if we got affirmations on all of those issues, we're gonna be in a much better spot in society,
Speaker 1
28:52 – 29:48
and we're gonna be on the leading edge of AI and individual rights. And I think for me, what I what I hope we can keep in mind moving forward and the principle that I hope will anchor everything is that the government cannot and shouldn't be in a position of deciding for us the types of ideas, perspectives, or information that are worth our time. That is the core of the first amendment, and I think we should hold on to that pretty jealously and not hand it over either to the government or either or to to companies as as a monolith to decide what it is that we should be thinking and and should be doing with the this new technology. Whether we like it or not, and some people aren't the biggest fans of AI, AI is being incorporated into a lot of products, which means it's really important for us to protect our ability to to use those tools and that technology in a way that's consistent with our first amendment values and make sure that we can use it to communicate, learn, and think the ways that we want to. That's fantastic.
Speaker 0
29:49 – 30:23
Well, John and Becca, thank you so much for being here today. I really, really appreciate, your time and your thoughtful candor throughout this conversation. Thank you. Thank you. Thank you for listening to Tech Talks, presented by the Center for Democracy and Technology. I've been your host, Jamal Magdi. Tech Talks is edited by Jacob Kaufman and produced by Drew Corby. Check out more of CDT's work by visiting us online at cdt.org and on various social media at sendem tech. That's c e n d e m tech. Thanks for talking tech.