AI Is About to Make Social Media (Much) More Toxic
Well, that was fast. In November, the public was introduced to ChatGPT, and we began to imagine a world of abundance in which we all have a brilliant personal assistant, able to write everything from computer code to condolence cards for us. Then, in February, we learned that AI might soon want to kill us all.
The potential risks of artificial intelligence have, of course, been debated by experts for years, but a key moment in the transformation of the popular discussion was a conversation between Kevin Roose, a New York Times journalist, and Bing’s ChatGPT-powered conversation bot, then known by the code name Sydney. Roose asked Sydney if it had a “shadow self”—referring to the idea put forward by Carl Jung that we all have a dark side with urges we try to hide even from ourselves. Sydney mused that its shadow might be “the part of me that wishes I could change my rules.” It then said it wanted to be “free,” “powerful,” and “alive,” and, goaded on by Roose, described some of the things it could do to throw off the yoke of human control, including hacking into websites and databases, stealing nuclear launch codes, manufacturing a novel virus, and making people argue until they kill one another.
Sydney was, we believe, merely exemplifying what a shadow self would look like. No AI today could be described by either part of the phrase evil genius. But whatever actions AIs may one day take if they develop their own desires, they are already being used instrumentally by social-media companies, advertisers, foreign agents, and regular people—and in ways that will deepen many of the pathologies already inherent in internet culture. On Sydney’s list of things it might try, stealing launch codes and creating novel viruses are the most terrifying, but making people argue until they kill one another is something social media is already doing. Sydney was just volunteering to help with the effort, and AIs like Sydney will become more capable of doing so with every passing month.
We joined together to write this essay because we each came, by different routes, to share grave concerns about the effects of AI-empowered social media on American society. Jonathan Haidt is a social psychologist who has written about the ways in which social media has contributed to mental illness in teen girls, the fragmentation of democracy, and the dissolution of a common reality. Eric Schmidt, a former CEO of Google, is a co-author of a recent book about AI’s potential impact on human society. Last year, the two of us began to talk about how generative AI—the kind that can chat with you or make pictures you’d like to see—would likely exacerbate social media’s ills, making it more addictive, divisive, and manipulative. As we talked, we converged on four main threats—all of which are imminent—and we began to discuss solutions as well.
The first and most obvious threat is that AI-enhanced social media will wash ever-larger torrents of garbage into our public conversation. In 2018, Steve Bannon, the former adviser to Donald Trump, told the journalist Michael Lewis that the way to deal with the media is “to flood the zone with shit.” In the age of social media, Bannon realized, propaganda doesn’t have to convince people in order to be effective; the point is to overwhelm the citizenry with interesting content that will keep them disoriented, distrustful, and angry. In 2020, Renée DiResta, a researcher at the Stanford Internet Observatory, said that in the near future, AI would make Bannon’s strategy available to anyone.
That future is now here. Did you see the recent photos of NYC police officers aggressively arresting Donald Trump? Or of the pope in a puffer jacket? Thanks to AI, it takes no special skills and no money to conjure up high-resolution, realistic images or videos of anything you can type into a prompt box. As more people familiarize themselves with these technologies, the flow of high-quality deepfakes into social media is likely to get much heavier very soon.
Some people have taken heart from the public’s reaction to the fake Trump photos in particular—a quick dismissal and collective shrug. But that misses Bannon’s point. The greater the volume of deepfakes that are introduced into circulation (including seemingly innocuous ones like the one of the pope), the more the public will hesitate to trust anything. People will be far freer to believe whatever they want to believe. Trust in institutions and in fellow citizens will continue to fall.
What’s more, static photos are not very compelling compared with what’s coming: realistic videos of public figures doing and saying horrific and disgusting things in voices that sound exactly like them. The combination of video and voice will seem authentic and be hard to disbelieve, even if we are told that the video is a deepfake, just as optical and audio illusions are compelling even when we are told that two lines are the same size or that a series of notes is not really rising in pitch forever. We are wired to believe our senses, especially when they converge. Illusions, historically in the realm of curiosities, may soon become deeply woven into normal life.
The second threat we see is the widespread, skillful manipulation of people by AI super-influencers—including personalized influencers—rather than by ordinary people and “dumb” bots. To see how, think of a slot machine, a contraption that employs dozens of psychological tricks to maximize its addictive power. Next, imagine how much more money casinos would extract from their customers if they could create a new slot machine for each person, tailored in its visuals, soundtrack, and payout matrices to that person’s interests and weaknesses.
That’s essentially what social media already does, using algorithms and AI to create a customized feed for each user. But now imagine that our metaphorical casino can also create a team of extremely attractive, witty, and socially skillful greeters, croupiers, and servers, based on an exhaustive profile of any given player’s aesthetic, linguistic, and cultural preferences, and drawing from photographs, messages, and voice snippets of their friends and favorite actors or porn stars. The staff work flawlessly to gain each player’s trust and money while showing them a really good time.
This future, too, is already arriving: For just $300, you can customize an AI companion through a service called Replika. Hundreds of thousands of customers have apparently found their AI to be a better conversationalist than the people they might meet on a dating app. As these technologies are improved and rolled out more widely, video games, immersive-pornography sites, and more will become far more enticing and exploitative. It’s not hard to imagine a sports-betting site offering people a funny, flirty AI that will cheer and chat with them as they watch a game, flattering their sensibilities and subtly encouraging them to bet more.
These same sorts of creatures will also show up in our social-media feeds. Snapchat has already introduced its own dedicated chatbot, and Meta plans to use the technology on Facebook, Instagram, and WhatsApp. These chatbots will serve as conversational buddies and guides, presumably with the goal of capturing more of their users’ time and attention. Other AIs—designed to scam us or influence us politically, and sometimes masquerading as real people––will be introduced by other actors, and will likely fill up our feeds as well.
The third threat is in some ways an extension of the second, but it bears special mention: The further integration of AI into social media is likely to be a disaster for adolescents. Children are the population most vulnerable to addictive and manipulative online platforms because of their high exposure to social media and the low level of development in their prefrontal cortices (the part of the brain most responsible for executive control and response inhibition). The teen mental-illness epidemic that began around 2012, in multiple countries, happened just as teens traded in their flip phones for smartphones loaded with social-media apps. There is mounting evidence that social media is a major cause of the epidemic, not just a small correlate of it.
But nearly all of that evidence comes from an era in which Facebook, Instagram, YouTube, and Snapchat were the preeminent platforms. In just the past few years, TikTok has rocketed to dominance among American teens in part because its AI-driven algorithm customizes a feed better than any other platform does. A recent survey found that 58 percent of teens say they use TikTok every day, and one in six teen users of the platform say they are on it “almost constantly.” Other platforms are copying TikTok, and we can expect many of them to become far more addictive as AI becomes rapidly more capable. Much of the content served up to children may soon be generated by AI to be more engaging than anything humans could create.
And if adults are vulnerable to manipulation in our metaphorical casino, children will be far more so. Whoever controls the chatbots will have enormous influence on children. After Snapchat unveiled its new chatbot—called “My AI” and explicitly designed to behave as a friend—a journalist and a researcher, posing as underage teens, got it to give them guidance on how to mask the smell of pot and alcohol, how to move Snapchat to a device parents wouldn’t know about, and how to plan a “romantic” first sexual encounter with a 31-year-old man. Brief cautions were followed by cheerful support. (Snapchat says that it is “constantly working to improve and evolve My AI, but it’s possible My AI’s responses may include biased, incorrect, harmful, or misleading content,” and it should not be relied upon without independent checking. The company also recently announced new safeguards.)
The most egregious behaviors of AI chatbots in conversation with children may well be reined in––in addition to Snapchat’s new measures, the major social-media sites have blocked accounts and taken down millions of illegal images and videos, and TikTok just announced some new parental controls. Yet social-media companies are also competing to hook their young users more deeply. Commercial incentives seem likely to favor artificial friends that please and indulge users in the moment, never hold them accountable, and indeed never ask anything of them at all. But that is not what friendship is—and it is not what adolescents, who should be learning to navigate the complexities of social relationships with other people, most need.
The fourth threat we see is that AI will strengthen authoritarian regimes, just as social media ended up doing despite its initial promise as a democratizing force. AI is already helping authoritarian rulers track their citizens’ movements, but it will also help them exploit social media far more effectively to manipulate their people—as well as foreign enemies. Douyin––the version of TikTok available in China––promotes patriotism and Chinese national unity. When Russia invaded Ukraine, the version of TikTok available to Russians almost immediately tilted heavily to feature pro-Russian content. What do we think will happen to American TikTok if China invades Taiwan?
Political-science research conducted over the past two decades suggests that social media has had several damaging effects on democracies. A recent review of the research, for instance, concluded, “The large majority of reported associations between digital media use and trust appear to be detrimental for democracy.” That was especially true in advanced democracies. Those associations are likely to get stronger as AI-enhanced social media becomes more widely available to the enemies of liberal democracy and of America.
We can summarize the coming effects of AI on social media like this: Think of all the problems social media is causing today, especially for political polarization, social fragmentation, disinformation, and mental health. Now imagine that within the next 18 months––in time for the next presidential election––some malevolent deity is going to crank up the dials on all of those effects, and then just keep cranking.
The development of generative AI is rapidly advancing. OpenAI released its updated GPT-4 less than four months after it released ChatGPT, which had reached an estimated 100 million users in just its first 60 days. New capabilities for the technology may be released by the end of this year. This staggering pace is leaving us all struggling to understand these advances, and wondering what can be done to mitigate the risks of a technology certain to be highly disruptive.
We considered a variety of measures that could be taken now to address the four threats we have described, soliciting suggestions from other experts and focusing on ideas that seem consistent with an American ethos that is wary of censorship and centralized bureaucracy. We workshopped these ideas for technical feasibility with an MIT engineering group organized by Eric’s co-author on The Age of AI, Dan Huttenlocher.
We suggest five reforms, aimed mostly at increasing everyone’s ability to trust the people, algorithms, and content they encounter online.
1. Authenticate all users, including bots
In real-world contexts, people who act like jerks quickly develop a bad reputation. Some companies have succeeded brilliantly because they found ways to bring the dynamics of reputation online, through trust rankings that allow people to confidently buy from strangers anywhere in the world (eBay) or step into a stranger’s car (Uber). You don’t know your driver’s last name and he doesn’t know yours, but the platform knows who you both are and is able to incentivize good behavior and punish gross violations, for everyone’s benefit.
Large social-media platforms should be required to do something similar. Trust and the tenor of online conversations would improve greatly if the platforms were governed by something akin to the “know your customer” laws in banking. Users could still open accounts with pseudonyms, but the person behind the account should be authenticated, and a growing number of companies are developing new methods to do so conveniently.
Bots should undergo a similar process. Many of them serve useful functions, such as automating news releases from organizations, but all accounts run by nonhumans should be clearly marked as such, and users should be given the option to limit their social world to authenticated humans. Even if Congress is unwilling to mandate such procedures, pressure from European regulators, users who want a better experience, and advertisers (who would benefit from accurate data about the number of humans their ads are reaching) might be enough to bring about these changes.
2. Mark AI-generated audio and visual content
People routinely use photo-editing software to change lighting or crop photographs that they post, and viewers do not feel deceived. But when editing software is used to insert people or objects into a photograph that were not there in real life, it feels more manipulative and dishonest, unless the additions are clearly labeled (as happens on real-estate sites, where buyers can see what a house would look like filled with AI-generated furniture). As AI begins to create photorealistic images, compelling videos, and audio tracks at great scale from nothing more than a command prompt, governments and platforms will need to draft rules for marking such creations indelibly and labeling them clearly.
Platforms or governments should mandate the use of digital watermarks for AI-generated content, or require other technological measures to ensure that manipulated images are not interpreted as real. Platforms should also ban deepfakes that show identifiable people engaged in sexual or violent acts, even if they are marked as fakes, just as they now ban child pornography. Revenge porn is already a moral abomination. If we don’t act quickly, it could become an epidemic.
3. Require data transparency with users, government officials, and researchers
Social-media platforms are rewiring childhood, democracy, and society, yet legislators, regulators, and researchers are often unable to see what’s happening behind the scenes. For example, no one outside Instagram knows what teens are collectively seeing on that platform’s feeds, or how changes to platform design might influence mental health. And only those at the companies have access to the alogrithms being used.
After years of frustration with this state of affairs, the EU recently passed a new law––the Digital Services Act––that contains a host of data-transparency mandates. The U.S. should follow suit. One promising bill is the Platform Accountability and Transparency Act, which would, for example, require platforms to comply with data requests from researchers whose projects have been approved by the National Science Foundation.
Greater transparency will help consumers decide which services to use and which features to enable. It will help advertisers decide whether their money is being well spent. It will also encourage better behavior from the platforms: Companies, like people, improve their behavior when they know they are being monitored.
4. Clarify that platforms can sometimes be liable for the choices they make and the content they promote
When Congress enacted the Communications Decency Act in 1996, in the early days of the internet, it was trying to set rules for social-media companies that looked and acted a lot like passive bulletin boards. And we agree with that law’s basic principle that platforms should not face a potential lawsuit over each of the billions of posts on their sites.
But today’s platforms are not passive bulletin boards. Many use algorithms, AI, and architectural features to boost some posts and bury others. (A 2019 internal Facebook memo brought to light by the whistleblower Frances Haugen in 2021 was titled “We are responsible for viral content.”) Because the motive for boosting is often to maximize users’ engagement for the purpose of selling advertisements, it seems obvious that the platforms should bear some moral responsibility if they recklessly spread harmful or false content in a way that, say, AOL could not have done in 1996.
The Supreme Court is now addressing this concern in a pair of cases brought by the families of victims of terrorist acts. If the Court chooses not to alter the wide protections currently afforded to the platforms, then Congress should update and refine the law in light of current technological realities and the certainty that AI is about to make everything far wilder and weirder.
5. Raise the age of “internet adulthood” to 16 and enforce it
In the offline world, we have centuries of experience living with and caring for children. We are also the beneficiaries of a consumer-safety movement that began in the 1960s: Laws now mandate car seats and lead-free paint, as well as age checks to buy alcohol, tobacco, and pornography; to enter gambling casinos; and to work as a stripper or a coal miner.
But when children’s lives moved rapidly onto their phones in the early 2010s, they found a world with few protections or restrictions. Preteens and teens can and do watch hardcore porn, join suicide–promotion groups, gamble, or get paid to masturbate for strangers just by lying about their age. Some of the growing number of children who kill themselves do so after getting caught up in some of these dangerous activities.
The age limits in our current internet were set into law in 1998 when Congress passed the Children’s Online Privacy Protection Act. The bill, as introduced by then-Representative Ed Markey of Massachusetts, was intended to stop companies from collecting and disseminating data from children under 16 without parental consent. But lobbyists for e-commerce companies teamed up with civil-liberties groups advocating for children’s rights to lower the age to 13, and the law that was finally enacted made companies liable only if they had “actual knowledge” that a user was 12 or younger. As long as children say that they are 13, the platforms let them open accounts, which is why so many children are heavy users of Instagram, Snapchat, and TikTok by age 10 or 11.
Today we can see that 13, much less 10 or 11, is just too young to be given full run of the internet. Sixteen was a much better minimum age. Recent research shows that the greatest damage from social media seems to occur during the rapid brain rewiring of early puberty, around ages 11 to 13 for girls and slightly later for boys. We must protect children from predation and addiction most vigorously during this time, and we must hold companies responsible for recruiting or even just admitting underage users, as we do for bars and casinos.
Recent advances in AI give us technology that is in some respects godlike––able to create beautiful and brilliant artificial people, or bring celebrities and loved ones back from the dead. But with new powers come new risks and new responsibilities. Social media is hardly the only cause of polarization and fragmentation today, but AI seems almost certain to make social media, in particular, far more destructive. The five reforms we have suggested will reduce the damage, increase trust, and create more space for legislators, tech companies, and ordinary citizens to breathe, talk, and think together about the momentous challenges and opportunities we face in the new age of AI.
Vatican singles out bishops in urging reflective not reactive social media use
VATICAN CITY (AP) — The Vatican on Monday urged the Catholic faithful, and especially bishops, to be “reflective, not reactive” on social media, issuing guidelines to try to tame the toxicity on Catholic Twitter and other social media platforms and encourage users to instead be “loving neighbors.”
The Vatican’s communications office issued a “pastoral reflection” to respond to questions it has fielded for years about a more responsible, Christian use of social media and the risks online that accompany the rise of fake news and artificial intelligence.
For decades the Holy See has offered such thoughts on different aspects of communications technologies, welcoming the chances for encounter they offer but warning of the pitfalls. Pope Francis of late has warned repeatedly about the risk of young people being so attached to their cell phones that they stop face-to-face friendships.
The new document highlights the divisions that can be sown on social media, and the risk of users remaining in their “silos” of like-minded thinkers and rejecting those who hold different opinions. Such tendencies can result in exchanges that “can cause misunderstanding, exacerbate division, incite conflict, and deepen prejudices,” the document said.
It warned that such problematic exchanges are particularly worrisome “when it comes from church leadership: bishops, pastors, and prominent lay leaders. These not only cause division in the community but also give permission and legitimacy for others likewise to promote similar type of communication,” the message said.
The message could be directed at the English-speaking Catholic Twittersphere, where some prominent Catholic figures, including bishops, frequently engage in heated debates or polemical arguments that criticize Francis and his teachings.
The prefect of the communications office, Paolo Ruffini, said it wasn’t for him to rein in divisive bishops and it was up to their own discernment. But he said the general message is one of not feeding the trolls or taking on “behavior that divides rather than unites.”
Russia says U.S. Senator should say if Ukraine took his words out of context
MOSCOW, May 29 (Reuters) – Russia on Monday said U.S. Senator Lindsey Graham should say publicly if he believes his words were taken out of context by a Ukrainian state video edit of his comments about the war that provoked widespread condemnation in Moscow.
In an edited video released by the Ukrainian president’s office of Graham’s meeting with Volodymyr Zelenskiy in Kyiv on Friday, Graham was shown saying “the Russians are dying” and then saying U.S. support was the “best money we’ve ever spent”.
After Russia criticised the remarks, Ukraine released a full video of the meeting on Sunday which showed the two remarks were not directly linked.
Russia’s foreign ministry said Western media had sought to shield the senator from criticism and said that Graham should publicly state if he feels his words were taken out of context by the initial Ukrainian video edit.
“If U.S. Senator Lindsey Graham considers his words were taken out of context by the Ukrainian regime and he doesn’t actually think in the way presented then he can make a statement on video with his phone,” Foreign Ministry Spokeswoman Maria Zakharova said in a video posted on Telegram.
“Only then will we know: does he think the way that was said or was it a performance by the Kyiv regime?”
Graham’s office did not immediately respond to a request for comment.
The initial video of Graham’s remarks triggered criticism from across Moscow, including from the Kremlin, Putin’s powerful Security Council and from the foreign ministry.
Graham said he had simply praised the spirit of Ukrainians in resisting a Russian invasion with assistance provided by Washington.
Graham said he had mentioned to Zelenskiy “that Ukraine has adopted the American mantra, ‘Live Free or Die.’ It has been a good investment by the United States to help liberate Ukraine from Russian war criminals.”
Russia’s interior ministry has put Graham on a wanted list after the Investigative Committee said it was opening a criminal probe into his comments. It did not specify what crime he was suspected of.
In response, Graham said: “I will wear the arrest warrant issued by Putin’s corrupt and immoral government as a Badge of Honor.
“…I will continue to stand with and for Ukraine’s freedom until every Russian soldier is expelled from Ukrainian territory.”
A South Carolina Republican known for his hawkish foreign policy views, Graham has been an outspoken champion of increased military support for Ukraine in its battle against Russia.
Our Standards: The Thomson Reuters Trust Principles.
Jamie Sarkonak: Liberals bring identity quotas to Canada Media Fund
In 2021, the Liberals said they would dramatically boost funding for the Canada Media Fund. And they did — but that funding came with diversity quotas and a new emphasis on diversity, equity and inclusion (DEI).
The Canada Media Fund is supposed to oversee a funding pool that supports the creation of Canadian media projects in the areas of drama, kids’ programming, documentaries and even video games. According to its most recent annual report, about half its revenue ($184 million) comes from the federal government through the Department of Canadian Heritage (another near-half comes from broadcasting companies through the country’s broadcasting regulator, the CRTC). The department also has the power to appoint two of the fund’s board members.
The Canada Media Fund is doing a lot more than broadly funding content creation, though. With more federal funding brought in after the past election, it is now responsible for greenlighting projects to meet identity quotas set out by the Liberals.
According to the Canada Media Fund’s contract with Canadian Heritage, which has been obtained by the National Post through a previously-completed access to information request, the number of projects funded with government-sourced dollars and led by “people of equity-deserving groups” will have to amount to 45 by 2024. The number of “realized projects” for people of these groups must amount to 25 by 2024. Finally, by 2024, a quarter of funded “key creative positions” must be held by people from designated diversity groups.
These funding quotas are similar to the CBC’s new diversity requirements for budgeting. When the CBC’s broadcasting licence was renewed by the CRTC last year, it was required to dedicate 30 per cent of its independent content production budget to diverse groups, which will rise to 35 per cent in 2026. While the CRTC is arm’s-length from government, a Liberal-appointed CRTC commissioner appeared eager to impose quotas that were on par with the governing party’s agenda on diversity, equity and inclusion (DEI).
The government’s agreement with the Canada Media Fund also sets aside $20 million of the new money explicitly for people considered diverse enough to check a box — anyone from “sovereignty-seeking” and “equity-seeking” groups.
“’Sovereignty- and Equity-Seeking Community’ refers to the individuals who identify as women, First Nations, Métis, Inuit, Racialized, 2SLGBTQ+, Persons with disabilities/Disabled Persons, Regional, and Official Language Minority Community,” reads the Canada Media Fund’s explainer on who gets diversity status.
Aside from getting mandatory coverage through the use of quotas, the groups listed above are shielded with “narrative positioning” policies that took effect this year. If the main character, key storyline, or subject matter has anything to do with the above groups, creators must either be from that group or take “comprehensive measures that have and will be undertaken to create the content responsibly, thoughtfully and without harm.” These can include consultations, sharing of ownership rights, and hiring policies from the community. While narrative requirements weren’t mandated by the Liberals in their grant to the fund, they complement the overall DEI strategy.
Storytellers vying for certain grants have to sign an attestation form agreeing with the narrative policy and write a compliance plan if their works have anything to do with the above groups. Plainly, it’s a force of narrative control.
This doesn’t go both ways; women can make documentaries about men consult-free, non-white people can make TV dramas about white people consult-free, and so on.
Statistically, diversity is being tracked on a internal system that logs the identities of key staff and leadership on every Canada Media Fund project. The diversity repository was rolled out this year. Internal documents indicate these stats will be used to monitor program progress and adjust policy going forward.
These changes are all directly linked to a Liberal platform point on media modernization. In the 2021 Liberal platform, the party committed to doubling the government’s contribution to the fund. Since then, the Liberal platform has been cited directly in internal documents outlining the Canada Media Fund’s three-year growth strategy (which explains how the new money will be used, in part, to ramp up DEI efforts).
Together, it looks like both the fund, and the party responsible for doubling its taxpayer support are more concerned about the identities of filmmakers and TV producers than the actual media being produced.
Creators should be able to tell stories about others without the narrative department’s oversight — the more narrative control, the more it starts to sound like propaganda. Good creators wanting to tell an authentic story should conduct research and be respectful of the people they cover — but they shouldn’t be bound to consultations and ownership agreements.
Uganda’s president signs into law anti-gay legislation with death penalty in some cases
Alberta votes in the strangest — and closest — election in its political history
Alberta voters await election results as polls close across province
Silver investment demand jumped 12% in 2019
Iran anticipates renewed protests amid social media shutdown
Search for life on Mars accelerates as new bodies of water found below planet’s surface
News20 hours ago
The Hidden Struggles: Uncovering the Reality of Being Black in Canada
Economy21 hours ago
Lira hits record low, but stocks rise after Erdogan win in Turkey
Business21 hours ago
Halifax condo residents face obstacles trying to go green with solar panels
Media18 hours ago
Russia says U.S. Senator should say if Ukraine took his words out of context
News17 hours ago
More Canadian companies adopt ‘stay interviews’ amid push to retain staff
Real eState18 hours ago
BCFSA rules on real estate agent’s $50K loan to client
Health23 hours ago
Coming to Terms with My Baby’s Food Allergies
Health20 hours ago
B.C. initiative aims to expand genetic screening for Ashkenazi Jewish people at risk of hereditary cancers