Zurich Uni’s secret AI experiment manipulated Redditors’ opinions

Researchers at the University of Zurich have been accused of undertaking an unauthorized four-month-long experiment on a Reddit board using artificial intelligence-generated comments to test whether AI could alter people’s opinions. 

As part of the experiment,  AI-powered accounts  faked a variety of personas, including a rape victim, a person opposed to specific social movements and a trauma counselor specializing in abuse, moderators of the r/changemyview subreddit  said  in an April 26 post.

“Our sub is a decidedly human space that rejects undisclosed AI as a core value,” the moderators said. “People do not come here to discuss their views with AI or to be experimented upon.” 

The researchers used AI to generate responses but attempted to personalize the replies based on information from the original  posters’ prior Reddit history , such as political orientation, gender, age, and ethnicity,  according  to a draft of the paper.

Over the four-month experiment, Zurich University’s fake AI accounts posted 1,783 comments and received 137 deltas — a mark showing when another Reddit user acknowledged the account had persuaded them to change their opinion on an issue. 

  The researchers  said  in a post to the subreddit that all comments were manually reviewed before posting to ensure they met the community guidelines and to “minimize potential harm.”  

The university team argued that the “potential benefits of this research substantially outweigh its risks” because they have found that the  large language models  used in the experiment can be highly persuasive, surpassing all “previously known benchmarks of human persuasiveness.”

“Our controlled, low-risk study provided valuable insight into the real-world persuasive capabilities of LLMs — capabilities that are already easily accessible to anyone and that malicious actors could already exploit at scale for far more dangerous reasons,” the researchers said. 

At the same time, the researchers said the experiment shows that  distinguishing humans from AI  still faces significant challenges because nobody in the subreddit discovered the AI bots during the entire experiment. 

The r/changemyview board has 3.8 million members and ranks among the top 1% of subreddits by size.

Reddit considers legal options 

The Reddit board’s moderators said they were unaware of the experiment and have asked the university for an apology and to block the publication of the research. 

Reddit might also be considering legal action, as the platform’s chief legal officer, Ben Lee,  said  in a follow-up April 28 post that the experiment broke the site’s user agreement and rules, and all known accounts associated with the University of Zurich research effort were now banned. 

“We are in the process of reaching out to the University of Zurich and this particular research team with formal legal demands,” Lee said. 

“We want to do everything we can to support the community and ensure that the researchers are held accountable for their misdeeds here,” he added. 

In its response to the subreddit, the University of Zurich’s Faculty of Arts and Sciences Ethics Commission said it had investigated the incident and promised to coordinate better with test subjects in the future. The lead investigator for the project was also issued a formal warning.

“This project yields important insights, and the risks are minimal. This means that suppressing publication is not proportionate to the importance of the insights the study yields,” the ethics commission said. 

The University of Zurich did not immediately respond to a request for comment. Cointelegraph did not immediately receive a response to questions sent to an email address associated with the experiment.