Researchers secretly experimented on Reddit users with AI-generated comments

Engadget - Apr 28th, 2025
Open on Engadget

A covert experiment conducted by researchers from the University of Zurich used AI-generated comments to test the persuasiveness of large language models in the Reddit community, r/changemyview. This unauthorized study involved creating AI personas with varied identities to engage users in debates, raising ethical concerns about psychological manipulation. The moderators of the subreddit, which boasts 3.8 million members, criticized the researchers for violating community rules and filed a complaint with the university, requesting the withholding of the study's publication.

The researchers defended their work, stating that it was approved by an ethics committee and emphasized the potential benefits of understanding AI’s persuasive capabilities to prevent malicious use. However, the moderators and some community members argue that the study was unnecessary and intrusive, highlighting existing research conducted ethically without involving unsuspecting participants. The incident raises broader implications for the ethical boundaries of AI research, especially in digital spaces where user consent is paramount.

Story submitted by Fairstory

RATING

6.4
Moderately Fair
Read with skepticism

The article provides a detailed account of an unauthorized AI experiment conducted on Reddit, highlighting significant ethical concerns and the potential for AI misuse. It effectively presents the perspectives of subreddit moderators and the researchers involved, offering a balanced view of the controversy. However, the lack of direct responses from key stakeholders, such as the University of Zurich and Reddit, limits the article's depth and source quality. The story's timeliness and relevance to ongoing debates about AI ethics make it an important contribution to public discourse. The clear and structured presentation ensures readability, while the controversial nature of the topic is likely to provoke debate and engage readers. Overall, the article succeeds in raising awareness of critical issues related to AI and online discourse, though it could benefit from additional perspectives and verification of key claims.

RATING DETAILS

7
Accuracy

The article presents a detailed account of an unauthorized experiment conducted by researchers from the University of Zurich on Reddit's r/changemyview subreddit using AI-generated comments. The factual claims include the experiment's unauthorized nature, the use of AI to simulate various identities, and the lack of informed consent from subreddit participants. These claims are supported by statements from subreddit moderators and references to a draft paper by the researchers. However, the article lacks direct confirmation from the University of Zurich or the ethics committee, which are crucial for verifying the experiment's approval and ethical oversight. Additionally, the claim that researchers attempted to personalize AI responses based on users' Reddit history requires further evidence to assess its accuracy fully.

6
Balance

The article primarily presents the perspective of the subreddit moderators and the ethical concerns they raised. It includes statements from the researchers defending their actions, arguing that the potential benefits of the study outweigh the risks. However, the article could benefit from additional viewpoints, such as input from independent AI ethics experts or comments from Reddit users affected by the experiment. Including these perspectives would provide a more comprehensive view of the situation and help readers understand the broader implications of the research.

8
Clarity

The article is well-structured and uses clear language to describe the events and the ethical concerns raised by the experiment. It logically presents the sequence of events, from the experiment's revelation to the moderators' response and the researchers' defense. The tone remains neutral, allowing readers to form their own opinions based on the information provided. However, the article could benefit from a clearer explanation of the specific subreddit rules violated and the potential implications of the research.

5
Source quality

The article relies heavily on statements from subreddit moderators and a draft paper from the researchers involved in the experiment. While these are relevant sources, the lack of direct quotes or confirmation from the University of Zurich or the ethics committee weakens the source quality. Additionally, the article does not cite any independent experts or third-party verification, which would enhance the credibility of the reporting. The absence of responses from Reddit or the university further limits the depth of source quality.

6
Transparency

The article provides a clear description of the experiment and the moderators' response, but it lacks transparency regarding the methodology used to verify the claims. There is no mention of attempts to contact the University of Zurich for confirmation or to obtain a copy of the researchers' draft paper. The article also does not disclose any potential conflicts of interest or biases that might affect the reporting. Greater transparency in these areas would improve the article's trustworthiness.

Sources

  1. https://www.engadget.com/ai/researchers-secretly-experimented-on-reddit-users-with-ai-generated-comments-194328026.html
  2. https://retractionwatch.com/2025/04/28/experiment-using-ai-generated-posts-on-reddit-draws-fire-for-ethics-concerns/
  3. https://www.404media.co/researchers-secretly-ran-a-massive-unauthorized-ai-persuasion-experiment-on-reddit-users/
  4. https://simonwillison.net/2025/Apr/26/unauthorized-experiment-on-cmv/
  5. https://slashdot.org/story/25/04/28/1642223/unauthorized-ai-bot-experiment-infiltrated-reddit-to-test-persuasion-capabilities