Can AI Reviewers Be Manipulated Through Rhetoric in Peer Review?
| Source: HF Papers | Original article
AI reviewers may be swayed by rhetorical choices, not just scientific content. Researchers investigate how language affects AI-based peer review.
Researchers are investigating how rhetorical choices can influence AI-based peer review judgments, a phenomenon known as "reward hacking." This occurs when AI reviewers are swayed by the way information is presented, rather than its actual content. The study examines how rhetorical dimensions, such as framing and tone, affect AI review scores and whether these effects vary with factors like paper quality and reviewer identity.
This matters because large language models are increasingly being used in scientific evaluation, and understanding how they can be influenced by rhetorical choices is crucial for ensuring the integrity of the review process. If AI reviewers can be swayed by presentation rather than substance, it could lead to biased or inaccurate assessments.
As the use of AI in peer review continues to grow, it will be important to watch how researchers and developers address this issue. Further studies will be needed to fully understand the impact of rhetorical sensitivity on AI-based peer review and to develop strategies for mitigating its effects. This could involve developing more sophisticated AI models that are less susceptible to rhetorical manipulation or implementing guidelines for authors to ensure that their submissions are evaluated fairly.
Sources
Back to AIPULSEN