Black high school students sue after AI confuses Doritos bag with gun
| Source: HN | Original article
Four Black high school students in Maryland have filed a lawsuit after an AI system misidentified a Doritos bag as a gun, leading to police detention.
Four Black high‑school students have filed a civil lawsuit over an incident that unfolded at Kenwood High School in Baltimore County, Maryland, in October 2025. The students allege that an AI‑driven gun‑detection system, Omnilert Gun Detect, mistakenly flagged a bag of Doritos as a firearm. Police responded with guns drawn, handcuffed the teenagers and conducted a search outside the school. The plaintiffs, who are current and former students, say the episode caused lasting emotional harm and reflects broader biases in automated security tools.
The case spotlights the growing reliance on artificial‑intelligence surveillance in K‑12 environments and the risks when such systems generate false positives. Critics argue that the technology can disproportionately target Black students, amplifying existing inequities in school policing. The lawsuit, filed on behalf of the students by the Lawyers’ Committee on Civil Rights, seeks redress for the alleged violation of their constitutional rights and for the trauma inflicted by the police response.
Legal experts will be watching how the courts assess liability for the AI vendor, the school district and the police department. The outcome could prompt districts nationwide to reevaluate or suspend similar AI‑based security platforms, and may spur legislative scrutiny of algorithmic accountability in schools. As the case proceeds, stakeholders—from education officials to civil‑rights groups—are likely to demand greater transparency about how AI tools are trained, tested and deployed in environments where false alarms can have life‑altering consequences.
Sources
Back to AIPULSEN