Four current and former students of a high school in Baltimore said in a lawsuit filed on Tuesday that their civil rights had been violated when an artificial intelligence surveillance system alerted the police to a gun that was actually a bag of chips.

The students had been waiting for a ride home from football practice at Kenwood High School on Oct. 20, 2025. One of them was eating Cool Ranch Doritos, a snack from their coach, the lawsuit said.

Suddenly, police officers arrived with guns drawn and ordered the teenagers, who are Black, to their knees, handcuffed them and searched them, the lawsuit said.

“The encounter was terrifying and life-threatening,” the lawsuit said. “With armed police encircling them for no apparent reason, each student feared for his life and the lives of his friends.”

  • Duchess@piefed.linenoise.vip
    link
    fedilink
    English
    arrow-up
    76
    arrow-down
    3
    ·
    2 days ago

    ACAB. A human couldn’t double check the images? A human probably did and they chose this anyway knowing they had an excuse. Pigs.

    • Mrkawfee@lemmy.world
      link
      fedilink
      arrow-up
      3
      ·
      21 hours ago

      This is how the Israelis have killed at least 20,000 children. The AI targeting is the excuse for mass murder.

    • TheOneCurly@feddit.online
      link
      fedilink
      English
      arrow-up
      19
      ·
      2 days ago

      Yeah the non-deterministic nature and high error rate of these tools is a feature. They’re probable cause generators.

    • MasterBlaster@lemmy.world
      link
      fedilink
      arrow-up
      2
      ·
      1 day ago

      let’s not lose sight of the fact it was the result of 24/7 surveillance policy. the problem is the loss of privacy, and therefore agency.

      we are quickly becomming slaves to the state.

  • SpankyDoodle@eviltoast.org
    link
    fedilink
    arrow-up
    47
    arrow-down
    1
    ·
    2 days ago

    AI needs to be HEAVILY regulated and removed from circumstances where human lives are in jeopardy from the use of it. Or at least go through several layers of human verification before police are deployed to an incident. All the sane people already knew this though.

    The Iran war shows how important this is. Ending any number of innocent lives without any human verification to prevent a mistake is murderous and psychotic, imo.

  • Rentlar@lemmy.ca
    link
    fedilink
    arrow-up
    35
    arrow-down
    1
    ·
    2 days ago

    Markov probability chain for the AI logic trained on US police responses:

    Dark skinned person holding shiny object ->

    • 50% holding a gun
    • 50% stealing valuables