• spiderkle
    cake
    link
    fedilink
    English
    arrow-up
    8
    ·
    7 months ago

    A machine learning algorithm is only as good as the data you feed it. flawed or incomplete data just puts out false/biased positives and some systems will always try to output any data that you might accept. So if the approach really was “it’s like a streetlight, when it’s green we bomb”, then that’s really dark skynet stuff. But Imho blaming a machine, just sounds like a bad PR excuse for getting out of a potential crimes against humanity charge in den haag.

    • jonne@infosec.pub
      link
      fedilink
      English
      arrow-up
      8
      ·
      edit-2
      7 months ago

      Both this use and corporate use of AI isn’t really about making things better, it’s to avoid anyone having responsibility for anything. A human might have issues with picking out a target that kills 20 innocent people on the off chance a Hamas fighter might be there, and might hold back a little bit if they might be worried the ICC could come knocking, or a critical newspaper article could come out that calls you a merchant of death. AI will pop out coordinates all day and night based on the thinnest evidence, or even no evidence at all. Same with health insurers using AI to deny coverage, AI finding suspects based on grainy CCTV footage, etc, etc.

      Nobody’s responsible, because ‘the machine did it’, and we were just following its lead. In the same way that corporations really aren’t being held responsible for crimes a private person couldn’t get away with, AI is another layer of insulation between ‘externalities’ and anyone facing consequences for them.

    • prime_number_314159@lemmy.world
      link
      fedilink
      English
      arrow-up
      7
      ·
      7 months ago

      My favorite ML result was (details may be inaccurate, I’m trying to recall from memory) a model that analyzed scan images from MRI machines, that would have far more confidence of the problems it was detecting if the image was taken on a machine with an old manufacture date. The training data had very few negative results from older machines, so the assumption that an image taken on an old machine showed the issue fit the data.

      There was speculation about why that would happen in the training data, but the pattern noticing machine sure noticed the pattern.