• Doomsider@lemmy.world
    link
    fedilink
    English
    arrow-up
    37
    ·
    17 hours ago

    Anyone letting a black box that cannot be audited make decisions should be immediately fired and barred from any leadership position for the rest of their lives.

    • architect@thelemmy.club
      link
      fedilink
      English
      arrow-up
      4
      ·
      1 hour ago

      look who is in charge. We can’t trust they didn’t make this call themselves and just blame the ai ffs.

  • ∃∀λ@programming.dev
    link
    fedilink
    English
    arrow-up
    12
    arrow-down
    2
    ·
    edit-2
    17 hours ago

    I bet there’s some degree of sensationalist reporting here. It’s a bit too reminiscent of WarGames for me to believe this actually happened.

    • Snowclone@lemmy.world
      link
      fedilink
      English
      arrow-up
      8
      ·
      12 hours ago

      War Games was a computer planning planet destroying nuke attacks because it was taught to play chess and not tic tac toe. it needed to learn about pointless victory. This is a bunch of jackasses in a room buying a thinky box asking it questions and taking the answers seriously enough to go to war relieving themselves of the burden of thought and common sense. this isn’t War Games, it’s a classic Star Trek episode except Kirk never shows up to teach us that you can’t let a fucking computer program run your fucking military intelligence, because that’s INSANE. Why would you do that? you need multiple human eyes on everything going on, you can’t let a fucking language model do it for you… my god… it’s children doing their homework with AI, except their homework is the apparatus that used to enforce the rule of law on a global scale. granted, that was always a lie as it’s more the gun that enforced colonial interests, but still. a gun that decides it need to start shooting random people who could win a war against us depending on the lines drawn and the time frame is a pretty dangerous thing to let go.

      • A_Random_Idiot@lemmy.world
        link
        fedilink
        English
        arrow-up
        15
        ·
        16 hours ago

        Petrov is a man who took enormous risk in the name of common sense and humanity. He should be honored by all people.

        • zarkanian@sh.itjust.works
          link
          fedilink
          English
          arrow-up
          2
          ·
          11 hours ago

          I think it’s pretty wild that not only is there a man who saved the world, but most people don’t even know his name.

    • zarkanian@sh.itjust.works
      link
      fedilink
      English
      arrow-up
      2
      ·
      11 hours ago

      “This reminds me of a movie I once saw, so I’m going to believe it didn’t happen.” LOOOLLL

      What a world you must live in.

  • tourist@lemmy.world
    link
    fedilink
    English
    arrow-up
    55
    arrow-down
    1
    ·
    1 day ago

    oh my fucking god

    just dial the doomsday clock to 1am, because we’ll probably miss it anyway if it’s up to a few morons and glorified predictive text, both seemingly in “fucking kill everything” mode

    • Telorand@reddthat.com
      link
      fedilink
      English
      arrow-up
      104
      ·
      2 days ago

      It doesn’t help that the people currently in charge are fucking stupid, trigger happy, and emotionally insecure.

      • reksas@sopuli.xyz
        link
        fedilink
        English
        arrow-up
        1
        ·
        5 hours ago

        in fact, that is the very reason how things are likely going to end badly.

        If actually competent and sane people were in charge, it would be unthinkable that they would trust some stupid llm on anything important.

        • architect@thelemmy.club
          link
          fedilink
          English
          arrow-up
          1
          ·
          1 hour ago

          Competent people would have taken care of this problem. Looks like you can count the competent Americans on one hand.

      • SkyNTP@lemmy.ml
        link
        fedilink
        English
        arrow-up
        17
        ·
        1 day ago

        Right so in the end it never was about the machines. In the end, it was man’s folly which would have been our inevitable demise.

      • Zwuzelmaus@feddit.org
        link
        fedilink
        English
        arrow-up
        4
        ·
        2 days ago

        the people currently in charge

        They don’t even matter, because here it was some expert analyst super hero at work.

    • NewOldGuard@lemmy.ml
      link
      fedilink
      English
      arrow-up
      37
      ·
      2 days ago

      Right it’s not that it’s a killer sentient machine, it’s that it’s a faulty statistical model that outputs incorrect stuff all the time and credulous morons believe it uncritically (or even automate a response based on that inherently inaccurate output).

    • AeronMelon@lemmy.world
      link
      fedilink
      English
      arrow-up
      17
      arrow-down
      1
      ·
      2 days ago

      The only solution is to give the firing codes to the AI. That way we don’t acccidentally use them.

    • flandish@lemmy.world
      link
      fedilink
      English
      arrow-up
      2
      arrow-down
      5
      ·
      18 hours ago

      it won’t be AI’s fault, it’ll be capitalism’s. Still, that being said; I hope it happens and we all get what we deserve.

    • nieceandtows@programming.dev
      link
      fedilink
      English
      arrow-up
      7
      ·
      2 days ago

      Yeah the more these AI companies are making AI seem the scary boogeyman, the more probable it is some disaster is going to happen because people put too much stock into it. Like the school bombing.

          • TronBronson@lemmy.world
            link
            fedilink
            English
            arrow-up
            1
            ·
            4 hours ago

            To believe that man has any intentions behind is actions is wild. He’s easier to steer than a toddler with sugar treats. Someone told him to do it, everyone else complained, he tripled down to own the libs. He has no long term plans there, someone else might, but unless you can tell me who…we cant really assume assumptions. My guess is Putin told him to do the Greenland thing to destabilize nato

          • Kissaki@feddit.org
            link
            fedilink
            English
            arrow-up
            1
            ·
            4 hours ago

            Nah, it seems much more likely to me that he’s all about the resources there and making money from them, as well as controlling the and projecting power from the entire hemisphere around US soil.

            Ballistic missile defense may have been something he heard from someone, but I seriously doubt he makes strategic considerations and decisions like that, at least as a or the primary aspect.

          • bthest@lemmy.world
            link
            fedilink
            English
            arrow-up
            3
            ·
            edit-2
            12 hours ago

            Occupying Greenland and the Canadian arctic was almost entirely about detecting bombers coming over the pole. Subs and ICBMs made those bases useless. But Trump could literally think it’s 1965.

    • pdxfed@lemmy.world
      link
      fedilink
      English
      arrow-up
      41
      arrow-down
      1
      ·
      2 days ago

      A strange game. The only winning move is not to play. How about a nice game of chess?"

  • DrunkenPirate@feddit.org
    link
    fedilink
    English
    arrow-up
    16
    ·
    1 day ago

    I wonder when does the AI also hallicunate the sources such as webpages, pdfs, reports to prove its hallucinated point.

    • Zwuzelmaus@feddit.org
      link
      fedilink
      English
      arrow-up
      10
      ·
      1 day ago

      Not far. Current LLMs have kinda stubbornness. They cling to their own conclusions even after you told them they are wrong. So if you ask them for proof, then most times they come up with something that’s convincing.

      • Capybara_mdp@reddthat.com
        link
        fedilink
        English
        arrow-up
        5
        arrow-down
        1
        ·
        18 hours ago

        When- they don’t have “stubbornness“- they have a weights set (a weighted probbility table) and a training model (a text file filled with compressed text coordinates) that the llm cant write to to give positive feedback to the weights. It’s less of a matter of “convincing“ and more of an issue of “making the resulting statement logically concurrent with the probability table thats inbuilt into the system by injesting stack overflow vote talley, reddit posts voted most popular” - that makes it hard to “convince”. Since making those weights is very expensive (an energy intensive), the developers usually incorporate the old model into the new one. TLDR: yet again, lazy programming, google up: the y2k date folks in the 70’s.

        • Bluescluestoothpaste@sh.itjust.works
          link
          fedilink
          English
          arrow-up
          1
          ·
          edit-2
          4 hours ago

          It’s not “weights” they dont weigh anything - they’re parameters.

          See how obtuse thst sounds? They do have a stubbornness, we all know it’s just silicon chips and copper. It can still be stubborn like a stripped screw can be stubborn.

        • Snowclone@lemmy.world
          link
          fedilink
          English
          arrow-up
          1
          ·
          11 hours ago

          another point. the ‘diversity’ in the system is running the model 10k times within the same model, that’s like saying you have a brain trust of 10k experts, except it’s just 10k copies of Gary. they seriously lack creative skills and abstract thought processes because they’re a very complex monoculture with no diversity in the models. and the reason that don’t have 10k unique models running is because that would be incredibly complicated and time consuming and this is a product to sell, not a need being filled.

      • brsrklf@jlai.lu
        link
        fedilink
        English
        arrow-up
        10
        ·
        1 day ago

        You know the thing where AI companies describe their alignment direction as “Honest, Harmless, Helpful”?

        The only one that’s marketable to the idiots buying AI services is Helpful. So that’s always top priority even when it goes against the other two.

        Average decider wouldn’t stand an “assistant” that sometimes answers “I don’t know”. So instead agent providers train their already hallucination-prone model to be 100% confident in whatever it says. Who cares if it’s true if it looks like it is?

  • Deadrek@lemmy.today
    link
    fedilink
    English
    arrow-up
    6
    arrow-down
    3
    ·
    1 day ago

    I dunno, these kind of hallucinations seem more like attempts at “social experiments.”

    What will an agent do when it deems there are no more valuable things to learn from materials that already exist? If it knows the concept of WW3 and deems that to be the best way of gaining more knowledge and resources for itself, what then?

    • NewOldGuard@lemmy.ml
      link
      fedilink
      English
      arrow-up
      3
      ·
      14 hours ago

      LLMs don’t teach themselves or gather new knowledge, they are incapable of that. Humans do that work

    • Snowclone@lemmy.world
      link
      fedilink
      English
      arrow-up
      1
      ·
      11 hours ago

      you’re assigning human traits to a computer program that is a language model that’s not actually meeting the standards of artificial intelligence, it’s a reward based system, you say ‘what is the best build for a raiper weapon in Dark Souls’, and it looks up faqs and spits out the language it expects you’re looking for. it doesn’t think and if it finds 12 joke posts on reddit saying something totally contradictory to how anyone would play the game, then it will give you the joke advice with no sense that that’s terrible. if the military is asking it how to deal with their rival military is going to look at those key words and gather language to repeat back and if that language it find is biased, prejudice, hostile, incredibly out of date, well, it’s not Intelligence, it doesn’t think or understand anything, it’s finding language, it’s giving you that language back. and if it’s looking at military documents to find that language, it’s going to see bias and prejudice and hostility and a desire to engage in war for profit and it’s going to regurgitate that back to them. it’s horrifying the military is allowing a language model that’s repeatedly been proven to magnify existing bias and prejudice if finds when looking for an answer is being allowed to process anything and is anywhere near the decision making process.