• FiniteBanjo@feddit.online
    link
    fedilink
    English
    arrow-up
    12
    arrow-down
    2
    ·
    edit-2
    10 hours ago

    Lol what? Of course it won’t, If the AI slop ends with recursive edits it’s just going to cause degradation and collapse. I swear techbros have reality confused with their favorite fantasy fiction books.


    EDIT: To demonstrate, 90% accuracy of 90% is 81%. Even the best most specific models on earth are not capable of self improvement because they will never reach much less exceed their training data’s capability even if the largest most perfect dataset existed. They might think that by simply adding more layers of machines running in parallel and killing off models which underperform creating a system similar to evolutionary adaptation that it might eventually reach that 91%, but our current approach and level of technology have never demonstrated that capability not even theoretically.

    • MangoCats@feddit.it
      link
      fedilink
      English
      arrow-up
      1
      arrow-down
      7
      ·
      8 hours ago

      What happened in the computer programming space (with testable outputs) is that the first pass 80% accuracy nailed down an 80% success rate - wrote code that successfully met requirements 4/5 trials. Then, the agents were able to repeat the 1/5 failing trials with “sufficient heat” to both find their problems and create workable solutions, again 4/5 trials - so 80% success rate becomes 96% success rate, and so on… Back in early 2025, programming LLM agents would get themselves caught in iterative loops - trying, failing, trying again, failing again, then trying the first approach again - failing indefinitely. By mid 2026, I don’t see that behavior anymore - if the first “light pass - quick attempt” solution doesn’t succeed, they dig in deeper - do more research specifically focused on the problem areas identified in the first failure and try again, generally successful by the 2nd try, almost always by the 3rd - I haven’t had to break a “trying the first unworkable solution again because I can’t think of anything else to do” loop in over 6 months.

      Not all problem spaces are as clear-cut as software creation, but many have similar rules that just take a bit more training to learn.

      • FiniteBanjo@feddit.online
        link
        fedilink
        English
        arrow-up
        5
        arrow-down
        3
        ·
        edit-2
        8 hours ago

        They Don’t pass 4/5.

        They pass 0/5 because they are 80% (that number is way too optimistic btw) accurate to human output on every one of the five attempts.

        They also can’t be forced to learn and retake the trial because they don’t have any contextual awareness, they just guess the next word in a sequence.

        Even if a machine made 4 self edits sucessfully, it would be permanently disfigured by the one failure and no longer be capable of making good edits.