• panda_abyss
    link
    fedilink
    arrow-up
    57
    arrow-down
    1
    ·
    13 days ago

    Please stop using Amazon.

    They’re evil, we all know they’re evil, why do we bother?

  • nightlily@leminal.space
    link
    fedilink
    English
    arrow-up
    46
    ·
    13 days ago

    Jailbreaking is an inherent problem with LLMs that can never be solved. Any safeguard has to be less capable than the LLM it protects, else you can just target that. So there will always be a way to communicate with the LLM in a way that bypasses the safeguard.

    It’s like trying to sanitise user input from SQL injections, except the database speaks every form of communication documented by humanity.

    All this is to say, I’m glad I’m not responsible for any of these systems.

  • rowinxavier@lemmy.world
    link
    fedilink
    arrow-up
    10
    ·
    13 days ago

    One thing that gets me about AI chat agents is the idea of attack surface. If you have a clearly defined protocol you can curtail most of the possible attacks by narrowing things, only accepting well formed requests, and validating both on the user end and then on the server end before processing anything. An LLM is inherently wide in attack surface given the way it is structured. It can take a prompt which can be any set of characters connected together into tokens. These tokens can’t easily be filtered for intent or goal and yet they can get the LLM to drop other rules or restrictions because they are just other prompts.

    A simple coded padlock is not very secure, but a door with no walls is less secure.

  • NahMarcas@lemmy.ml
    link
    fedilink
    arrow-up
    5
    arrow-down
    2
    ·
    13 days ago

    Did just amazon and more using know names to fire them of knowledge. Because Rufus is the tool to burn CDs and record operative systems

      • NahMarcas@lemmy.ml
        link
        fedilink
        arrow-up
        5
        arrow-down
        2
        ·
        13 days ago

        Gemini is the internet protocol before google use the name for their AI. X.com is the first competitor of x.org Rufus.ie are the burner program. Im trying to say they want to replace the free internet stealing their names

        • Randomgal
          link
          fedilink
          arrow-up
          3
          ·
          13 days ago

          Hoe many CDs did you burn last year that they might want to steal that business away from you?

          • tuff_wizard@aussie.zone
            link
            fedilink
            arrow-up
            7
            ·
            13 days ago

            Rufus is one of the most popular programs for writing.iso files to flash drives to make bootable usbs.

            I don’t think there is a conspiracy here but it is interesting

            • TexasDrunk@lemmy.world
              link
              fedilink
              arrow-up
              2
              ·
              13 days ago

              The Gemini one is the one I find interesting. Protocol to put up pages that aren’t indexed by Google? Well now it’s harder to get information about.

              I don’t think it’s a conspiracy either. It’s just interesting.