• patruelis@lemmy.world
    link
    fedilink
    arrow-up
    0
    ·
    2 months ago

    Its bound to happen more and more. More concerning, what is it decides to insert unknown code into backups? How are they detected? Who’s guarding all if these? Another AI?

    • pinball_wizard@lemmy.zip
      link
      fedilink
      arrow-up
      0
      ·
      2 months ago

      Exactly. We aren’t (and probably won’t) even learn about all the subtle poisoning happening, causing waste and data loss.

  • gravitas_deficiency@sh.itjust.works
    link
    fedilink
    English
    arrow-up
    0
    ·
    2 months ago

    If you are giving your codegen LLM - the model involved truly, genuinely doesn’t matter - admin access to your prod env, all I’m going to do is point and laugh.

  • Brokkr@lemmy.world
    link
    fedilink
    arrow-up
    0
    ·
    2 months ago

    I don’t understand what Railway is supposed to do here? If deleting a drive also deletes the backup, what’s the point of the backup?

  • grueling_spool@sh.itjust.works
    link
    fedilink
    arrow-up
    0
    ·
    2 months ago

    No bro you don’t understand, Claude needs access to backups so it can restore them in case something breaks because our senior dev ($50k, 2YoE) doesn’t know how to do it

  • GrumpyBike1020@monero.town
    link
    fedilink
    English
    arrow-up
    0
    ·
    2 months ago

    Maybe their backup system should hold onto those backups for a few days after the volume is deleted or something like that…

      • jafra@slrpnk.net
        link
        fedilink
        arrow-up
        0
        ·
        2 months ago

        Actually this is how AI should be viewed. Under the right circumstances it maybe saves lots of time, but it also might destroy, so treat it like you would an intern…

  • deadbeef79000@lemmy.nz
    link
    fedilink
    arrow-up
    0
    ·
    2 months ago

    Man who shit his own pants horrified that his pants are full of shit.

    Demands explanation from pants vendor.

  • db2@lemmy.world
    link
    fedilink
    arrow-up
    0
    ·
    2 months ago

    They can’t go rogue, they have no agency or desire or thought. What really happened is the thing specifically designed to do whatever the Plinko line with the most chips says did it because the incompetent dickheads who deployed it didn’t know how not to do that.

  • Raven@lemmy.org
    link
    fedilink
    arrow-up
    0
    ·
    2 months ago

    This is fun to read. I hope people will have their actual intelligence activated after this.

  • Avicenna@programming.dev
    link
    fedilink
    arrow-up
    0
    ·
    2 months ago

    If you are going to give an LLM a free pass to your whole prod database least you should do is to take weekly (or daily if plausible) offline backups of it. A hard limit against deleting stuff would be better.

  • Err(()).unwrap()@lemmy.world
    link
    fedilink
    arrow-up
    0
    ·
    2 months ago

    PocketOS founder blames ‘Cursor running Anthropic’s flagship Claude Opus 4.6’

    Fuck that. I’m blaming the PocketOS founder and every person in the chain of decisions that led to a clanker being given this level of unrestricted access to the database and the backups.