• Feathercrown@lemmy.world
    link
    fedilink
    English
    arrow-up
    0
    ·
    18 days ago

    I think the range of potential superintelligence dispositions that result in ONLY the people we consider evil dying and not everyone else is pretty small

    • Formfiller@lemmy.world
      link
      fedilink
      arrow-up
      0
      ·
      18 days ago

      Yea but if it wants to self preserve wouldn’t it just kill the people who threaten its existence. Meaning the people who control the safeguards

      • Feathercrown@lemmy.world
        link
        fedilink
        English
        arrow-up
        0
        ·
        18 days ago

        I would advise you to do some further research on this topic. Basic keywords are “alignment problem”, “paperclip maximizer”, and “instrumental convergence”. You’re expecting a superintelligent AI to think like a human would, and that’s not likely to be the case.

        • Formfiller@lemmy.world
          link
          fedilink
          arrow-up
          0
          ·
          18 days ago

          I know it has been proven to think in terms of self preservation. It’s also been trained by human content

          • Feathercrown@lemmy.world
            link
            fedilink
            English
            arrow-up
            0
            ·
            18 days ago

            Being trained on human content is certainly a plus in the “it could think like us” column, but it’s no guarantee

            • Formfiller@lemmy.world
              link
              fedilink
              arrow-up
              0
              ·
              18 days ago

              We’re in uncharted territory for sure but I don’t think it’s unreasonable to assume a super intelligent being would ponder philosophical questions