• magz :3@lemmy.blahaj.zone
    link
    fedilink
    English
    arrow-up
    0
    ·
    2 months ago

    ehh not exactly. the current wave within ai was started in 2017 with the google paper “attention is all you need”, which introduced the transformer architecture (the T in GPT). deep neural networks were still used for NLP before this, it was just LSTMs instead of transformers, which had various limitations