• 0 Posts
  • 6 Comments
Joined 3 years ago
cake
Cake day: June 8th, 2023

help-circle
  • tiny@midwest.socialtoPrivacy@lemmy.ml•Private AI?
    link
    fedilink
    English
    arrow-up
    0
    ·
    3 days ago

    You need a minimum of 16gb of vram in order to do anything that requires tool calls and even then it is slow. Running llms locally is a fun challenge and it’s impressive what can be done on consumer hardware but it isn’t cheap or simple