nymnympseudonym@piefed.social to Lemmy Shitpost@lemmy.worldEnglish · 5 days agoWant fries with that? Or maybe 10,000 ice watersmedia.piefed.socialimagemessage-square13linkfedilinkarrow-up11arrow-down10
arrow-up11arrow-down1imageWant fries with that? Or maybe 10,000 ice watersmedia.piefed.socialnymnympseudonym@piefed.social to Lemmy Shitpost@lemmy.worldEnglish · 5 days agomessage-square13linkfedilink
minus-squarefonix232@fedia.iolinkfedilinkarrow-up0·5 days agoCan I have an LLM Light? In these times I must watch my RAM usage.
minus-squarenymnympseudonym@piefed.socialOPlinkfedilinkEnglisharrow-up0·5 days agoYou can run TinyLlama with no GPU and ~2GB RAM https://huggingface.co/TinyLlama/TinyLlama-1.1B-Chat-v1.0
Can I have an LLM Light? In these times I must watch my RAM usage.
You can run TinyLlama with no GPU and ~2GB RAM
https://huggingface.co/TinyLlama/TinyLlama-1.1B-Chat-v1.0