I didn;t try any 7b ones lately, they may be better fit for 16gb I think. I was able to try the 2b ones as I mentioned (on cpu). they are subpar. like mentioned the usable ones were 31b, I think you need atleast 24gb vram for most models though. maybe someone else can suggest better.
- 5 Posts
- 4 Comments
Joined 2 years ago
Cake day: October 28th, 2024
You are not logged in. If you use a Fediverse account that is able to follow users, you can follow this user.
hey, thanks for your response… yeah that’s what I meant, the 2b models aren’t usable in today’s state, but more practical for everyday use if they work out…
I actually meant the 31b models are useful for my purpose. I don’t do full-on agentic coding, just interactive chat/prompting. Example, I make good use for making linux shell scripts (as I don’t know howto myself). Currently I use qwen3.5-flash via cloud. It’s as good as the frontier models back then if not better…
ntn888@lemmy.mlto
Technology@lemmy.world•Bitcoin slips below $71,000 as Trump orders U.S. to join Iran in blockade of Strait of HormuzEnglish
4·1 month agoofcourse he’s not blocking the blockade… he’s merely imitating it :D





cool what was your hardware, and which qwen size you used? thanks