32 GB VRAM for less $1k sounds like a steal these days, and I’m sure it’s not getting cheaper any time soon.
Does anyone here use this GPU? Or any recent Arc Pros? I basically want someone to talk me out of driving to the nearest place that has it in stock and getting $1k poorer.
Thanks for your experience! I’m in a similar boat regarding NVIDIA - plus the budget …
At least in Europe the V100 are only available from China and with a huge markup.
Used 5090 for 3,5k, even a 3060 used is still at 250$ plus.
It’s crazy at the moment - I simply can’t afford self hosting LLMs which is a new thing to say :D