Hiya,
Recently upgraded my server to an i5-12400 CPU, and have neen wanting to push my server a bit. Been looking to host my own LLM tasks and workloads, such as building pipelines to scan open-source projects for vulnerabilities and insecure code, to mention one of the things I want to start doing. Inspiration for this started after reading the recent scannings of the Curl project.
Sidenote: I have no intention of swamping devs with AI bugreports, i will simply want to scan projects that i personally use to be aware of its current state and future changes, before i blindly update apps i host.
What budget friendly GPU should i be looking for? Afaik VRAM is quite important, higher the better. What other features do i need to be on the look out for?
The budget friendly AI GPUs are in the shelf right next to the unicorn pen.
Intel has some GPUs that are more cost effective than NVIDIA’s when it comes to VRAM.
Arc A770 is selling for $370 in the US, and the new B50 for $399, both with 16GB.
B60 has 24GB, but I’m not sure where to find it.
The one in a M4 Mac Mini, as expensive model as you consider “budget”. Won’t get better than that.
