I purchased the HP Z4 workstation to use as an AI box. Will add dual PNY quadro rtx 5000 cards to use with Ollama or LM Studio to run local LLMs. What you your opinion of this setup?
Hey @Alonzo That should work well. I have Ollama running with a Ryzen 5 1600, Nvidia 3060 12gb and 16gb of ram. It gets the job done.