2 posts tagged with "AI"

The RTX 4090 is still a practical local-AI card, but the important constraint is not just “can it run the model?” It is whether the GPU is being treated like a shared service or a model zoo.

Ollama was randomly hanging during inference. GPU would go idle mid-conversation, requests would timeout.