And it maintains my privacy, too ...
Tom Fenton reports running Ollama on a Windows 11 laptop with an older eGPU (NVIDIA Quadro P2200) connected via Thunderbolt dramatically outperforms both CPU-only native Windows and VM-based ...
Your self-hosted LLMs care more about your memory performance ...