Running a Local AI Agent on AMD: ROCm, WSL2, llama.cpp and Hermes Agent Running a local Large Language Model is becoming increasingly attractive, especially for AI agents that need privacy, low latency, and full control over their data. Running one on NVIDIA hardware is relatively straightforward these days. AMD