UPDATE: Version 1.0.0 now has some small but useful updates. Download and try the source code or the precompiled Windows executable file available here. IMPORTANT ...

So far, running LLMs has required a large amount of computing resources, mainly GPUs. Running locally, a simple prompt with a typical LLM takes on an average Mac ...