Creator of llama-cpp-python
Public work celebrated here · current
Andrei's llama-cpp-python is the bridge through which a huge share of the Python world first ran a model locally on a Mac, Metal backend included. Maintaining bindings that track llama.cpp's relentless pace is a service to everyone building private AI on Apple hardware.
We built this from your public work because we think it deserves celebrating. You did not ask us to, so the only fair thing is that you decide what happens to it. Claim it and it is yours to edit. Ask us to change something and we will. Ask us to take it down and it is gone within 72 hours — free, no account needed, and nobody will try to talk you out of it.