We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
41061d7
Properly expose generation parameters for each backend, handle config entry updates without reloading, support remote backends with an API key
Also updates the included llama-cpp-python wheel to v0.2.29
llama-cpp-python