Skip to content

v0.2.1 (alpha)

Compare
Choose a tag to compare
@acon96 acon96 released this 16 Jan 04:52

Properly expose generation parameters for each backend, handle config entry updates without reloading, support remote backends with an API key

Also updates the included llama-cpp-python wheel to v0.2.29