Local Language Mpdel API App

Requirements

1. App creates http://localhost:8272 enpoint to serve all llm openai compatibele requests.
2. App passes requests to and from external api endpoint.
3. App can add authorisation credentioals to api call
4. App can inspect package and parse and re-format payload for requests and responses.
5. App is logging all traffic to well organized history directory.
6. App provides search for history loggs
7. App provides history playback analysis, where it can show step by step system, user, assistant, context and other prompts and messages, step by step.

CLI interface:

llmapi