Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support custom model names #7

Open
johnd0e opened this issue May 5, 2024 · 2 comments
Open

Support custom model names #7

johnd0e opened this issue May 5, 2024 · 2 comments

Comments

@johnd0e
Copy link

johnd0e commented May 5, 2024

Currently, there are two distinct OpenAI options in the providers list: "gpt-3.5 turbo" and "gpt-4 turbo". It would be more efficient to consolidate these into a single item, with the capability to switch between different models. Naturally, the ability to assign custom model names is necessary.

The same improvements should also be made for Claude, LLama, and Mistral.

@pymike00
Copy link
Owner

pymike00 commented May 6, 2024

Hi there,

Yes, duplicating the handler instantiation like that is probably not the cleanest of solutions, I will see what can be done without compromising simplicity too much while refactoring.

If you had any initial thoughts feel free to share them here!

@johnd0e
Copy link
Author

johnd0e commented May 6, 2024

If you had any initial thoughts feel free to share them here!

I see several alternatives

  • Common models list, with possibility to add there any model by any provider.
    Additionally there could be "Filter by provider" , drop-down control.
  • 2 separate lists in dropdown controls: Provider / Model, with possibility to add any custom model.
    It would be good, if we could add custom providers as well.
    By "custom provider" I mean any OpenAI-, or Google Gemini-compatible service, which can be defined with its URL (Support custom API base #6)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants