Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Deploy with Llama2 #76

Open
Libresse opened this issue Oct 27, 2023 · 8 comments
Open

Deploy with Llama2 #76

Libresse opened this issue Oct 27, 2023 · 8 comments

Comments

@Libresse
Copy link

Hi SolidGPT team,

Are there any ways I can deploy your product with Llama2 or any other open source model?

I saw you have Llama manager but didn't find a way to use it.

BR,

@wwwwww1020
Copy link
Contributor

Yes, we are working on using opensource model Llama2 as the LLM core to implement fully local deployment. We will update more about this cool feature in the future. Btw, we will publish our roadmap real soon

@Libresse
Copy link
Author

@wwwwww1020 Does the SolidGPT fully support Azure integration, any best practice for that?

@kodiii
Copy link

kodiii commented Nov 3, 2023

would be great if was possible to use with LM Studio app

@wwwwww1020
Copy link
Contributor

Yes you can easily deploy the project into Azure with Static App , container app and blob storage. We have provide the blob storage client manager let user easily store their data into the blob. We will provide more context about deployment in the further

@wwwwww1020
Copy link
Contributor

would be great if was possible to use with LM Studio app

good idea we will do some research on this

@Libresse
Copy link
Author

Libresse commented Nov 3, 2023

So are you going to support Chinese LLM like ERNIE in the future?

@wwwwww1020
Copy link
Contributor

So are you going to support Chinese LLM like ERNIE in the future?

Yes we are going to adding more model like ERNIE

@bhupesh-sf
Copy link

Hey, did we have any update on LM Studio or anything similar which gives openAI compatible API?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants