add your own LLM_api #1386
Open
add your own LLM_api #1386
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
add own_api.py to use your own LLM API
add you own LLMapi
better629
reviewed
Jul 16, 2024
metagpt/provider/own_api.py
Outdated
| self.config = config | ||
| self.use_system_prompt = False | ||
| self.__init_ownapi() | ||
| self.cost_manager = CostManager(token_costs=self.token_costs) |
There was a problem hiding this comment.
refs to https://docs.deepwisdom.ai/main/en/guide/contribute/contribute_guide.html#before-submission to use pre-commit before commit.
metagpt/provider/own_api.py
Outdated
| 'Content-Type': 'application/json' | ||
| } | ||
| resp_json = None | ||
| for i in range(666): |
| ) | ||
|
|
||
| @register_provider(LLMType.SHAHE) | ||
| class OwnLLM(BaseLLM): |
There was a problem hiding this comment.
why another own_api.py?
metagpt/provider/own_api.py
Outdated
|
|
||
|
|
||
| def __init_ownapi(self): | ||
| # finish your own init |
There was a problem hiding this comment.
seems not a complete code
| ) | ||
|
|
||
| @register_provider(LLMType.SHAHE) | ||
| class OwnLLM(BaseLLM): |
There was a problem hiding this comment.
should add unit-test code
| ) | ||
|
|
||
| @register_provider(LLMType.SHAHE) | ||
| class OwnLLM(BaseLLM): |
There was a problem hiding this comment.
what's the difference with https://github.com/geekan/MetaGPT/blob/main/metagpt/provider/qianfan_api.py
修改了之前的问题
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
在provider增加了own_api.py
这段代码是一个用于调用百度智能云千帆大模型平台API服务的Python模块。它定义了一个名为
ShaheLLM的类，该类继承自BaseLLM，并通过register_provider装饰器注册为语言模型提供者。以下是代码的功能和主要部分的介绍：导入模块
代码首先导入了多个标准库和第三方库，包括
qianfan库以及自定义的metagpt模块。注册提供者
通过
register_provider装饰器将ShaheLLM类注册为LLMType.SHAHE类型的提供者。类的文档字符串包含了一些参考链接，指向百度智能云千帆大模型平台的相关文档。初始化方法
__init__和__init_shahe方法负责初始化配置，包括设置环境变量、验证配置中的模型和端点、更新token费用、以及初始化ChatCompletion对象。辅助方法
_const_kwargs：构建请求参数。_update_costs：更新每次请求的token费用。get_choice_text：从响应中获取结果文本。request_eb_dynamic_ppo：向ERNIE-Bot发送请求并获取响应。completion：执行一次对话并返回结果。_achat_completion和acompletion：异步执行对话。_achat_completion_stream：异步流式执行对话。主要功能
request_eb_dynamic_ppo方法向ERNIE-Bot发送请求。结论
这段代码是一个复杂的Python模块，设计用于与百度智能云千帆大模型平台进行交互。它提供了配置初始化、请求发送、响应处理和异步支持等功能，适用于多种对话和续写任务。