Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Pull Request
Description
This pull request introduces a Mech tool to establish Subject Matter Expert (SME) roles for specific market-related questions. The resulting SME introduction can serve as a system prompt to guide downstream language models (LLMs) in answering those questions.
Currently, AI Mech works primarily with proprietary LLMs like GPT-3.5 and GPT-4 due to their strong generalization abilities. However, this tool has the potential to integrate other specialized domain LLMs for decision-making in specific areas. For instance, we can fine-tune an open-source LLM with content related to blockchain and quantitative finance to enhance its expertise in blockchain investment and probability estimation. This enables us to address questions like, "Will Tether cause a crypto market collapse by the end of 2024?" We can also manage risk preferences for these fine-tuned roles in line with our investment strategy.
Furthermore, the trading community can collaborate to develop a set of domain-specific LLMs to address a wide array of questions and contribute additional tools that can leverage the capabilities of these domain-specific LLMs within the Mech ecosystem.
Flow Diagram
Changes
sme_role_system_prompt
in themech/tools/prediction_request.py
Additional Notes