Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Description
As a dev, I want to test my RAG application on its capability so that I can evaluate how well it performs.
Acceptance Criteria
Implementation of the following metrics from RAGAS:
Faithfulness
Answer Correctness
Answer Relevance
Context Precision
Context Recall
https://docs.ragas.io/en/stable/getstarted/install.html
Establish a connection to an RAG to retrieve the "context" input
Motivation and Context
As a dev, I want to test my RAG application on its capability so that I can evaluate how well it performs.
Acceptance Criteria
Implementation of the following metrics from RAGAS:
Faithfulness
Answer Correctness
Answer Relevance
Context Precision
Context Recall
https://docs.ragas.io/en/stable/getstarted/install.html
Establish a connection to an RAG to retrieve the "context" input
Type of Change
How to Test
There are huge changes in this ticket. Please test it properly and thoroughly.
There is a zip files that contains scripts and so on.
Steps:
Update your azure-langchain-openai-chatopenai-gpt4o.json and azure-langchain-openai-embedding-ada-2 with our azure openai key and uri.
Check if you need to modify setup_api_tera.sh to run forked tera-sample-files or tera-sample-files. You should be using forked tera-sample-files.
Proceed to setup TERA.
3.1 Create a new terminal
3.2 Create venv by using python -m venv venv
3.3 Activate the virtual environment
3.4 Run the script using ./setup_api_tera.sh (SEED Must be off.)
3.5 It will clone and install requirements and run docker and start the fastapi service.
You can test using POSTMAN on the endpoints (localhost:8000/get_agent_context and localhost:8000/get_agent_response).
So if that works, proceed to the next step.
run_recipe "myrag" "['test-rag-recipe']" "['tera-connector']" -n 1 -r 1 -s "You are an intelligent AI"
Checklist
Please check all the boxes that apply to this pull request using "x":
Screenshots (if applicable)
[If the changes involve visual modifications, include screenshots or GIFs that demonstrate the changes.]
Additional Notes
[Add any additional information or context that might be relevant to reviewers.]
Developer Certificate of Origin