talk_to_images_with_gemini

Flask web application built with Gemini and Spire to talk to images in PDF

Steps

1. Get an OPEN AI API KEY for TruLens evaluation
2. Get Google API KEY to use Gemini Pro Vision
3. add the keys in line 11 and 12 respectively of the code
4. pip install -r requirements.txt
5. export FLASK_APP=app.py
6. flask run

Demo screenshots

English question : How much did Contrastive COT score in Arithematic Reasoning?

Uploaded PDF: https://github.com/Raghavan1988/talk_to_images_with_gemini/blob/main/uploads/Survey_of_prompt_engineering_techniques_and_challenges.docx.pdf

Spanish Translation: ¿Cuánto obtuvo COT contrastivo en razonamiento aritmético?

Ask the question in Spanish to Gemini

Gemini's response

Gemini responded in english saying Contrastive COT scored 79.

Relevant image from the PDF

Trulens Eval dashboard

Terminal Log for verification