Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Does MiniGPT4 support multiple image uploading? #180

Open
Leon1207 opened this issue May 2, 2023 · 4 comments · May be fixed by #232
Open

Does MiniGPT4 support multiple image uploading? #180

Leon1207 opened this issue May 2, 2023 · 4 comments · May be fixed by #232

Comments

@Leon1207
Copy link

Leon1207 commented May 2, 2023

In some applications, you need to upload multiple pictures, clearly describe some scenes, and ask questions about the scenes. May I ask whether MiniGPT4 supports this practice?
@feymanwang
Copy link

I guess MiniGPT-4 can't support multiple images , but you can do these with a little bit extra works.
Some suggestions I have tried maybe help you :

  1. use MiniGPT-4 to describe images as detailed as possible, try the best to get maximum information from the images
  2. use LLM as controller ,such as vincua、llama and so on, to finish your task. The information you get from images are the inputs of LLM, and you can prompt you question to LLM controller based on the inputs

@Leon1207
Copy link
Author

Leon1207 commented May 6, 2023

Thanks for your advice!

@ifsheldon
Copy link

It can. In fact, I am drafting a PR to enable this.

@ifsheldon ifsheldon linked a pull request May 17, 2023 that will close this issue
Open
@wwcc1107
Copy link

It can. In fact, I am drafting a PR to enable this.

hi,i think you will do a nice work,can you send me your work about supporting multiple images uploading to me?thanks!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

Enable uploading multiple images in demo.py ifsheldon/MiniGPT-4
4 participants
@feymanwang @ifsheldon @Leon1207 @wwcc1107