Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Bring cog demo up to date with rewritten llava code in upstream #4

Draft
wants to merge 63 commits into
base: main
Choose a base branch
from
Draft

Bring cog demo up to date with rewritten llava code in upstream #4

wants to merge 63 commits into from

Commits on Nov 10, 2023

  1. Update README.md

    @ChunyuanLI
    ChunyuanLI authored Nov 10, 2023
    Configuration menu
    Copy the full SHA
    786aa6a View commit details
    Browse the repository at this point in the history

Commits on Nov 13, 2023

  1. Update README.md

    @ChunyuanLI
    ChunyuanLI authored Nov 13, 2023
    Configuration menu
    Copy the full SHA
    80540fb View commit details
    Browse the repository at this point in the history

Commits on Nov 17, 2023

  1. Update README.md

    @ChunyuanLI
    ChunyuanLI authored Nov 17, 2023
    Configuration menu
    Copy the full SHA
    414cebd View commit details
    Browse the repository at this point in the history

Commits on Nov 24, 2023

  1. 🩹 make load_pretrained_model accept kwargs 

    - this allows it to e.g. take a ``cache_dir`` argument
    @l-salewski
    l-salewski committed Nov 24, 2023
    Configuration menu
    Copy the full SHA
    8fa7f58 View commit details
    Browse the repository at this point in the history

  2. Merge pull request haotian-liu#851 from l-salewski/kwargs-for-model-l… 

    …oading

🩹 make ``load_pretrained_model`` accept kwargs
    @haotian-liu
    haotian-liu authored Nov 24, 2023
    Configuration menu
    Copy the full SHA
    2ca20de View commit details
    Browse the repository at this point in the history

Commits on Nov 27, 2023

  1. Revert "use images instead of image to match model.forward kwarg"

    @haotian-liu
    haotian-liu authored Nov 27, 2023
    Configuration menu
    Copy the full SHA
    31cceb8 View commit details
    Browse the repository at this point in the history

  2. Merge pull request haotian-liu#866 from haotian-liu/revert-694-images… 

    …-name-fix

Revert "use images instead of image to match model.forward kwarg"
    @haotian-liu
    haotian-liu authored Nov 27, 2023
    Configuration menu
    Copy the full SHA
    82fc5e0 View commit details
    Browse the repository at this point in the history

Commits on Nov 30, 2023

  1. Fix args missing in readme

    @philokey
    philokey committed Nov 30, 2023
    Configuration menu
    Copy the full SHA
    d45daf9 View commit details
    Browse the repository at this point in the history

Commits on Dec 4, 2023

  1. Update Intel.md 

    Extention -> Extension
    @eltociear
    eltociear authored Dec 4, 2023
    Configuration menu
    Copy the full SHA
    0e0eccf View commit details
    Browse the repository at this point in the history

  2. Merge pull request haotian-liu#894 from eltociear/patch-4 

    Update Intel.md
    @haotian-liu
    haotian-liu authored Dec 4, 2023
    Configuration menu
    Copy the full SHA
    fda0e8a View commit details
    Browse the repository at this point in the history

  3. Merge pull request haotian-liu#879 from philokey/qts/fix_readme 

    Fix args missing in readme
    @haotian-liu
    haotian-liu authored Dec 4, 2023
    Configuration menu
    Copy the full SHA
    7775b12 View commit details
    Browse the repository at this point in the history

Commits on Dec 22, 2023

  1. Update README.md

    @haotian-liu
    haotian-liu authored Dec 22, 2023
    Configuration menu
    Copy the full SHA
    ba72f82 View commit details
    Browse the repository at this point in the history

  2. Update README.md

    @haotian-liu
    haotian-liu authored Dec 22, 2023
    Configuration menu
    Copy the full SHA
    2120e82 View commit details
    Browse the repository at this point in the history

Commits on Dec 28, 2023

  1. Update README.md

    @haotian-liu
    haotian-liu authored Dec 28, 2023
    Configuration menu
    Copy the full SHA
    9a26bd1 View commit details
    Browse the repository at this point in the history

Commits on Jan 28, 2024

  1. Update MODEL_ZOO.md 

    T-VQA should be TextVQA to avoid confusion.

(first result for T-VQA is [TVQA](https://arxiv.org/abs/1809.01696) and not TextVQA)
    @simon-lund
    simon-lund authored Jan 28, 2024
    Configuration menu
    Copy the full SHA
    d3fcd32 View commit details
    Browse the repository at this point in the history

  2. Merge pull request haotian-liu#1023 from simon-lund/patch-1 

    Update MODEL_ZOO.md
    @haotian-liu
    haotian-liu authored Jan 28, 2024
    Configuration menu
    Copy the full SHA
    ac89962 View commit details
    Browse the repository at this point in the history

Commits on Jan 31, 2024

  1. Release LLaVA-v1.6

    @haotian-liu
    haotian-liu committed Jan 31, 2024
    Configuration menu
    Copy the full SHA
    0a16dea View commit details
    Browse the repository at this point in the history

  2. Update README.md

    @haotian-liu
    haotian-liu authored Jan 31, 2024
    Configuration menu
    Copy the full SHA
    c51666b View commit details
    Browse the repository at this point in the history

  3. Update MODEL_ZOO.md

    @haotian-liu
    haotian-liu authored Jan 31, 2024
    Configuration menu
    Copy the full SHA
    ac6b1e7 View commit details
    Browse the repository at this point in the history

  4. Update cli.py for LLaVA-v1.6 

    Pass image_size to model.generate() in cli.py
    @heltrix
    heltrix authored Jan 31, 2024
    Configuration menu
    Copy the full SHA
    7d0b5f9 View commit details
    Browse the repository at this point in the history

Commits on Feb 1, 2024

  1. Update cli.py

    @haotian-liu
    haotian-liu authored Feb 1, 2024
    Configuration menu
    Copy the full SHA
    4718611 View commit details
    Browse the repository at this point in the history

  2. Merge pull request haotian-liu#1038 from heltrix/patch-1 

    [Fix] Add image_sizes for cli.py for LLaVA-v1.6
    @haotian-liu
    haotian-liu authored Feb 1, 2024
    Configuration menu
    Copy the full SHA
    c878cc3 View commit details
    Browse the repository at this point in the history

  3. Fix training.

    @haotian-liu
    haotian-liu committed Feb 1, 2024
    Configuration menu
    Copy the full SHA
    879ef31 View commit details
    Browse the repository at this point in the history

  4. No need to replace the monkey patch.

    @haotian-liu
    haotian-liu committed Feb 1, 2024
    Configuration menu
    Copy the full SHA
    4afcebd View commit details
    Browse the repository at this point in the history

Commits on Feb 2, 2024

  1. Update README.md

    @haotian-liu
    haotian-liu authored Feb 2, 2024
    Configuration menu
    Copy the full SHA
    49fb2f4 View commit details
    Browse the repository at this point in the history

  2. Prevent failing if tensors are of different shape

    @timabdulla
    timabdulla committed Feb 2, 2024
    Configuration menu
    Copy the full SHA
    dc32c3f View commit details
    Browse the repository at this point in the history

  3. Update README.md

    @haotian-liu
    haotian-liu authored Feb 2, 2024
    Configuration menu
    Copy the full SHA
    de8a664 View commit details
    Browse the repository at this point in the history

  4. Update README.md

    @haotian-liu
    haotian-liu authored Feb 2, 2024
    Configuration menu
    Copy the full SHA
    137173b View commit details
    Browse the repository at this point in the history

  5. Fix run_llava.py

    @haotian-liu
    haotian-liu committed Feb 2, 2024
    Configuration menu
    Copy the full SHA
    498e18d View commit details
    Browse the repository at this point in the history

  6. Fix multiple GPU inference.

    @haotian-liu
    haotian-liu committed Feb 2, 2024
    Configuration menu
    Copy the full SHA
    4c92669 View commit details
    Browse the repository at this point in the history

  7. Merge pull request haotian-liu#1057 from haotian-liu/fix-multiple-gpu 

    Fix multiple GPU inference.
    @haotian-liu
    haotian-liu authored Feb 2, 2024
    Configuration menu
    Copy the full SHA
    1564e67 View commit details
    Browse the repository at this point in the history

Commits on Feb 3, 2024

  1. Bump version to 1.2.1

    @haotian-liu
    haotian-liu committed Feb 3, 2024
    Configuration menu
    Copy the full SHA
    c03b054 View commit details
    Browse the repository at this point in the history

  2. Add upload pypi scripts

    @haotian-liu
    haotian-liu committed Feb 3, 2024
    Configuration menu
    Copy the full SHA
    2c612f5 View commit details
    Browse the repository at this point in the history

  3. Update gradio web server dir

    @haotian-liu
    haotian-liu committed Feb 3, 2024
    Configuration menu
    Copy the full SHA
    5204cb4 View commit details
    Browse the repository at this point in the history

  4. Upgrade gradio server version.

    @haotian-liu
    haotian-liu committed Feb 3, 2024
    Configuration menu
    Copy the full SHA
    f04e1cc View commit details
    Browse the repository at this point in the history

  5. Merge pull request haotian-liu#1056 from timabdulla/fix-keyword-stopp… 

    …ing-size-mismatch

Prevent failing if tensors are of different shape
    @haotian-liu
    haotian-liu authored Feb 3, 2024
    Configuration menu
    Copy the full SHA
    0b5397e View commit details
    Browse the repository at this point in the history

  6. Fix

    @haotian-liu
    haotian-liu committed Feb 3, 2024
    Configuration menu
    Copy the full SHA
    ad79a5d View commit details
    Browse the repository at this point in the history

  7. Merge branch 'main' of https://github.com/haotian-liu/LLaVA into main

    @haotian-liu
    haotian-liu committed Feb 3, 2024
    Configuration menu
    Copy the full SHA
    d4c2f1f View commit details
    Browse the repository at this point in the history

  8. Improve serving.

    @haotian-liu
    haotian-liu committed Feb 3, 2024
    Configuration menu
    Copy the full SHA
    806cfe0 View commit details
    Browse the repository at this point in the history

  9. Add SGLang doc and update dependencies.

    @haotian-liu
    haotian-liu committed Feb 3, 2024
    Configuration menu
    Copy the full SHA
    d41ab72 View commit details
    Browse the repository at this point in the history

  10. Fix worker hang

    @haotian-liu
    haotian-liu committed Feb 3, 2024
    Configuration menu
    Copy the full SHA
    63c1055 View commit details
    Browse the repository at this point in the history

Commits on Feb 4, 2024

  1. Fix deepspeed version

    @haotian-liu
    haotian-liu committed Feb 4, 2024
    Configuration menu
    Copy the full SHA
    24fa1d0 View commit details
    Browse the repository at this point in the history

  2. Disable keyword stopping criterion and rely on hf eos token instead.

    @haotian-liu
    haotian-liu committed Feb 4, 2024
    Configuration menu
    Copy the full SHA
    da83c48 View commit details
    Browse the repository at this point in the history

Commits on Feb 5, 2024

  1. Fix

    @haotian-liu
    haotian-liu committed Feb 5, 2024
    Configuration menu
    Copy the full SHA
    4b3febd View commit details
    Browse the repository at this point in the history

  2. Merge branch 'sglang' into main

    @haotian-liu
    haotian-liu committed Feb 5, 2024
    Configuration menu
    Copy the full SHA
    237f81f View commit details
    Browse the repository at this point in the history

  3. Merge pull request haotian-liu#1074 from haotian-liu/sglang 

    Add Sglang docs
    @haotian-liu
    haotian-liu authored Feb 5, 2024
    Configuration menu
    Copy the full SHA
    be683a6 View commit details
    Browse the repository at this point in the history

  4. Merge branch 'main' of github.com:haotian-liu/LLaVA into main

    @haotian-liu
    haotian-liu committed Feb 5, 2024
    Configuration menu
    Copy the full SHA
    329e070 View commit details
    Browse the repository at this point in the history

Commits on Feb 6, 2024

  1. Always start a new conversation when an image is uploaded. haotian-li… 

    …u#1086
    @haotian-liu
    haotian-liu committed Feb 6, 2024
    Configuration menu
    Copy the full SHA
    f1c3c01 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'main' of github.com:haotian-liu/LLaVA into main

    @haotian-liu
    haotian-liu committed Feb 6, 2024
    Configuration menu
    Copy the full SHA
    159c8b0 View commit details
    Browse the repository at this point in the history

  3. Fix lora loading haotian-liu#1075

    @haotian-liu
    haotian-liu committed Feb 6, 2024
    Configuration menu
    Copy the full SHA
    04fb03d View commit details
    Browse the repository at this point in the history

Commits on Feb 7, 2024

  1. Update README.md

    @haotian-liu
    haotian-liu authored Feb 7, 2024
    Configuration menu
    Copy the full SHA
    49540fe View commit details
    Browse the repository at this point in the history

  2. Fix haotian-liu#1050

    @haotian-liu
    haotian-liu authored Feb 7, 2024
    Configuration menu
    Copy the full SHA
    b42a13d View commit details
    Browse the repository at this point in the history

  3. Fix decoding in cli.py

    @haotian-liu
    haotian-liu authored Feb 7, 2024
    Configuration menu
    Copy the full SHA
    188ac52 View commit details
    Browse the repository at this point in the history

  4. Fix decoding in cli.py

    @haotian-liu
    haotian-liu authored Feb 7, 2024
    Configuration menu
    Copy the full SHA
    28b96e2 View commit details
    Browse the repository at this point in the history

Commits on Feb 9, 2024

  1. Update README.md

    @haotian-liu
    haotian-liu authored Feb 9, 2024
    Configuration menu
    Copy the full SHA
    1a91fc2 View commit details
    Browse the repository at this point in the history

Commits on Feb 15, 2024

  1. Update README.md

    @haotian-liu
    haotian-liu authored Feb 15, 2024
    Configuration menu
    Copy the full SHA
    fe82008 View commit details
    Browse the repository at this point in the history

  2. Update README.md

    @haotian-liu
    haotian-liu authored Feb 15, 2024
    Configuration menu
    Copy the full SHA
    d080696 View commit details
    Browse the repository at this point in the history

  3. Update README.md

    @haotian-liu
    haotian-liu authored Feb 15, 2024
    Configuration menu
    Copy the full SHA
    5d8f176 View commit details
    Browse the repository at this point in the history

Commits on Mar 10, 2024

  1. Update README.md

    @ChunyuanLI
    ChunyuanLI authored Mar 10, 2024
    Configuration menu
    Copy the full SHA
    7440ec9 View commit details
    Browse the repository at this point in the history

Commits on Mar 24, 2024

  1. Update README.md

    @haotian-liu
    haotian-liu authored Mar 24, 2024
    Configuration menu
    Copy the full SHA
    4e2277a View commit details
    Browse the repository at this point in the history

Commits on Apr 2, 2024

  1. Merge branch 'main' of github.com:haotian-liu/LLaVA into merge-upstre… 

    …am-2404
    @jd7h
    jd7h committed Apr 2, 2024
    Configuration menu
    Copy the full SHA
    7f5287c View commit details
    Browse the repository at this point in the history

  2. Make cog demo compatible with upstream rewrite 

    Add device_map param to model loader
Add image_size param to text generation
    @jd7h
    jd7h committed Apr 2, 2024
    Configuration menu
    Copy the full SHA
    ac3c77c View commit details
    Browse the repository at this point in the history

Commits on Apr 8, 2024

  1. Fix missing parameter in LlamaForCausalLM class

    @jd7h
    jd7h committed Apr 8, 2024
    Configuration menu
    Copy the full SHA
    9e35bcb View commit details
    Browse the repository at this point in the history