Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Feat v1.1 Updates to chat client, retrieval, and evauations #54

Merged
merged 74 commits into from
Feb 12, 2024
Merged

Feat v1.1 Updates to chat client, retrieval, and evauations #54

merged 74 commits into from
Feb 12, 2024

Commits on Dec 15, 2023

  1. feat: add initial evaluation code

    Bharat Ramanathan committed Dec 15, 2023
    Configuration menu
    Copy the full SHA
    3469d33 View commit details
    Browse the repository at this point in the history

  2. feat: add more updates and caching to eval process

    Bharat Ramanathan committed Dec 15, 2023
    Configuration menu
    Copy the full SHA
    5f740b3 View commit details
    Browse the repository at this point in the history

  3. feat: add additional few-shot result example for reasoning about scor… 

    …ing.
    Bharat Ramanathan committed Dec 15, 2023
    Configuration menu
    Copy the full SHA
    c3f84e3 View commit details
    Browse the repository at this point in the history

Commits on Dec 18, 2023

  1. feat: add retrieval endpoint, fix language filters and ad caching in … 

    …evals
    Bharat Ramanathan committed Dec 18, 2023
    Configuration menu
    Copy the full SHA
    277c79d View commit details
    Browse the repository at this point in the history

Commits on Dec 19, 2023

  1. feat: add hybrid index retrieval with bm25 and you.com results

    @parambharat
    parambharat committed Dec 19, 2023
    Configuration menu
    Copy the full SHA
    bf19259 View commit details
    Browse the repository at this point in the history

Commits on Dec 20, 2023

  1. feat: use litellm instead of openai to allow cohere and anthropic models

    @parambharat
    parambharat committed Dec 20, 2023
    Configuration menu
    Copy the full SHA
    55b0c4f View commit details
    Browse the repository at this point in the history

Commits on Dec 21, 2023

  1. feat: add reports dataloader

    @parambharat
    parambharat committed Dec 21, 2023
    Configuration menu
    Copy the full SHA
    02aa6da View commit details
    Browse the repository at this point in the history

Commits on Dec 22, 2023

  1. feat: add improve ingestion pipeline with better parsing and metadata

    @parambharat
    parambharat committed Dec 22, 2023
    Configuration menu
    Copy the full SHA
    4ebfd25 View commit details
    Browse the repository at this point in the history

  2. feat: add new query handler and chat prompt

    @parambharat
    parambharat committed Dec 22, 2023
    Configuration menu
    Copy the full SHA
    1c32d78 View commit details
    Browse the repository at this point in the history

Commits on Dec 26, 2023

  1. feat: separate out the query handler and retriever from the chat inte… 

    …rface
    @parambharat
    parambharat committed Dec 26, 2023
    Configuration menu
    Copy the full SHA
    fb0f06c View commit details
    Browse the repository at this point in the history

  2. chore: run linters and formatters

    @parambharat
    parambharat committed Dec 26, 2023
    Configuration menu
    Copy the full SHA
    c37ccc5 View commit details
    Browse the repository at this point in the history

Commits on Dec 27, 2023

  1. feat: update prompting method with a better templated prompt.

    @parambharat
    parambharat committed Dec 27, 2023
    Configuration menu
    Copy the full SHA
    6b52990 View commit details
    Browse the repository at this point in the history

  2. fix: json formatting errors and issues

    @parambharat
    parambharat committed Dec 27, 2023
    Configuration menu
    Copy the full SHA
    0c869fc View commit details
    Browse the repository at this point in the history

  3. fix: json formatting errors and issues

    @parambharat
    parambharat committed Dec 27, 2023
    Configuration menu
    Copy the full SHA
    94a0e5b View commit details
    Browse the repository at this point in the history

  4. chore: run formatters and linters

    @parambharat
    parambharat committed Dec 27, 2023
    Configuration menu
    Copy the full SHA
    c71f4d5 View commit details
    Browse the repository at this point in the history

  5. feat: fix chat prompt logging in streamtable

    @parambharat
    parambharat committed Dec 27, 2023
    Configuration menu
    Copy the full SHA
    d114363 View commit details
    Browse the repository at this point in the history

Commits on Dec 28, 2023

  1. fix: slack message formatting to mrkdwn

    @parambharat
    parambharat committed Dec 28, 2023
    Configuration menu
    Copy the full SHA
    60ded81 View commit details
    Browse the repository at this point in the history

  2. fix: manually implement partial formatting for placeholder

    @parambharat
    parambharat committed Dec 28, 2023
    Configuration menu
    Copy the full SHA
    86d38a7 View commit details
    Browse the repository at this point in the history

  3. fix: pydanticv1 compatibility for ResolvedQuery with llama-index

    @parambharat
    parambharat committed Dec 28, 2023
    Configuration menu
    Copy the full SHA
    16b83c1 View commit details
    Browse the repository at this point in the history

  4. feat: add condensed chat history retriever.

    @parambharat
    parambharat committed Dec 28, 2023
    Configuration menu
    Copy the full SHA
    6a746fc View commit details
    Browse the repository at this point in the history

Commits on Jan 8, 2024

  1. feat: add query enhancer to the chat client with keywords and sub que… 

    …ries
    @parambharat
    parambharat committed Jan 8, 2024
    Configuration menu
    Copy the full SHA
    915f440 View commit details
    Browse the repository at this point in the history

  2. chore: run formatters and linters

    @parambharat
    parambharat committed Jan 8, 2024
    Configuration menu
    Copy the full SHA
    870723f View commit details
    Browse the repository at this point in the history

Commits on Jan 9, 2024

  1. fix: timezone issues in timer util

    @parambharat
    parambharat committed Jan 9, 2024
    Configuration menu
    Copy the full SHA
    ac5ce0f View commit details
    Browse the repository at this point in the history

Commits on Jan 11, 2024

  1. feat: improve fc reports ingestion pipeline

    @parambharat
    parambharat committed Jan 11, 2024
    Configuration menu
    Copy the full SHA
    4c68876 View commit details
    Browse the repository at this point in the history

  2. feat: change chunk size of markdown and code documents

    @parambharat
    parambharat committed Jan 11, 2024
    Configuration menu
    Copy the full SHA
    912576b View commit details
    Browse the repository at this point in the history

  3. feat: add include and exclude tag filters

    @parambharat
    parambharat committed Jan 11, 2024
    Configuration menu
    Copy the full SHA
    8679c8a View commit details
    Browse the repository at this point in the history

  4. fix: return metadata instead of only source during retrieval

    @parambharat
    parambharat committed Jan 11, 2024
    Configuration menu
    Copy the full SHA
    930bb98 View commit details
    Browse the repository at this point in the history

  5. fix: add launch in query feature description

    @parambharat
    parambharat committed Jan 11, 2024
    Configuration menu
    Copy the full SHA
    7b7c7d1 View commit details
    Browse the repository at this point in the history

  6. fix: reduce discord char chunking limit to reduce failures after mess… 

    …age formatting.
    @parambharat
    parambharat committed Jan 11, 2024
    Configuration menu
    Copy the full SHA
    fa99095 View commit details
    Browse the repository at this point in the history

  7. chore: update libraries and versions and add new eval

    @parambharat
    parambharat committed Jan 11, 2024
    Configuration menu
    Copy the full SHA
    fd52ff6 View commit details
    Browse the repository at this point in the history

Commits on Jan 12, 2024

  1. chore: run formatters and sort imports

    @parambharat
    parambharat committed Jan 12, 2024
    Configuration menu
    Copy the full SHA
    53494e5 View commit details
    Browse the repository at this point in the history

  2. fix: move arrangement of source in system prompt

    @parambharat
    parambharat committed Jan 12, 2024
    Configuration menu
    Copy the full SHA
    60becef View commit details
    Browse the repository at this point in the history

  3. fix: move metadata postprocessor before language filter

    @parambharat
    parambharat committed Jan 12, 2024
    Configuration menu
    Copy the full SHA
    68786be View commit details
    Browse the repository at this point in the history

  4. chore: run formatters and linters

    @parambharat
    parambharat committed Jan 12, 2024
    Configuration menu
    Copy the full SHA
    4fe3c8a View commit details
    Browse the repository at this point in the history

  5. chore: update langchain and fix broken dependencies and code

    @parambharat
    parambharat committed Jan 12, 2024
    Configuration menu
    Copy the full SHA
    3ea5b51 View commit details
    Browse the repository at this point in the history

Commits on Jan 16, 2024

  1. fix: change retrieval defaults and cache backed embeddings

    @parambharat
    parambharat committed Jan 16, 2024
    Configuration menu
    Copy the full SHA
    50f90e4 View commit details
    Browse the repository at this point in the history

Commits on Jan 17, 2024

  1. chore: run linters and formatters

    @parambharat
    parambharat committed Jan 17, 2024
    Configuration menu
    Copy the full SHA
    c9d3714 View commit details
    Browse the repository at this point in the history

Commits on Jan 18, 2024

  1. fix: timer issues not recoding end time correctly

    @parambharat
    parambharat committed Jan 18, 2024
    Configuration menu
    Copy the full SHA
    25cd7cc View commit details
    Browse the repository at this point in the history

  2. fix: issue with other query type description

    @parambharat
    parambharat committed Jan 18, 2024
    Configuration menu
    Copy the full SHA
    bede513 View commit details
    Browse the repository at this point in the history

  3. feat: update eval visualization code with all models and charts

    @parambharat
    parambharat committed Jan 18, 2024
    Configuration menu
    Copy the full SHA
    f34c2ee View commit details
    Browse the repository at this point in the history

Commits on Jan 19, 2024

  1. feat: avoid retrieving results from you for some intents

    @parambharat
    parambharat committed Jan 19, 2024
    Configuration menu
    Copy the full SHA
    3238316 View commit details
    Browse the repository at this point in the history

  2. update setting fc reports content to type str

    Morgan McGuire authored and Morgan McGuire committed Jan 19, 2024
    Configuration menu
    Copy the full SHA
    9b0239d View commit details
    Browse the repository at this point in the history

Commits on Jan 22, 2024

  1. feat: add langdetect, fix report parsing and add ml-news tag

    @parambharat
    parambharat committed Jan 22, 2024
    Configuration menu
    Copy the full SHA
    b978e3e View commit details
    Browse the repository at this point in the history

  2. adds error handling for invalid unicode sequences

    Morgan McGuire authored and Morgan McGuire committed Jan 22, 2024
    Configuration menu
    Copy the full SHA
    8995dec View commit details
    Browse the repository at this point in the history

  3. Merge branch 'feat/v1.1' of https://github.com/wandb/wandbot into fea… 

    …t/v1.1
    Morgan McGuire authored and Morgan McGuire committed Jan 22, 2024
    Configuration menu
    Copy the full SHA
    0282668 View commit details
    Browse the repository at this point in the history

  4. re-add repr

    Morgan McGuire authored and Morgan McGuire committed Jan 22, 2024
    Configuration menu
    Copy the full SHA
    6fe85ec View commit details
    Browse the repository at this point in the history

  5. bump project version to 1.1

    Morgan McGuire authored and Morgan McGuire committed Jan 22, 2024
    Configuration menu
    Copy the full SHA
    e6508dc View commit details
    Browse the repository at this point in the history

  6. fix: embedding chunk size issue in reports ingestion

    @parambharat
    parambharat committed Jan 22, 2024
    Configuration menu
    Copy the full SHA
    bcbaa8a View commit details
    Browse the repository at this point in the history

  7. Merge branch 'feat/v1.1' of github.com:wandb/wandbot into feat/v1.1

    @parambharat
    parambharat committed Jan 22, 2024
    Configuration menu
    Copy the full SHA
    e14fab1 View commit details
    Browse the repository at this point in the history

  8. fix: switch to token text splitter for larger chunks

    @parambharat
    parambharat committed Jan 22, 2024
    Configuration menu
    Copy the full SHA
    a6ea55e View commit details
    Browse the repository at this point in the history

Commits on Jan 23, 2024

  1. feat: add wandb edu code loader

    @parambharat
    parambharat committed Jan 23, 2024
    Configuration menu
    Copy the full SHA
    28a9404 View commit details
    Browse the repository at this point in the history

  2. fix: errors in code parsing logic

    @parambharat
    parambharat committed Jan 23, 2024
    Configuration menu
    Copy the full SHA
    c6a12ab View commit details
    Browse the repository at this point in the history

  3. fix: improve retrieval speed by loading retrievers at startup.

    @parambharat
    parambharat committed Jan 23, 2024
    Configuration menu
    Copy the full SHA
    34d87d5 View commit details
    Browse the repository at this point in the history

  4. add dev depenencies to pyproject.toml

    Morgan McGuire authored and Morgan McGuire committed Jan 23, 2024
    Configuration menu
    Copy the full SHA
    f3965dd View commit details
    Browse the repository at this point in the history

Commits on Jan 24, 2024

  1. update tags logic for FC Reports

    Morgan McGuire authored and Morgan McGuire committed Jan 24, 2024
    Configuration menu
    Copy the full SHA
    1ebf69b View commit details
    Browse the repository at this point in the history

  2. add fastext model artifact and add fc tag logic

    Morgan McGuire authored and Morgan McGuire committed Jan 24, 2024
    Configuration menu
    Copy the full SHA
    c9229f5 View commit details
    Browse the repository at this point in the history

  3. fix model_ naming to keep pydantic happy

    Morgan McGuire authored and Morgan McGuire committed Jan 24, 2024
    Configuration menu
    Copy the full SHA
    5a30dc8 View commit details
    Browse the repository at this point in the history

  4. fix fasttext path

    Morgan McGuire authored and Morgan McGuire committed Jan 24, 2024
    Configuration menu
    Copy the full SHA
    f4bc728 View commit details
    Browse the repository at this point in the history

  5. fix langdetect fasttext model loading

    Morgan McGuire authored and Morgan McGuire committed Jan 24, 2024
    Configuration menu
    Copy the full SHA
    5f38fc6 View commit details
    Browse the repository at this point in the history

  6. exclude dev dependencies in build file

    Morgan McGuire authored and Morgan McGuire committed Jan 24, 2024
    Configuration menu
    Copy the full SHA
    eac6f21 View commit details
    Browse the repository at this point in the history

  7. new build-dev.sh file to install all dependencies, including dev depe… 

    …ndencies
    Morgan McGuire authored and Morgan McGuire committed Jan 24, 2024
    Configuration menu
    Copy the full SHA
    30c9083 View commit details
    Browse the repository at this point in the history

Commits on Jan 25, 2024

  1. add no-result dummy node creation if needed

    Morgan McGuire authored and Morgan McGuire committed Jan 25, 2024
    Configuration menu
    Copy the full SHA
    b403be4 View commit details
    Browse the repository at this point in the history

  2. update licence field

    Morgan McGuire authored and Morgan McGuire committed Jan 25, 2024
    Configuration menu
    Copy the full SHA
    20070e9 View commit details
    Browse the repository at this point in the history

  3. copy pyproject that works in deployment

    Morgan McGuire authored and Morgan McGuire committed Jan 25, 2024
    Configuration menu
    Copy the full SHA
    e3d733c View commit details
    Browse the repository at this point in the history

Commits on Jan 26, 2024

  1. re-adds zendesk app to run.sh

    Morgan McGuire authored and Morgan McGuire committed Jan 26, 2024
    Configuration menu
    Copy the full SHA
    ee325a0 View commit details
    Browse the repository at this point in the history

Commits on Jan 31, 2024

  1. fix: replace headers in slack formatter with bold text

    @parambharat
    parambharat committed Jan 31, 2024
    Configuration menu
    Copy the full SHA
    386c576 View commit details
    Browse the repository at this point in the history

  2. refactor: move FastText language detection to common utils

    @parambharat
    parambharat committed Jan 31, 2024
    Configuration menu
    Copy the full SHA
    b04c663 View commit details
    Browse the repository at this point in the history

  3. feat: switch from cohere lang detect to fasttext langdetect

    @parambharat
    parambharat committed Jan 31, 2024
    Configuration menu
    Copy the full SHA
    1ea8cdb View commit details
    Browse the repository at this point in the history

  4. chore: install fasttext using pip instead of poetry and update lock file

    @parambharat
    parambharat committed Jan 31, 2024
    Configuration menu
    Copy the full SHA
    0b7983d View commit details
    Browse the repository at this point in the history

  5. chore: add fasttext to dev install in addition to prod install

    @parambharat
    parambharat committed Jan 31, 2024
    Configuration menu
    Copy the full SHA
    6b3ed14 View commit details
    Browse the repository at this point in the history

  6. feat: switch to new turbo models

    @parambharat
    parambharat committed Jan 31, 2024
    Configuration menu
    Copy the full SHA
    0d1fa36 View commit details
    Browse the repository at this point in the history

Commits on Feb 1, 2024

  1. revert: switch to older models for v1.1 before testing for v1.2

    @parambharat
    parambharat committed Feb 1, 2024
    Configuration menu
    Copy the full SHA
    acefd29 View commit details
    Browse the repository at this point in the history

  2. chore: run linting and formatting changes

    @parambharat
    parambharat committed Feb 1, 2024
    Configuration menu
    Copy the full SHA
    fe5b6b5 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'main' of github.com:wandb/wandbot into feat/v1.1

    @parambharat
    parambharat committed Feb 1, 2024
    Configuration menu
    Copy the full SHA
    48140fb View commit details
    Browse the repository at this point in the history